00000001:02000400:1.0F:1788200910.436086:0:2956:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788200919.734643:0:3158:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1788200920.579854:0:3218:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1331 MB/s 00000001:01000000:3.0F:1788200920.829707:0:3218:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1171 MB/s 00000001:01000000:2.0:1788200921.079469:0:3218:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3407 MB/s 00000020:02000000:1.0:1788200921.890016:0:3250:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.56_54_gb664824 00000400:02000000:3.0:1788200922.701992:0:3265:0:(api-ni.c:2822:lnet_startup_lndni()) Added LNI 192.168.201.156@tcp [8/256/0/180] 00008000:02000000:0.0:1788200925.996968:0:3415:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788200979.891969:0:5223:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788200990.343509:0:5806:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788200990.343517:0:5806:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788200990.343677:0:5806:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000004ffe6a1e 00000080:02000400:1.0:1788200990.343692:0:5806:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788200990.353449:0:5806:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788200990.353464:0:5806:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788200990.353507:0:5806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000074a6e4e6) 00000020:00000080:1.0:1788200990.353528:0:5806:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788200990.411119:0:5806:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788200990.412829:0:5806:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788200990.446316:0:5806:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788200990.446382:0:5806:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788200990.446403:0:5806:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788200990.446451:0:5806:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788200990.446473:0:5806:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788200990.446964:0:5806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788200990.446975:0:5806:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788200990.446989:0:5806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa81c4c9a2f3ca770 00000020:01000004:3.0:1788200990.446997:0:5806:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788200990.447003:0:5806:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788200990.447008:0:5806:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004ffe6a1e from MGS 00000020:01000004:3.0:1788200990.447013:0:5806:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788200990.447035:0:5806:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005a372682) 00000020:00000080:3.0:1788200990.447051:0:5806:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788200990.447130:0:5806:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004ffe6a1e from MGS, refs=2 00080000:01000000:3.0:1788200990.447135:0:5806:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788200990.447140:0:5806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa81c4c9a2f3ca77e 00000100:00100000:3.0:1788200990.447246:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788200990.447416:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788200990.447422:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788200990.449762:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788200990.449775:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788200990.450542:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788200990.450725:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788200990.450731:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788200990.451445:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788200990.451454:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788200990.451969:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788200990.451976:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788200990.452952:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200990.452956:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200990.452958:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200990.453297:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200990.453300:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200990.453302:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200990.454166:0:5806:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788200990.457078:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788200990.703523:0:5806:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2879 MB/s 00000001:01000000:2.0:1788200990.953833:0:5806:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3255 MB/s 00000001:01000000:2.0:1788200991.206880:0:5806:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 387 MB/s 00000001:01000000:1.0:1788200991.457599:0:5806:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 458 MB/s 00080000:10000000:0.0:1788200991.470064:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1788200991.478580:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788200991.488066:0:5806:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788200991.488084:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788200991.488087:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788200991.489169:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788200991.489243:0:5806:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788200991.489294:0:5806:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788200991.489649:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788200991.489670:0:5806:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788200991.491073:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788200991.491270:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788200991.491276:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788200991.493042:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788200991.493060:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788200991.493960:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788200991.493968:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788200991.497560:0:5806:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788200991.497584:0:5806:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.156@tcp' 00000020:01000004:3.0:1788200991.497586:0:5806:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:1.0:1788200991.497728:0:5821:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1788200991.500165:0:5806:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.156@tcp (typ=mgc) 00000020:00000080:3.0:1788200991.500191:0:5806:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.156@tcp (00000000b2f19940) 00000020:00000080:3.0:1788200991.500213:0:5806:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788200991.500361:0:5806:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ec07b177@MGC192.168.201.156@tcp: add connection 192.168.201.156@tcp at head 00010000:00010000:3.0:1788200991.500525:0:5806:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.156@tcp-0 is initialized 00000040:01000000:3.0:1788200991.500532:0:5806:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788200991.508143:0:5822:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788200991.508482:0:5806:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.156@tcp (uuid 64683b94-32c1-4e22-b29e-6bf9fd5f0adf) 00000020:00000080:2.0:1788200991.508513:0:5806:0:(genops.c:1406:class_connect()) connect: client 64683b94-32c1-4e22-b29e-6bf9fd5f0adf, cookie 0xa81c4c9a2f3ca78c 00000100:00080000:2.0:1788200991.508534:0:5806:0:(import.c:510:import_select_connection()) MGC192.168.201.156@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788200991.508540:0:5806:0:(import.c:624:import_select_connection()) MGC192.168.201.156@tcp: import 00000000ec07b177 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:2.0:1788200991.508578:0:5806:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000136f4fb7 x1875064569987200/t0(0) o250->MGC192.168.201.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788200991.508702:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000136f4fb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3281:1875064569987200:0@lo:250: 00000100:00100000:2.0:1788200991.508753:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788200991.508812:0:5806:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 64683b94-32c1-4e22-b29e-6bf9fd5f0adf->MGS 00000020:01000004:2.0:1788200991.508828:0:5806:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788200991.508846:0:5806:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788200991.508863:0:5806:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000044b5e6ce) 00000020:00000080:2.0:1788200991.508875:0:5806:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788200991.509248:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569987200 00000100:00100000:1.0:1788200991.509256:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569987200 00000100:00100000:1.0:1788200991.509283:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788200991.509290:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018092912 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3281:x1875064569987200:12345-0@lo:250: 00010000:00080000:1.0:1788200991.509311:0:5818:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 64683b94-32c1-4e22-b29e-6bf9fd5f0adf@0@lo t0 exp 0000000000000000 cur 123 last 0 00000020:00000080:1.0:1788200991.509373:0:5818:0:(genops.c:1406:class_connect()) connect: client 64683b94-32c1-4e22-b29e-6bf9fd5f0adf, cookie 0xa81c4c9a2f3ca79a 00000100:00080000:1.0:1788200991.509475:0:5818:0:(import.c:65:import_set_state_nolock()) 0000000067fc856e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788200991.509543:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018092912 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+5:3281:x1875064569987200:12345-0@lo:250: Request processed in 252us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200991.509550:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788200991.510609:0:3281:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.156@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788200991.510620:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.156@tcp: connect to target with instance 0 00000100:00080000:2.0:1788200991.510627:0:3281:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.156@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788200991.510631:0:3281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788200991.510634:0:3281:0:(import.c:65:import_set_state_nolock()) 00000000ec07b177 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788200991.510637:0:3281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788200991.510657:0:3281:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788200991.510663:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000136f4fb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3281:1875064569987200:0@lo:250: 00000100:00100000:2.0:1788200991.525965:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788200991.529292:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788200991.529307:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788200991.533059:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788200991.533074:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788200991.534070:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788200991.534078:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788200991.534981:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788200991.535211:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788200991.535217:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788200991.536153:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788200991.536163:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788200991.606575:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788200991.606772:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788200991.606780:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788200991.608976:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788200991.608990:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788200991.612842:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788200991.613023:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788200991.613029:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788200991.613924:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788200991.613933:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788200991.614746:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788200991.614904:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788200991.614910:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788200991.615635:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788200991.615642:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788200991.619272:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788200991.619514:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788200991.619526:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788200991.620215:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788200991.620224:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788200991.695065:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788200991.695297:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788200991.695304:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788200991.707791:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788200991.707817:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788200991.709212:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788200991.709231:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788200991.715855:0:5806:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788200991.715902:0:5806:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788200991.715909:0:5806:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788200991.716325:0:5806:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788200991.716591:0:5806:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.156@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788200991.716596:0:5806:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788200991.716600:0:5806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788200991.716601:0:5806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788200991.716602:0:5806:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788200991.716604:0:5806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788200991.716606:0:5806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788200991.716607:0:5806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788200991.716608:0:5806:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788200991.716610:0:5806:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788200991.716611:0:5806:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788200991.716613:0:5806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788200991.716614:0:5806:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788200991.716621:0:5806:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788200991.716624:0:5806:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788200991.716624:0:5806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788200991.716625:0:5806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788200991.716626:0:5806:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788200991.716627:0:5806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788200991.716628:0:5806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788200991.716628:0:5806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788200991.716629:0:5806:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788200991.716630:0:5806:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788200991.716631:0:5806:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788200991.716631:0:5806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788200991.716632:0:5806:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788200991.716947:0:5806:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788200991.716979:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000136f4fb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569987328:0@lo:253: 00000100:00100000:2.0:1788200991.717057:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200991.718234:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d95b5e0f going to sleep for 11 seconds 00000100:00100000:1.0:1788200991.728514:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569987328 00000100:00100000:1.0:1788200991.728529:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569987328 00000100:00100000:1.0:1788200991.728614:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788200991.728623:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c155ea6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+5:5806:x1875064569987328:12345-0@lo:253: 20000000:01000000:1.0:1788200991.728710:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788200991.728713:0:5820:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788200991.728924:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788200991.729297:0:5820:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788200991.729658:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788200991.737261:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788200991.743666:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788200991.743683:0:5820:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788200991.743691:0:5820:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788200991.743695:0:5820:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788200991.743713:0:5820:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788200991.744008:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788200991.744259:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788200991.744275:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788200991.744330:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788200991.744721:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788200991.744762:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788200991.744857:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788200991.744866:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788200991.744910:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788200991.744918:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788200991.744947:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788200991.744954:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788200991.745117:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788200991.745211:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788200991.745242:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788200991.745247:0:5820:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788200991.745258:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788200991.748738:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788200991.748774:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788200991.748842:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788200991.748875:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788200991.748918:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788200991.748937:0:5820:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788200991.754136:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788200991.754165:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788200991.754290:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788200991.758298:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788200991.758339:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788200991.758375:0:5820:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788200991.758539:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788200991.758550:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788200991.758579:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788200991.758609:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788200991.759943:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788200991.760026:0:5820:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788200991.760034:0:5820:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788200991.767600:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788200991.768240:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788200991.768272:0:5820:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.156@tcp for mdt 20000000:01000000:2.0:1788200991.768274:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.156@tcp (null) (null) (null) 00000040:00080000:2.0:1788200991.768326:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788200991.768334:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788200991.768785:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788200991.768795:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.156@tcp (null) (null) 00000040:00080000:2.0:1788200991.768844:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788200991.768855:0:5820:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788200991.768897:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788200991.768932:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788200991.769073:0:5820:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788200991.769077:0:5820:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788200991.769081:0:5820:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788200991.769092:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788200991.769095:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788200991.769127:0:5820:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788200991.769129:0:5820:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788200991.779245:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788200991.783235:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788200991.783292:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788200991.783494:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788200991.783510:0:5820:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788200991.783513:0:5820:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788200991.784804:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788200991.785223:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788200991.785304:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788200991.785553:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1788200991.785570:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788200991.785572:0:5820:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788200991.785577:0:5820:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788200991.785580:0:5820:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788200991.785586:0:5820:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788200991.785592:0:5820:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788200991.786624:0:5846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788200991.786854:0:5820:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788200991.799974:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788200991.800031:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788200991.800114:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788200991.800138:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788200991.800164:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000973c6dc8/0xa81c4c9a2f3ca7a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200991.800195:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000973c6dc8/0xa81c4c9a2f3ca7a1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200991.800206:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000973c6dc8/0xa81c4c9a2f3ca7a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200991.800212:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000973c6dc8/0xa81c4c9a2f3ca7a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200991.800218:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000973c6dc8/0xa81c4c9a2f3ca7a1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200991.800225:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000973c6dc8/0xa81c4c9a2f3ca7a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200991.800231:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000973c6dc8 already unused, calling callback (000000007d59dd3e) 00010000:00010000:3.0:1788200991.800235:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000973c6dc8/0xa81c4c9a2f3ca7a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200991.800262:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000973c6dc8/0xa81c4c9a2f3ca7a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200991.800276:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000973c6dc8/0xa81c4c9a2f3ca7a1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200991.800283:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000973c6dc8/0xa81c4c9a2f3ca7a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200991.800289:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000973c6dc8/0xa81c4c9a2f3ca7a1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788200991.800307:0:5820:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788200992.158389:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c155ea6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+5:5806:x1875064569987328:12345-0@lo:253: Request processed in 429759us (441324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200992.158408:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788200992.158570:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000136f4fb7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569987328:0@lo:253: 10000000:01000000:0.0:1788200992.158587:0:5806:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788200992.158590:0:5806:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788200992.158592:0:5806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788200992.158594:0:5806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788200992.158595:0:5806:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788200992.158596:0:5806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788200992.158597:0:5806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788200992.158598:0:5806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788200992.158600:0:5806:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788200992.158601:0:5806:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788200992.158603:0:5806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788200992.158604:0:5806:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788200992.158622:0:5806:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004ffe6a1e from lustre-MDT0000 10000000:01000000:0.0:1788200992.158646:0:5806:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788200992.158649:0:5806:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788200992.158653:0:5806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff962485b40000 10000000:01000000:0.0:1788200992.158657:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788200992.158664:0:5806:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff962485b40000 from 1 10000000:01000000:0.0:1788200992.158667:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788200992.158725:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 000000007ee6c4b0/0xa81c4c9a2f3ca7a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200992.158747:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 000000007ee6c4b0/0xa81c4c9a2f3ca7a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200992.158757:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 000000007ee6c4b0/0xa81c4c9a2f3ca7a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200992.158776:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eefd06d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569987456:0@lo:101: 00000100:00100000:0.0:1788200992.158814:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200992.158933:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569987456 00000100:00100000:1.0:1788200992.158940:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569987456 00000100:00100000:1.0:1788200992.158989:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788200992.158996:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7567d4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+5:5806:x1875064569987456:12345-0@lo:101: 00010000:00010000:1.0:1788200992.159011:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200992.159028:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea827759/0xa81c4c9a2f3ca7af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca7a8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200992.159059:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea827759/0xa81c4c9a2f3ca7af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca7a8 expref: 6 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200992.159069:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea827759/0xa81c4c9a2f3ca7af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca7a8 expref: 6 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200992.159079:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea827759, rc 0) 00000100:00100000:1.0:1788200992.159106:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7567d4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+6:5806:x1875064569987456:12345-0@lo:101: Request processed in 111us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200992.159112:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788200992.160521:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020b07841 going to sleep for 11 seconds 00000100:00100000:0.0:1788200992.160565:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eefd06d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569987456:0@lo:101: 00010000:00010000:0.0:1788200992.160586:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 000000007ee6c4b0/0xa81c4c9a2f3ca7a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca7af expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200992.160597:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 000000007ee6c4b0/0xa81c4c9a2f3ca7a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca7af expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200992.160694:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eefd06d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569987584:0@lo:501: 00000100:00100000:0.0:1788200992.160752:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200992.160836:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569987584 00000100:00100000:1.0:1788200992.160843:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569987584 00000100:00100000:1.0:1788200992.160884:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788200992.160892:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088d18f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+6:5806:x1875064569987584:12345-0@lo:501: 00000100:00100000:1.0:1788200992.161176:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088d18f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+6:5806:x1875064569987584:12345-0@lo:501: Request processed in 273us (413us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788200992.161184:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788200992.164729:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020b07841 going to sleep for 11 seconds 00000100:00100000:0.0:1788200992.164788:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eefd06d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569987584:0@lo:501: 10000000:01000000:0.0:1788200992.164843:0:5806:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788200992.164863:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 000000007ee6c4b0/0xa81c4c9a2f3ca7a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca7af expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200992.164874:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 000000007ee6c4b0/0xa81c4c9a2f3ca7a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca7af expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200992.164908:0:5806:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9624902af800 10000000:01000000:0.0:1788200992.164915:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788200992.164921:0:5806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9624902af800 10000000:01000000:0.0:1788200992.164925:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788200992.164928:0:5806:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9624902af800 from 1 10000000:01000000:0.0:1788200992.164931:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788200992.164983:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 0000000082ab6713/0xa81c4c9a2f3ca7b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200992.164991:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 0000000082ab6713/0xa81c4c9a2f3ca7b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200992.165002:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 0000000082ab6713/0xa81c4c9a2f3ca7b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200992.165023:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eefd06d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569987712:0@lo:101: 00000100:00100000:0.0:1788200992.165095:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200992.165134:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020b07841 going to sleep for 11 seconds 00000100:00100000:1.0:1788200992.165257:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569987712 00000100:00100000:1.0:1788200992.165264:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569987712 00000100:00100000:1.0:1788200992.165312:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788200992.165320:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf079531 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+6:5806:x1875064569987712:12345-0@lo:101: 00010000:00010000:1.0:1788200992.165336:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200992.165369:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c9f9bab0/0xa81c4c9a2f3ca7bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca7b6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200992.165394:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9f9bab0/0xa81c4c9a2f3ca7bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca7b6 expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200992.165417:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c9f9bab0/0xa81c4c9a2f3ca7bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca7b6 expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200992.165425:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c9f9bab0, rc 0) 00000100:00100000:1.0:1788200992.165474:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf079531 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+7:5806:x1875064569987712:12345-0@lo:101: Request processed in 154us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200992.165481:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788200992.166248:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eefd06d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569987712:0@lo:101: 00010000:00010000:0.0:1788200992.166267:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 0000000082ab6713/0xa81c4c9a2f3ca7b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca7bd expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200992.166277:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 0000000082ab6713/0xa81c4c9a2f3ca7b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca7bd expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200992.166291:0:5806:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788200992.166308:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 0000000082ab6713/0xa81c4c9a2f3ca7b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca7bd expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200992.166330:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 0000000082ab6713/0xa81c4c9a2f3ca7b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca7bd expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200992.166338:0:5806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788200992.166378:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788200992.166384:0:5806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9624902af800 10000000:01000000:0.0:1788200992.166387:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788200992.166390:0:5806:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788200992.166393:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788200992.166416:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 0000000013d147a6/0xa81c4c9a2f3ca7c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200992.166423:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 0000000013d147a6/0xa81c4c9a2f3ca7c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200992.166430:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 0000000013d147a6/0xa81c4c9a2f3ca7c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200992.166446:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eefd06d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569987840:0@lo:101: 00000100:00100000:0.0:1788200992.166484:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200992.166515:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020b07841 going to sleep for 11 seconds 00000100:00100000:1.0:1788200992.166638:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569987840 00000100:00100000:1.0:1788200992.166645:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569987840 00000100:00100000:1.0:1788200992.166685:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788200992.166692:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8011e73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+7:5806:x1875064569987840:12345-0@lo:101: 00010000:00010000:1.0:1788200992.166703:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200992.166713:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f42e1c2a/0xa81c4c9a2f3ca7cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca7c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200992.166732:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f42e1c2a/0xa81c4c9a2f3ca7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca7c4 expref: 8 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200992.166741:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f42e1c2a/0xa81c4c9a2f3ca7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca7c4 expref: 8 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200992.166748:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f42e1c2a, rc 0) 00000100:00100000:1.0:1788200992.166779:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8011e73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+8:5806:x1875064569987840:12345-0@lo:101: Request processed in 88us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200992.166785:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788200992.166867:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eefd06d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569987840:0@lo:101: 00010000:00010000:0.0:1788200992.166877:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 0000000013d147a6/0xa81c4c9a2f3ca7c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca7cb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200992.166884:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 0000000013d147a6/0xa81c4c9a2f3ca7c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca7cb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200992.166945:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eefd06d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569987968:0@lo:501: 00000100:00100000:0.0:1788200992.166971:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200992.167039:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020b07841 going to sleep for 11 seconds 00000100:00100000:3.0:1788200992.172686:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569987968 00000100:00100000:3.0:1788200992.172704:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569987968 00000100:00100000:3.0:1788200992.172757:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788200992.172766:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000517bfaa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+8:5806:x1875064569987968:12345-0@lo:501: 00000100:00100000:3.0:1788200992.173118:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000517bfaa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+9:5806:x1875064569987968:12345-0@lo:501: Request processed in 352us (6144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200992.173126:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788200992.173610:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eefd06d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569987968:0@lo:501: 00000100:00100000:1.0:1788200992.173697:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000094b7276a pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569988096:0@lo:503: 00000100:00100000:1.0:1788200992.173756:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200992.173815:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 000000005e1891f6 going to sleep for 11 seconds 00000100:00100000:3.0:1788200992.173960:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569988096 00000100:00100000:3.0:1788200992.173966:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569988096 00000100:00100000:3.0:1788200992.174001:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788200992.174008:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d7ed277 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+9:5806:x1875064569988096:12345-0@lo:503: 00000100:00100000:3.0:1788200992.174211:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d7ed277 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+9:5806:x1875064569988096:12345-0@lo:503: Request processed in 203us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200992.174218:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788200992.174307:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000094b7276a pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569988096:0@lo:503: 00000100:00100000:2.0:1788200992.174892:0:5848:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f380585f pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5848:1875064569988224:0@lo:502: 00000100:00100000:2.0:1788200992.174941:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200992.174978:0:5848:0:(client.c:2702:ptlrpc_set_wait()) set 0000000000d246a8 going to sleep for 11 seconds 00000100:00100000:3.0:1788200992.175032:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569988224 00000100:00100000:3.0:1788200992.175043:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569988224 00000100:00100000:3.0:1788200992.175077:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788200992.175084:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d93bcc07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+9:5848:x1875064569988224:12345-0@lo:502: 00000100:00100000:3.0:1788200992.175268:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d93bcc07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+9:5848:x1875064569988224:12345-0@lo:502: Request processed in 185us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200992.175276:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788200992.175471:0:5848:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f380585f pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5848:1875064569988224:0@lo:502: 00000020:01000000:2.0:1788200992.175496:0:5848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788200992.175508:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200992.175510:0:5848:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788200992.175516:0:5848:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788200992.175519:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788200992.175535:0:5848:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000035b78749) 00000020:00000080:2.0:1788200992.175554:0:5848:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788200992.175562:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788200992.175647:0:5848:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788200992.175654:0:5848:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa81c4c9a2f3ca7d9 00000020:00000080:2.0:1788200992.175891:0:5848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788200992.175896:0:5848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788200992.175900:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200992.175907:0:5848:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788200992.175911:0:5848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788200992.175915:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200992.175916:0:5848:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788200992.175920:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788200992.175927:0:5848:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000003bd89da4) 00000020:00000080:2.0:1788200992.175938:0:5848:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788200992.175942:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788200992.175943:0:5848:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788200992.175946:0:5848:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788200992.175953:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788200992.176003:0:5848:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004ffe6a1e from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788200992.176016:0:5848:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000006ba9e20d) 00000020:00000080:2.0:1788200992.176023:0:5848:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788200992.176075:0:5848:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788200992.176081:0:5848:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa81c4c9a2f3ca7ee 00000020:00000080:2.0:1788200992.176182:0:5848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788200992.176189:0:5848:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788200992.176193:0:5848:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa81c4c9a2f3ca7f5 00080000:01000000:2.0:1788200992.176198:0:5848:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788200992.176201:0:5848:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa81c4c9a2f3ca7fc 00080000:10000000:2.0:1788200992.178545:0:5848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788200992.178988:0:5848:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788200992.190980:0:5848:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788200992.407080:0:5848:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788200992.407747:0:5848:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788200992.410609:0:5848:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788200992.410914:0:5848:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788200992.439804:0:5848:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c35d28a3) 00000020:00000080:2.0:1788200992.439831:0:5848:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788200992.439915:0:5848:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788200992.439924:0:5848:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa81c4c9a2f3ca80a 00000020:00000080:1.0:1788200992.450607:0:5848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788200992.452757:0:5848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00010000:00010000:1.0:1788200992.504185:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788200992.540581:0:5848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788200992.591737:0:5848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788200992.686576:0:5848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788200992.796820:0:5848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788200992.876758:0:5848:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788200992.973004:0:5848:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa81c4c9a2f3ca811 00000020:00000080:1.0:1788200992.977121:0:5848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788200992.977138:0:5848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788200992.977159:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200992.977161:0:5848:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788200992.977166:0:5848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788200992.977170:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200992.977171:0:5848:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788200992.977174:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788200992.977176:0:5848:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788200992.977179:0:5848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788200992.977180:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200992.977181:0:5848:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788200992.977183:0:5848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788200992.977188:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200992.977189:0:5848:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788200992.977192:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788200992.977238:0:5848:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788200992.977313:0:5848:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001b23fac9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5848:1875064569988352:0@lo:502: 00000100:00100000:1.0:1788200992.977454:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200992.977518:0:5848:0:(client.c:2702:ptlrpc_set_wait()) set 000000000c7e1bfd going to sleep for 11 seconds 00000100:00100000:3.0:1788200992.977768:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569988352 00000100:00100000:3.0:1788200992.977777:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569988352 00000100:00100000:3.0:1788200992.977836:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788200992.977846:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ebee721 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+9:5848:x1875064569988352:12345-0@lo:502: 00000100:00100000:3.0:1788200992.978144:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ebee721 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+9:5848:x1875064569988352:12345-0@lo:502: Request processed in 298us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200992.978162:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788200992.978225:0:5848:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001b23fac9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5848:1875064569988352:0@lo:502: 00000020:01000000:3.0:1788200992.978254:0:5848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788200992.978260:0:5848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788200992.978261:0:5848:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788200992.978265:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788200992.978440:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788200992.978467:0:5806:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788200992.978482:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 0000000013d147a6/0xa81c4c9a2f3ca7c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca7cb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200992.978493:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 0000000013d147a6/0xa81c4c9a2f3ca7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca7cb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200992.978514:0:5806:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9624902af800 from 1 10000000:01000000:3.0:1788200992.978516:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788200992.978557:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200992.978565:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200992.978574:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200992.978590:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569988480:0@lo:101: 00000100:00100000:3.0:1788200992.978623:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200992.978845:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0f546b7 going to sleep for 11 seconds 00000100:00100000:3.0:1788200992.978878:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569988480 00000100:00100000:3.0:1788200992.978885:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569988480 00000100:00100000:3.0:1788200992.978915:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788200992.978922:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000715d5f27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+9:5806:x1875064569988480:12345-0@lo:101: 00010000:00010000:3.0:1788200992.978936:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200992.978950:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000012e252b6/0xa81c4c9a2f3ca81f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca818 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200992.978974:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012e252b6/0xa81c4c9a2f3ca81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca818 expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200992.978984:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000012e252b6/0xa81c4c9a2f3ca81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca818 expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200992.978993:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000012e252b6, rc 0) 00000100:00100000:3.0:1788200992.979037:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000715d5f27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+10:5806:x1875064569988480:12345-0@lo:101: Request processed in 115us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200992.979043:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788200992.979149:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569988480:0@lo:101: 00010000:00010000:3.0:1788200992.979173:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca81f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200992.979182:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca81f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200992.981879:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569988608:0@lo:256: 00000100:00100000:3.0:1788200992.982590:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200992.982856:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569988608 00000100:00100000:1.0:1788200992.982867:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569988608 00000100:00100000:1.0:1788200992.982921:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788200992.982929:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059d26f89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+10:5806:x1875064569988608:12345-0@lo:256: 20000000:01000000:1.0:1788200992.982981:0:5820:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788200992.982988:0:5820:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788200992.983485:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059d26f89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+10:5806:x1875064569988608:12345-0@lo:256: Request processed in 554us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200992.983493:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788200992.983855:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0f546b7 going to sleep for 11 seconds 00000100:00100000:3.0:1788200992.983881:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569988608:0@lo:256: 10000000:01000000:3.0:1788200992.988986:0:5806:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788200992.989080:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca81f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200992.989095:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca81f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200992.989104:0:5806:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9624902af800 from 1 10000000:01000000:3.0:1788200992.989107:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788200992.989171:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200992.989180:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200992.989206:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200992.989231:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569988736:0@lo:101: 00000100:00100000:3.0:1788200992.989317:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200992.989447:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569988736 00000100:00100000:1.0:1788200992.989456:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569988736 00000100:00100000:1.0:1788200992.989505:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788200992.989513:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f6d4003 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+10:5806:x1875064569988736:12345-0@lo:101: 00010000:00010000:1.0:1788200992.989527:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200992.989541:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c197e36/0xa81c4c9a2f3ca82d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca826 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200992.989561:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c197e36/0xa81c4c9a2f3ca82d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca826 expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200992.989570:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c197e36/0xa81c4c9a2f3ca82d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca826 expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200992.989578:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c197e36, rc 0) 00000100:00100000:1.0:1788200992.989612:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f6d4003 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:5806:x1875064569988736:12345-0@lo:101: Request processed in 100us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200992.989618:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788200992.992660:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0f546b7 going to sleep for 11 seconds 00000100:00100000:3.0:1788200992.992707:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569988736:0@lo:101: 00010000:00010000:3.0:1788200992.992734:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca82d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200992.992746:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca82d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200992.992835:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569988864:0@lo:501: 00000100:00100000:3.0:1788200992.992899:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200992.993170:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0f546b7 going to sleep for 11 seconds 00000100:00100000:0.0:1788200992.993519:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569988864 00000100:00100000:0.0:1788200992.993527:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569988864 00000100:00100000:0.0:1788200992.993593:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788200992.993602:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002a7e5dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:5806:x1875064569988864:12345-0@lo:501: 00000100:00100000:0.0:1788200992.996317:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002a7e5dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:5806:x1875064569988864:12345-0@lo:501: Request processed in 2697us (3399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200992.996333:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788200992.996881:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569988864:0@lo:501: 00000100:00100000:3.0:1788200992.997138:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569988992:0@lo:503: 00000100:00100000:3.0:1788200992.997276:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200992.997701:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0f546b7 going to sleep for 11 seconds 00000100:00100000:1.0:1788200992.997835:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569988992 00000100:00100000:1.0:1788200992.997844:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569988992 00000100:00100000:1.0:1788200992.997894:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788200992.997901:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f4de00b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:5806:x1875064569988992:12345-0@lo:503: 00000040:00080000:1.0:1788200992.998134:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788200992.998323:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f4de00b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:5806:x1875064569988992:12345-0@lo:503: Request processed in 421us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200992.998331:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788200993.001591:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569988992:0@lo:503: 00000040:00080000:1.0:1788200993.006826:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788200993.008452:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788200993.008498:0:5806:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788200993.008530:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca82d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200993.008578:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca82d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200993.008635:0:5806:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788200993.008638:0:5806:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9624902af800 10000000:01000000:3.0:1788200993.008641:0:5806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9624902af800 10000000:01000000:3.0:1788200993.008767:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788200993.008775:0:5806:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9624902af800 from 1 10000000:01000000:3.0:1788200993.008778:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788200993.008817:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 00000000f0ee25f4/0xa81c4c9a2f3ca834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200993.008827:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 00000000f0ee25f4/0xa81c4c9a2f3ca834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200993.008837:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 00000000f0ee25f4/0xa81c4c9a2f3ca834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200993.008860:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569989120:0@lo:101: 00000100:00100000:3.0:1788200993.009128:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200993.009408:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dffcec3 going to sleep for 11 seconds 00000100:00100000:1.0:1788200993.009749:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569989120 00000100:00100000:1.0:1788200993.009759:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569989120 00000100:00100000:1.0:1788200993.009859:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788200993.009869:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bd53dab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:5806:x1875064569989120:12345-0@lo:101: 00010000:00010000:1.0:1788200993.009891:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200993.009911:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e4761f8/0xa81c4c9a2f3ca83b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca834 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.010020:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e4761f8/0xa81c4c9a2f3ca83b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca834 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.010031:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e4761f8/0xa81c4c9a2f3ca83b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca834 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.010040:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e4761f8, rc 0) 00000100:00100000:1.0:1788200993.010288:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bd53dab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5806:x1875064569989120:12345-0@lo:101: Request processed in 420us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200993.010296:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788200993.010447:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569989120:0@lo:101: 00010000:00010000:3.0:1788200993.010462:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 00000000f0ee25f4/0xa81c4c9a2f3ca834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca83b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200993.010471:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 00000000f0ee25f4/0xa81c4c9a2f3ca834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca83b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200993.010559:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569989248:0@lo:501: 00000100:00100000:3.0:1788200993.010592:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200993.011528:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dffcec3 going to sleep for 11 seconds 00000100:00100000:2.0:1788200993.011631:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569989248 00000100:00100000:2.0:1788200993.011639:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569989248 00000100:00100000:2.0:1788200993.011699:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788200993.011705:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087931def pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5806:x1875064569989248:12345-0@lo:501: 00000100:00100000:2.0:1788200993.012015:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087931def pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5806:x1875064569989248:12345-0@lo:501: Request processed in 308us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200993.012022:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788200993.012567:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569989248:0@lo:501: 00000100:00100000:3.0:1788200993.012614:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569989376:0@lo:503: 00000100:00100000:3.0:1788200993.012673:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200993.012695:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dffcec3 going to sleep for 11 seconds 00000100:00100000:2.0:1788200993.012882:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569989376 00000100:00100000:2.0:1788200993.012888:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569989376 00000100:00100000:2.0:1788200993.012914:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788200993.012932:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038557d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5806:x1875064569989376:12345-0@lo:503: 00000100:00100000:2.0:1788200993.013393:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038557d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5806:x1875064569989376:12345-0@lo:503: Request processed in 470us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200993.013401:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788200993.013577:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569989376:0@lo:503: 00000100:00100000:3.0:1788200993.014641:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5853:1875064569989504:0@lo:502: 00000100:00100000:3.0:1788200993.014777:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200993.014852:0:5853:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b6efa059 going to sleep for 11 seconds 00000100:00100000:2.0:1788200993.014890:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569989504 00000100:00100000:2.0:1788200993.014897:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569989504 00000100:00100000:2.0:1788200993.015022:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788200993.015030:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063b4ba26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5853:x1875064569989504:12345-0@lo:502: 00000100:00100000:2.0:1788200993.016687:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063b4ba26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5853:x1875064569989504:12345-0@lo:502: Request processed in 1646us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200993.016704:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788200993.017141:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5853:1875064569989504:0@lo:502: 00000020:01000004:3.0:1788200993.022907:0:5853:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788200993.023018:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d919d3af) 00000020:00000080:3.0:1788200993.023046:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788200993.023629:0:5853:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004ffe6a1e from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788200993.023634:0:5853:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004ffe6a1e from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788200993.023637:0:5853:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004ffe6a1e 4 00010000:00080000:3.0:1788200993.023749:0:5853:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bddeabad@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.156@tcp at head 00010000:00010000:3.0:1788200993.028818:0:5853:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788200993.028926:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788200993.028965:0:5853:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788200993.028980:0:5853:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa81c4c9a2f3ca849 00000100:00080000:3.0:1788200993.028991:0:5853:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788200993.028997:0:5853:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000bddeabad using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1788200993.029043:0:5853:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c81a45ed x1875064569989632/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788200993.034139:0:5853:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788200993.034862:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073465e35 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5853:1875064569989760:0@lo:502: 00000100:00100000:3.0:1788200993.034972:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200993.035021:0:5853:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b6efa059 going to sleep for 11 seconds 00000100:00100000:0.0:1788200993.035201:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569989760 00000100:00100000:0.0:1788200993.035211:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569989760 00000100:00100000:0.0:1788200993.035260:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788200993.035268:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003a4780b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5853:x1875064569989760:12345-0@lo:502: 00000100:00100000:0.0:1788200993.035555:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003a4780b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5853:x1875064569989760:12345-0@lo:502: Request processed in 286us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200993.035564:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788200993.035915:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875064569989632:0@lo:38: 00000100:00100000:3.0:1788200993.036177:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073465e35 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5853:1875064569989760:0@lo:502: 00000040:00080000:3.0:1788200993.036210:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1788200993.036437:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788200993.037445:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788200993.037548:0:5806:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788200993.037573:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 00000000f0ee25f4/0xa81c4c9a2f3ca834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca83b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200993.037586:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 00000000f0ee25f4/0xa81c4c9a2f3ca834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca83b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788200993.037774:0:5806:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788200993.037776:0:5806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788200993.037778:0:5806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788200993.037779:0:5806:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788200993.037780:0:5806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788200993.037781:0:5806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788200993.037783:0:5806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788200993.037784:0:5806:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788200993.037786:0:5806:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788200993.037787:0:5806:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788200993.037788:0:5806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788200993.037790:0:5806:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788200993.037793:0:5806:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788200993.037796:0:5806:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788200993.037797:0:5806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788200993.037798:0:5806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788200993.037799:0:5806:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788200993.037800:0:5806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788200993.037802:0:5806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788200993.037803:0:5806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788200993.037803:0:5806:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788200993.037804:0:5806:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788200993.037805:0:5806:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788200993.037806:0:5806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788200993.037807:0:5806:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788200993.037830:0:5806:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788200993.037845:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0971398 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569989888:0@lo:253: 00000100:00100000:2.0:1788200993.037897:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200993.037989:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569989632 00000100:00100000:0.0:1788200993.037998:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569989632 00000100:00100000:0.0:1788200993.038032:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788200993.038038:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f380585f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875064569989632:12345-0@lo:38: 00000100:00100000:0.0:1788200993.038111:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f380585f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875064569989632:12345-0@lo:38: Request processed in 72us (1673us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788200993.038130:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788200993.038181:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788200993.038187:0:3281:0:(import.c:65:import_set_state_nolock()) 00000000bddeabad lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200993.038192:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788200993.038195:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c81a45ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875064569989632:0@lo:38: 00000100:00100000:2.0:1788200993.038820:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 000000004caf7cda going to sleep for 11 seconds 00000100:00100000:3.0:1788200993.048867:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569989888 00000100:00100000:3.0:1788200993.048886:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569989888 00000100:00100000:2.0:1788200993.053954:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788200993.053972:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad950838 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5806:x1875064569989888:12345-0@lo:253: 20000000:01000000:2.0:1788200993.054041:0:5820:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788200993.054270:0:5820:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788200993.123814:0:5820:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788200993.123881:0:5820:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788200993.124422:0:5841:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788200993.124430:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788200993.124460:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200993.124483:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000012e252b6/0xa81c4c9a2f3ca81f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca818 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200993.124491:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200993.124542:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000012e252b6/0xa81c4c9a2f3ca81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca818 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200993.124561:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000012e252b6/0xa81c4c9a2f3ca81f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca818 expref: 12 pid: 5820 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200993.124576:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038e34a7f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064569990016:0@lo:104: 00000100:00100000:0.0:1788200993.124721:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200993.124837:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b82e6a3b going to sleep for 11 seconds 00000100:00100000:1.0:1788200993.132129:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569990016 00000100:00100000:1.0:1788200993.132160:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569990016 00000100:00100000:1.0:1788200993.132226:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788200993.132237:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003689269e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064569990016:12345-0@lo:104: 00010000:00010000:1.0:1788200993.132258:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca81f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.132389:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788200993.132407:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003689269e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064569990016:12345-0@lo:104: Request processed in 173us (7687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200993.132414:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788200993.132448:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200993.132454:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca81f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.132462:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000973c6dc8 already unused, calling callback (00000000544f7bfe) 10000000:00010000:1.0:1788200993.132465:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca81f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.132473:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca81f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200993.132479:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca81f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200993.132485:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788200993.132520:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca81f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.132526:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788200993.132546:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca81f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.132553:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: 00000000973c6dc8/0xa81c4c9a2f3ca818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca81f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.132574:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200993.132576:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200993.132577:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200993.132686:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001fa12748 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064569990144:0@lo:103: 00000100:00100000:1.0:1788200993.132722:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200993.132806:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569990144 00000100:00100000:1.0:1788200993.132811:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569990144 00010000:00010000:1.0:1788200993.132825:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000012e252b6/0xa81c4c9a2f3ca81f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca818 expref: 13 pid: 5820 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788200993.132846:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788200993.132851:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008904e13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:3283:x1875064569990144:12345-0@lo:103: 00010000:00010000:1.0:1788200993.132860:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788200993.132865:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000012e252b6/0xa81c4c9a2f3ca81f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca818 expref: 13 pid: 5820 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.132876:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000012e252b6/0xa81c4c9a2f3ca81f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca818 expref: 13 pid: 5820 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.132896:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.132903:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788200993.132918:0:5810:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008489459s 00010000:00010000:1.0:1788200993.133270:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.133279:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.133283:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.133513:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.133518:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b1bc5296 already unused, calling callback (000000007d59dd3e) 00010000:00010000:1.0:1788200993.133521:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.133528:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.133538:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200993.133547:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788200993.133587:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008904e13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:3283:x1875064569990144:12345-0@lo:103: Request processed in 736us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200993.133594:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788200993.133635:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001fa12748 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064569990144:0@lo:103: 00010000:00010000:0.0:1788200993.134232:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012e252b6/0xa81c4c9a2f3ca81f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca818 expref: 12 pid: 5820 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200993.134250:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038e34a7f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064569990016:0@lo:104: 00010000:00010000:0.0:1788200993.134278:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200993.134286:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200993.134291:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200993.134296:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b1bc5296/0xa81c4c9a2f3ca850 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200993.146587:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad950838 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:5806:x1875064569989888:12345-0@lo:253: Request processed in 92611us (108681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200993.146604:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788200993.146780:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0971398 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5806:1875064569989888:0@lo:253: 10000000:01000000:2.0:1788200993.146812:0:5806:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788200993.146815:0:5806:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788200993.146817:0:5806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788200993.146819:0:5806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788200993.146820:0:5806:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788200993.146821:0:5806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788200993.146823:0:5806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788200993.146824:0:5806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788200993.146825:0:5806:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788200993.146826:0:5806:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788200993.146827:0:5806:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788200993.146829:0:5806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788200993.146830:0:5806:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788200993.146845:0:5806:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788200993.159610:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788200993.159941:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788200993.160174:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788200993.160384:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788200993.160603:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788200993.160790:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788200993.169520:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788200993.169874:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788200993.170752:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788200993.171279:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788200993.171795:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788200993.177608:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788200993.318442:0:5806:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788200993.416040:0:5806:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788200993.416846:0:5859:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1788200993.418680:0:5858:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788200993.418686:0:5858:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788200993.429522:0:5806:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788200993.430390:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788200993.433962:0:5806:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788200993.439616:0:5806:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788200993.439900:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788200993.441481:0:5806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788200993.442338:0:5806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788200993.442491:0:5806:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788200993.442945:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788200993.443292:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788200993.445426:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788200993.445572:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788200993.445827:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788200993.446219:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788200993.446392:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788200993.446557:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788200993.446852:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788200993.447110:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788200993.447258:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788200993.447556:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788200993.447808:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788200993.448129:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788200993.448305:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788200993.448618:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788200993.448846:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788200993.449123:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788200993.449626:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788200993.449845:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788200993.450189:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788200993.450314:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788200993.450624:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788200993.450805:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788200993.451030:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788200993.451538:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788200993.451717:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788200993.451868:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788200993.452204:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788200993.452401:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788200993.452557:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788200993.452862:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788200993.453032:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788200993.453283:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788200993.453809:0:5806:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788200993.512442:0:5859:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:1.0:1788200993.526482:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788200993.553207:0:5806:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788200993.553249:0:5806:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbdaf01c73988 00100000:10000000:1.0:1788200993.553260:0:5806:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788200993.554231:0:5806:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788200993.554253:0:5806:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788200993.554271:0:5806:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788200993.554293:0:5806:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788200993.614782:0:5859:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788200993.614874:0:5859:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788200993.614878:0:5859:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788200994.554062:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200995.575686:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200996.598560:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200997.624322:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788200998.456400:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788200998.456412:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200998.456415:0:37:0:(import.c:65:import_set_state_nolock()) 00000000bddeabad lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200998.456429:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000bddeabad using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788200998.456451:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000062da7f01 x1875064569990400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788200998.456491:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000062da7f01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875064569990400:0@lo:38: 00000100:00100000:0.0:1788200998.456565:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200998.456662:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569990400 00000100:00100000:0.0:1788200998.456670:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569990400 00000100:00100000:0.0:1788200998.456701:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788200998.456707:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fe0cbf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875064569990400:12345-0@lo:38: 00010000:00080000:0.0:1788200998.456733:0:5827:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 130 last 0 00000020:00000080:0.0:1788200998.456767:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa81c4c9a2f3ca857 00000004:00100000:0.0:1788200998.456809:0:5827:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788200998.457191:0:5827:0:(import.c:65:import_set_state_nolock()) 0000000060ef438e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788200998.457262:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fe0cbf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875064569990400:12345-0@lo:38: Request processed in 553us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200998.457269:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788200998.457313:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000062da7f01 x1875064569990400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788200998.457328:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788200998.457335:0:3281:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788200998.457339:0:3281:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788200998.457362:0:3281:0:(import.c:65:import_set_state_nolock()) 00000000bddeabad lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788200998.457367:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000062da7f01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875064569990400:0@lo:38: 00000100:00100000:1.0:1788200998.458280:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038e34a7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064569990272:0@lo:400: 00000100:00100000:1.0:1788200998.458336:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200998.458454:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569990272 00000100:00100000:1.0:1788200998.458461:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569990272 00000100:00100000:1.0:1788200998.458499:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788200998.458506:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000572df7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:3284:x1875064569990272:12345-0@lo:400: 00000100:00100000:1.0:1788200998.458550:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000572df7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:3284:x1875064569990272:12345-0@lo:400: Request processed in 45us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200998.458557:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788200998.458595:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038e34a7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064569990272:0@lo:400: 00010000:00010000:0.0:1788200998.648749:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788200998.863060:0:6102:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788200999.670483:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201000.705611:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788201001.526516:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201001.526523:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9624902af800 from 3 10000000:01000000:1.0:1788201001.526527:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201001.526566:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 00000000b04494a6/0xa81c4c9a2f3ca85e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201001.526577:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 00000000b04494a6/0xa81c4c9a2f3ca85e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201001.526585:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 00000000b04494a6/0xa81c4c9a2f3ca85e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201001.526601:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001fa12748 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569990528:0@lo:101: 00000100:00100000:1.0:1788201001.526658:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201001.526715:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 000000000f03b90f going to sleep for 11 seconds 00000100:00100000:3.0:1788201001.527130:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569990528 00000100:00100000:3.0:1788201001.527138:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569990528 00000100:00100000:3.0:1788201001.527180:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201001.527185:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078588746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:5822:x1875064569990528:12345-0@lo:101: 00010000:00010000:3.0:1788201001.527197:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201001.527209:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000206f564/0xa81c4c9a2f3ca865 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca85e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201001.527226:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000206f564/0xa81c4c9a2f3ca865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca85e expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201001.527246:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000206f564/0xa81c4c9a2f3ca865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca85e expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201001.527253:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000206f564, rc 0) 00000100:00100000:3.0:1788201001.527297:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078588746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5822:x1875064569990528:12345-0@lo:101: Request processed in 112us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201001.527302:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201001.527388:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001fa12748 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569990528:0@lo:101: 00010000:00010000:2.0:1788201001.527403:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 00000000b04494a6/0xa81c4c9a2f3ca85e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca865 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201001.527410:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 00000000b04494a6/0xa81c4c9a2f3ca85e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca865 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201001.527465:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0971398 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569990656:0@lo:256: 00000100:00100000:2.0:1788201001.527490:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201001.527513:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 000000009bb89881 going to sleep for 11 seconds 00000100:00100000:0.0:1788201001.527557:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569990656 00000100:00100000:0.0:1788201001.527561:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569990656 00000100:00100000:0.0:1788201001.527585:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201001.527589:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cb983e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5822:x1875064569990656:12345-0@lo:256: 20000000:01000000:0.0:1788201001.527599:0:5819:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201001.527612:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201001.527614:0:5819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788201001.527677:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cb983e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5822:x1875064569990656:12345-0@lo:256: Request processed in 87us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201001.527682:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788201001.527765:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0971398 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569990656:0@lo:256: 10000000:01000000:2.0:1788201001.527799:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201001.527805:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 00000000b04494a6/0xa81c4c9a2f3ca85e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca865 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201001.527820:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 00000000b04494a6/0xa81c4c9a2f3ca85e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca865 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201001.720998:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201002.742548:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201003.584780:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073465e35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064569990784:0@lo:400: 00000100:00100000:2.0:1788201003.584870:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201003.585066:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001bde95c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064569990912:0@lo:400: 00000100:00100000:3.0:1788201003.585115:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201003.585169:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569990912 00000100:00100000:3.0:1788201003.585176:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569990912 00000100:00100000:3.0:1788201003.585225:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201003.585233:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d74053e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064569990912:12345-0@lo:400: 00000100:00100000:3.0:1788201003.585284:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d74053e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064569990912:12345-0@lo:400: Request processed in 52us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201003.585291:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788201003.585332:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001bde95c0 x1875064569990912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201003.585376:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001bde95c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064569990912:0@lo:400: 00000100:00100000:3.0:1788201003.589662:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569990784 00000100:00100000:3.0:1788201003.589680:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569990784 00000100:00100000:3.0:1788201003.589758:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201003.589766:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059ee5368 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:3285:x1875064569990784:12345-0@lo:400: 00000100:00100000:3.0:1788201003.597776:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059ee5368 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:3285:x1875064569990784:12345-0@lo:400: Request processed in 8002us (12897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201003.597802:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201003.598646:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073465e35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064569990784:0@lo:400: 00010000:00010000:0.0:1788201003.767531:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201003.905696:0:6304:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5168cbd0 20000000:00000080:1.0:1788201003.905714:0:6304:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9624b9f7c800 uarg=0000000000000000 20000000:01000000:1.0:1788201003.905749:0:6304:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788201003.905755:0:6304:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788201003.905762:0:6304:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788201003.906074:0:6304:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788201003.906085:0:6304:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788201003.909852:0:6304:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201003.910136:0:6304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788201003.910312:0:6304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788201003.910600:0:6304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788201003.910617:0:6304:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788201003.910636:0:6304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201003.910655:0:6304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005c197e36/0xa81c4c9a2f3ca82d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca826 expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201003.910663:0:6304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201003.910709:0:6304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005c197e36/0xa81c4c9a2f3ca82d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca826 expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201003.910724:0:6304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005c197e36/0xa81c4c9a2f3ca82d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca826 expref: 11 pid: 5819 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201003.910740:0:6304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002f2aa67f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6304:1875064569991040:0@lo:104: 00000100:00100000:1.0:1788201003.910820:0:6304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201003.910901:0:6304:0:(client.c:2702:ptlrpc_set_wait()) set 000000004148cad1 going to sleep for 11 seconds 00000100:00100000:3.0:1788201003.911485:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569991040 00000100:00100000:3.0:1788201003.911494:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569991040 00000100:00100000:3.0:1788201003.911572:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201003.911581:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2058cf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:6304:x1875064569991040:12345-0@lo:104: 00010000:00010000:3.0:1788201003.911593:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca82d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201003.911659:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201003.911664:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2058cf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:6304:x1875064569991040:12345-0@lo:104: Request processed in 86us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201003.911670:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201003.912405:0:6304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002f2aa67f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6304:1875064569991040:0@lo:104: 00010000:00010000:0.0:1788201003.912427:0:6304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201003.912802:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201003.912808:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca82d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201003.912817:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000620ed103 already unused, calling callback (00000000544f7bfe) 10000000:00010000:3.0:1788201003.912819:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca82d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201003.912828:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca82d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201003.912834:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca82d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201003.912838:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201003.912913:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca82d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201003.912936:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201003.912993:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788201003.913038:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca82d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201003.913045:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: 00000000620ed103/0xa81c4c9a2f3ca826 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca82d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201003.913062:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201003.913063:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201003.913064:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201003.913943:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001bde95c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064569991168:0@lo:103: 00000100:00100000:0.0:1788201003.914008:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201003.914105:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569991168 00000100:00100000:2.0:1788201003.914112:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569991168 00010000:00010000:2.0:1788201003.914139:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005c197e36/0xa81c4c9a2f3ca82d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca826 expref: 12 pid: 5819 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201003.914173:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201003.914180:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062da7f01 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:3282:x1875064569991168:12345-0@lo:103: 00010000:00010000:2.0:1788201003.914289:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201003.914294:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005c197e36/0xa81c4c9a2f3ca82d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca826 expref: 12 pid: 5819 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201003.914305:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005c197e36/0xa81c4c9a2f3ca82d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca826 expref: 12 pid: 5819 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201003.914321:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005c197e36/0xa81c4c9a2f3ca82d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca826 expref: 12 pid: 5819 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201003.914335:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201003.914411:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201003.914434:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201003.914441:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201003.914446:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201003.914452:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201003.914458:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000009bf923d already unused, calling callback (000000007d59dd3e) 00010000:00010000:2.0:1788201003.914461:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201003.914468:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201003.914477:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201003.914485:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201003.914558:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062da7f01 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:3282:x1875064569991168:12345-0@lo:103: Request processed in 378us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201003.914565:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788201003.914620:0:6304:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201003.914628:0:6304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201003.914633:0:6304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000009bf923d/0xa81c4c9a2f3ca86c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201003.917981:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001bde95c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064569991168:0@lo:103: 00010000:00010000:0.0:1788201004.798436:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201005.814633:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201006.838538:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788201007.414813:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201007.414822:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9624902af800 from 1 10000000:01000000:2.0:1788201007.414828:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201007.414877:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 000000007bde7d79/0xa81c4c9a2f3ca873 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.414897:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 000000007bde7d79/0xa81c4c9a2f3ca873 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.414921:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 000000007bde7d79/0xa81c4c9a2f3ca873 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201007.414946:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0971398 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569991296:0@lo:101: 00000100:00100000:2.0:1788201007.415022:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201007.415076:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 000000007133d6b3 going to sleep for 11 seconds 00000100:00100000:0.0:1788201007.415412:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569991296 00000100:00100000:0.0:1788201007.415422:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569991296 00000100:00100000:0.0:1788201007.415465:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201007.415472:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ca638e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:5822:x1875064569991296:12345-0@lo:101: 00010000:00010000:0.0:1788201007.415485:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201007.415498:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ced37a68/0xa81c4c9a2f3ca87a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca873 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.415544:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ced37a68/0xa81c4c9a2f3ca87a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca873 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.415553:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ced37a68/0xa81c4c9a2f3ca87a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca873 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.415573:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ced37a68, rc 0) 00000100:00100000:0.0:1788201007.415612:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ca638e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5822:x1875064569991296:12345-0@lo:101: Request processed in 141us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201007.415618:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201007.417544:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0971398 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569991296:0@lo:101: 00010000:00010000:2.0:1788201007.417582:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 000000007bde7d79/0xa81c4c9a2f3ca873 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca87a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.417594:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 000000007bde7d79/0xa81c4c9a2f3ca873 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca87a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201007.417672:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0971398 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569991424:0@lo:501: 00000100:00100000:2.0:1788201007.417726:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201007.417767:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 000000007133d6b3 going to sleep for 11 seconds 00000100:00100000:0.0:1788201007.418084:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569991424 00000100:00100000:0.0:1788201007.418092:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569991424 00000100:00100000:0.0:1788201007.418131:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201007.418138:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0efc30b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5822:x1875064569991424:12345-0@lo:501: 00000100:00100000:0.0:1788201007.418448:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0efc30b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5822:x1875064569991424:12345-0@lo:501: Request processed in 310us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201007.418455:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201007.420025:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0971398 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569991424:0@lo:501: 00000100:00100000:2.0:1788201007.420079:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0971398 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569991552:0@lo:503: 00000100:00100000:2.0:1788201007.420146:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201007.420192:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 000000007133d6b3 going to sleep for 11 seconds 00000100:00100000:2.0:1788201007.420210:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569991552 00000100:00100000:2.0:1788201007.420215:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569991552 00000100:00100000:2.0:1788201007.420251:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201007.420266:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5b081de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5822:x1875064569991552:12345-0@lo:503: 00000100:00100000:2.0:1788201007.421097:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5b081de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5822:x1875064569991552:12345-0@lo:503: Request processed in 829us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.421107:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201007.425850:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0971398 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569991552:0@lo:503: 00000100:00100000:2.0:1788201007.427460:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a0acc429 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6525:1875064569991680:0@lo:502: 00000100:00100000:2.0:1788201007.427556:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201007.427596:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set 000000009951f1a7 going to sleep for 11 seconds 00000100:00100000:0.0:1788201007.427785:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569991680 00000100:00100000:0.0:1788201007.427792:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569991680 00000100:00100000:0.0:1788201007.427963:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201007.427973:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd14f258 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6525:x1875064569991680:12345-0@lo:502: 00000100:00100000:0.0:1788201007.428257:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd14f258 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6525:x1875064569991680:12345-0@lo:502: Request processed in 285us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201007.428265:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201007.428405:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a0acc429 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6525:1875064569991680:0@lo:502: 00000020:01000000:1.0:1788201007.428438:0:6525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201007.428449:0:6525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201007.428457:0:6525:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788201007.428465:0:6525:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624902af800 00000020:00000080:1.0:1788201007.428468:0:6525:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788201007.428516:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6525:1875064569991808:0@lo:502: 00000100:00100000:1.0:1788201007.428876:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201007.428993:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569991808 00000100:00100000:0.0:1788201007.428994:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff96248ba49f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201007.428999:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569991808 00000100:00100000:2.0:1788201007.429039:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201007.429048:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6525:x1875064569991808:12345-0@lo:502: 00000100:00100000:2.0:1788201007.429216:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6525:x1875064569991808:12345-0@lo:502: Request processed in 169us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.429224:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201007.429313:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6525:1875064569991808:0@lo:502: 00000020:01000000:0.0:1788201007.429336:0:6525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201007.429357:0:6525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201007.429359:0:6525:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788201007.429364:0:6525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788201007.433964:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788201007.434008:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201007.434021:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5200/0xa81c4c9a2f3ca873 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca87a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.434036:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c5200/0xa81c4c9a2f3ca873 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca87a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.879762:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201008.694523:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064569992064:0@lo:400: 00000100:00100000:3.0:1788201008.694599:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201008.694666:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201008.694673:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064569991936:0@lo:400: 00000100:00100000:3.0:1788201008.694703:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201008.694741:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569991936 00000100:00100000:3.0:1788201008.694748:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569991936 00000100:00100000:3.0:1788201008.694790:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201008.694799:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:3285:x1875064569991936:12345-0@lo:400: 00000100:00100000:3.0:1788201008.694849:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:3285:x1875064569991936:12345-0@lo:400: Request processed in 51us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201008.694856:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201008.694917:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064569991936:0@lo:400: 00000100:00100000:0.0:1788201008.698012:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569992064 00000100:00100000:0.0:1788201008.698027:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569992064 00000100:00100000:0.0:1788201008.698086:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201008.698096:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064569992064:12345-0@lo:400: 00000100:00100000:0.0:1788201008.698190:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064569992064:12345-0@lo:400: Request processed in 95us (3590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201008.698198:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788201008.698252:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9624ba19b100 x1875064569992064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201008.698268:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064569992064:0@lo:400: 00010000:00010000:0.0:1788201008.886495:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201009.912255:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201010.904491:0:6666:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788201010.904495:0:6666:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788201010.904712:0:6666:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9624902d7800 00000020:01000004:2.0:1788201010.904728:0:6666:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788201010.904739:0:6666:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788201010.904751:0:6666:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff962487eb0000) 00000020:00000080:2.0:1788201010.904766:0:6666:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788201010.920159:0:6666:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788201010.920591:0:6666:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:0.0:1788201010.934556:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788201010.945190:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788201010.951274:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788201010.951318:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788201010.951501:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788201010.951534:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788201010.952014:0:6666:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788201010.952027:0:6666:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201010.952038:0:6666:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3ca888 00000020:01000004:3.0:1788201010.952046:0:6666:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788201010.952067:0:6666:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201010.952070:0:6666:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788201010.952076:0:6666:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788201010.952080:0:6666:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788201010.952093:0:6666:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff962485b43380) 00000020:00000080:3.0:1788201010.952104:0:6666:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788201010.953717:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201010.953886:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788201010.953893:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788201010.957540:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788201010.957553:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788201010.959820:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788201010.959832:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788201010.961089:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201010.961266:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788201010.961272:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788201010.966057:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788201010.966071:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788201011.000220:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201011.000833:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788201011.000852:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788201011.003818:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788201011.003834:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788201011.004737:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788201011.004747:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788201011.008176:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201011.008548:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788201011.008556:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788201011.009218:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788201011.009227:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788201011.094229:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201011.094616:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788201011.094699:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788201011.096084:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788201011.096096:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788201011.096607:0:6666:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788201011.096645:0:6666:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788201011.096652:0:6666:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788201011.120503:0:6666:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788201011.120544:0:6666:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.156@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788201011.120550:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788201011.120552:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201011.120553:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201011.120554:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201011.120571:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201011.120573:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201011.120575:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201011.120583:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788201011.120584:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788201011.120586:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201011.120587:0:6666:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201011.120591:0:6666:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788201011.120593:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201011.120594:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201011.120595:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201011.120596:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201011.120597:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201011.120598:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201011.120599:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201011.120600:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788201011.120601:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788201011.120602:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201011.120603:0:6666:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201011.120630:0:6666:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788201011.120648:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569992192:0@lo:253: 00000100:00100000:3.0:1788201011.120731:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201011.120800:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff96248ba49e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201011.126052:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569992192 00000100:00100000:2.0:1788201011.126065:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569992192 00000100:00100000:2.0:1788201011.126130:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201011.126142:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6666:x1875064569992192:12345-0@lo:253: 20000000:01000000:2.0:1788201011.126179:0:5819:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788201011.126183:0:5819:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788201011.126188:0:5819:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788201011.126191:0:5819:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788201011.127109:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201011.127384:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788201011.127417:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788201011.127460:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788201011.127468:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788201011.127501:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788201011.127555:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788201011.128625:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788201011.128651:0:5819:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.156@tcp 20000000:01000000:2.0:1788201011.128653:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.156@tcp (null) (null) (null) 00000040:00080000:2.0:1788201011.128688:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788201011.128696:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788201011.128742:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788201011.128750:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.156@tcp (null) (null) 00000040:00080000:2.0:1788201011.128782:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788201011.128792:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788201011.128821:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788201011.130131:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788201011.135753:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788201011.135791:0:5819:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.156@tcp 20000000:01000000:0.0:1788201011.135793:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.156@tcp (null) (null) (null) 00000040:00080000:0.0:1788201011.135835:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788201011.135856:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788201011.135889:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788201011.135897:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.156@tcp (null) (null) 00000040:00080000:0.0:1788201011.135984:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788201011.135996:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788201011.136033:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788201011.136068:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788201011.136105:0:5819:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788201011.136108:0:5819:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788201011.136115:0:5819:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788201011.136117:0:5819:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788201011.136120:0:5819:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788201011.136133:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788201011.136136:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788201011.136178:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788201011.136181:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788201011.145947:0:6681:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788201011.146050:0:6681:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788201011.146106:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788201011.146525:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788201011.146569:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788201011.146600:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788201011.146614:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788201011.146616:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788201011.147177:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788201011.147434:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788201011.147476:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788201011.147567:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788201011.147583:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788201011.147585:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788201011.148265:0:6683:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788201011.148334:0:6683:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788201011.148530:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788201011.148794:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788201011.148828:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788201011.148891:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:1.0:1788201011.148909:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788201011.148929:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.148951:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca7af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca7a8 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.148959:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca7cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca7c4 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.148966:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624c21f1800/0xa81c4c9a2f3ca83b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca834 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.148973:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.149028:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624c21f1800/0xa81c4c9a2f3ca83b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca834 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.149043:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624c21f1800/0xa81c4c9a2f3ca83b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca834 expref: 12 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201011.149060:0:5819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba858a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875064569992320:0@lo:104: 00000100:00100000:1.0:1788201011.149141:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201011.149206:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca7c4 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.149213:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca7cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca7c4 expref: 12 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201011.149221:0:5819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875064569992448:0@lo:104: 00000100:00100000:1.0:1788201011.149257:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201011.149299:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca7af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca7a8 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.149307:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca7af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca7a8 expref: 12 pid: 5819 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201011.149315:0:5819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba859180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875064569992576:0@lo:104: 00000100:00100000:3.0:1788201011.149518:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569992320 00000100:00100000:3.0:1788201011.149527:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569992320 00000100:00100000:3.0:1788201011.149565:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569992448 00000100:00100000:3.0:1788201011.149568:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569992448 00000100:00100000:3.0:1788201011.149581:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201011.149590:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+4:5819:x1875064569992320:12345-0@lo:104: 00010000:00010000:3.0:1788201011.149605:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3ca834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca83b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201011.149680:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201011.149686:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+4:5819:x1875064569992320:12345-0@lo:104: Request processed in 98us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201011.149693:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201011.149722:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201011.149729:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5819:x1875064569992448:12345-0@lo:104: 00010000:00010000:3.0:1788201011.149737:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff962480030800/0xa81c4c9a2f3ca7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca7cb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201011.149772:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201011.149776:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5819:x1875064569992448:12345-0@lo:104: Request processed in 49us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201011.149783:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201011.149992:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201011.150061:0:5819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624a85dfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201011.150084:0:5819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba858a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875064569992320:0@lo:104: 00000100:00100000:1.0:1788201011.150095:0:5819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875064569992448:0@lo:104: 00010000:00010000:2.0:1788201011.150914:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201011.150924:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3ca834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca83b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.150934:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962493611c00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:2.0:1788201011.150949:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3ca834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca83b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.150960:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3ca834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca83b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201011.150967:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3ca834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca83b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201011.150974:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201011.151027:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3ca834 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca83b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151034:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201011.151056:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3ca834 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca83b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151064:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3ca834 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca83b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151097:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201011.151101:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962480030800/0xa81c4c9a2f3ca7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca7cb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151107:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962480030800 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:2.0:1788201011.151110:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962480030800/0xa81c4c9a2f3ca7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca7cb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151117:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962480030800/0xa81c4c9a2f3ca7c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca7cb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201011.151135:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962480030800/0xa81c4c9a2f3ca7c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca7cb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201011.151140:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201011.151156:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962480030800/0xa81c4c9a2f3ca7c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca7cb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151162:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201011.151168:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962480030800/0xa81c4c9a2f3ca7c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca7cb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151174:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962480030800/0xa81c4c9a2f3ca7c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca7cb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151186:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201011.151187:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201011.151190:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201011.151207:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064569992704:0@lo:103: 00000100:00100000:2.0:1788201011.151252:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.151292:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201011.151298:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064569992832:0@lo:103: 00000100:00100000:2.0:1788201011.151335:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.151411:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569992704 00000100:00100000:2.0:1788201011.151417:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569992704 00010000:00010000:2.0:1788201011.151441:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624c21f1800/0xa81c4c9a2f3ca83b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca834 expref: 13 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201011.151465:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569992832 00000100:00100000:2.0:1788201011.151468:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569992832 00010000:00010000:2.0:1788201011.151491:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca7cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca7c4 expref: 14 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201011.151505:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201011.151513:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:3282:x1875064569992704:12345-0@lo:103: 00010000:00010000:2.0:1788201011.151524:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201011.151528:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624c21f1800/0xa81c4c9a2f3ca83b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca834 expref: 14 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151539:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624c21f1800/0xa81c4c9a2f3ca83b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca834 expref: 14 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151553:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f1800/0xa81c4c9a2f3ca83b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca834 expref: 14 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151567:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201011.151601:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:3282:x1875064569992704:12345-0@lo:103: Request processed in 89us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201011.151608:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201011.151640:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201011.151648:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:3282:x1875064569992832:12345-0@lo:103: 00010000:00010000:2.0:1788201011.151656:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201011.151660:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca7cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca7c4 expref: 12 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151668:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca7c4 expref: 12 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151678:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca7cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca7c4 expref: 12 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.151699:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201011.151724:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:3282:x1875064569992832:12345-0@lo:103: Request processed in 77us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201011.151730:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201011.151766:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064569992832:0@lo:103: 00000100:00100000:2.0:1788201011.151775:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064569992704:0@lo:103: 00010000:00010000:0.0:1788201011.152142:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201011.152560:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569992576 00000100:00100000:3.0:1788201011.152570:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569992576 00000100:00100000:3.0:1788201011.152709:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201011.152718:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5819:x1875064569992576:12345-0@lo:104: 00010000:00010000:3.0:1788201011.152732:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff962480031c00/0xa81c4c9a2f3ca7a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca7af expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201011.152809:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201011.152816:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5819:x1875064569992576:12345-0@lo:104: Request processed in 100us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201011.152822:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201011.152913:0:5819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba859180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5819:1875064569992576:0@lo:104: 00010000:00010000:1.0:1788201011.152951:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153017:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201011.153023:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962480031c00/0xa81c4c9a2f3ca7a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca7af expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153030:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962480031c00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:0.0:1788201011.153034:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962480031c00/0xa81c4c9a2f3ca7a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca7af expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153042:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962480031c00/0xa81c4c9a2f3ca7a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca7af expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201011.153049:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962480031c00/0xa81c4c9a2f3ca7a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca7af expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201011.153055:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201011.153105:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962480031c00/0xa81c4c9a2f3ca7a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca7af expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153112:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201011.153133:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962480031c00/0xa81c4c9a2f3ca7a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca7af expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153140:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962480031c00/0xa81c4c9a2f3ca7a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca7af expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153165:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201011.153167:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201011.153168:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201011.153181:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064569992960:0@lo:103: 00000100:00100000:0.0:1788201011.153218:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201011.153265:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569992960 00000100:00100000:0.0:1788201011.153270:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569992960 00010000:00010000:0.0:1788201011.153288:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca7af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca7a8 expref: 11 pid: 5819 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201011.153309:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201011.153316:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:3284:x1875064569992960:12345-0@lo:103: 00010000:00010000:0.0:1788201011.153339:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201011.153370:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca7af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca7a8 expref: 11 pid: 5819 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153380:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca7af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca7a8 expref: 11 pid: 5819 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153392:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca7af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca7a8 expref: 11 pid: 5819 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153407:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153415:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153431:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153445:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153453:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153459:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153465:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624c21f0c00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:0.0:1788201011.153469:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153476:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153488:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.153495:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201011.153525:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+10:3284:x1875064569992960:12345-0@lo:103: Request processed in 210us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201011.153532:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201011.153563:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064569992960:0@lo:103: 00010000:00010000:1.0:1788201011.153768:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.153778:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.153785:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca896 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201011.153799:0:5819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788201011.208546:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+9:6666:x1875064569992192:12345-0@lo:253: Request processed in 82395us (87804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201011.208563:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201011.211444:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569992192:0@lo:253: 10000000:01000000:3.0:1788201011.211465:0:6666:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788201011.211469:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201011.211471:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201011.211472:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201011.211473:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788201011.211474:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201011.211476:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201011.211477:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201011.211479:0:6666:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788201011.211501:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201011.211502:0:6666:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201011.211523:0:6666:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9624902d7800 from lustre-OST0000 10000000:01000000:3.0:1788201011.211569:0:6666:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788201011.211572:0:6666:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788201011.211581:0:6666:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962485b40000 local copy 10000000:01000000:3.0:1788201011.211586:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788201011.211631:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201011.211643:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201011.211652:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201011.211673:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993088:0@lo:101: 00000100:00100000:3.0:1788201011.211742:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201011.211822:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff962490655540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201011.216007:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569993088 00000100:00100000:0.0:1788201011.216027:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569993088 00000100:00100000:0.0:1788201011.216113:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201011.216126:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+9:6666:x1875064569993088:12345-0@lo:101: 00010000:00010000:0.0:1788201011.216145:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201011.216219:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca89d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.216255:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca89d expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.216268:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca89d expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.216279:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962480031c00, rc 0) 00000100:00100000:0.0:1788201011.216406:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+10:6666:x1875064569993088:12345-0@lo:101: Request processed in 283us (4663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201011.216414:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201011.216468:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993088:0@lo:101: 00010000:00010000:2.0:1788201011.216487:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa81c4c9a2f3ca8a4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.216498:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa81c4c9a2f3ca8a4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201011.216763:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993216:0@lo:501: 00000100:00100000:2.0:1788201011.216802:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.216855:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba2c36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201011.216874:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569993216 00000100:00100000:3.0:1788201011.216879:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569993216 00000100:00100000:3.0:1788201011.216915:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788201011.216922:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+10:6666:x1875064569993216:12345-0@lo:501: 00000100:00100000:3.0:1788201011.217156:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+10:6666:x1875064569993216:12345-0@lo:501: Request processed in 233us (352us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201011.217163:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201011.217535:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993216:0@lo:501: 10000000:01000000:2.0:1788201011.217554:0:6666:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788201011.217588:0:6666:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788201011.217594:0:6666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa81c4c9a2f3ca8a4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.217616:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa81c4c9a2f3ca8a4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.217700:0:6666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa81c4c9a2f3ca8a4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.217728:0:6666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201011.217749:0:6666:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9624902d7800 10000000:01000000:2.0:1788201011.217754:0:6666:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788201011.217758:0:6666:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff962485b40000 10000000:01000000:2.0:1788201011.217761:0:6666:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788201011.217764:0:6666:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff962485b40000 from 1 10000000:01000000:2.0:1788201011.217767:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788201011.217791:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c4000/0xa81c4c9a2f3ca8ab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.217799:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c4000/0xa81c4c9a2f3ca8ab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.217809:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c4000/0xa81c4c9a2f3ca8ab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201011.217827:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993344:0@lo:101: 00000100:00100000:2.0:1788201011.217884:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.217921:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba2c3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201011.218457:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569993344 00000100:00100000:3.0:1788201011.218464:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569993344 00000100:00100000:3.0:1788201011.218508:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788201011.218516:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+10:6666:x1875064569993344:12345-0@lo:101: 00010000:00010000:3.0:1788201011.218538:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201011.218554:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962493610200/0xa81c4c9a2f3ca8b2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca8ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201011.218576:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962493610200/0xa81c4c9a2f3ca8b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca8ab expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201011.218586:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962493610200/0xa81c4c9a2f3ca8b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca8ab expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201011.218595:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962493610200, rc 0) 00000100:00100000:3.0:1788201011.218642:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:6666:x1875064569993344:12345-0@lo:101: Request processed in 127us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201011.218648:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201011.218729:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993344:0@lo:101: 00010000:00010000:2.0:1788201011.218745:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c4000/0xa81c4c9a2f3ca8ab lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca8b2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.218764:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c4000/0xa81c4c9a2f3ca8ab lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca8b2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201011.218784:0:6666:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788201011.218802:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c4000/0xa81c4c9a2f3ca8ab lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca8b2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.218810:0:6666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c4000/0xa81c4c9a2f3ca8ab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca8b2 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201011.218817:0:6666:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788201011.218821:0:6666:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201011.218827:0:6666:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788201011.218829:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201011.218857:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.218865:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.218873:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201011.218888:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993472:0@lo:101: 00000100:00100000:2.0:1788201011.218915:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201011.218931:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201011.218938:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa81c4c9a2f3ca8a4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.218946:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962493611600 already unused, calling callback (ffffffffc1b5cc20) 00000100:00100000:2.0:1788201011.218948:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba2c3600 going to sleep for 11 seconds 10000000:00010000:0.0:1788201011.218950:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa81c4c9a2f3ca8a4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.218958:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa81c4c9a2f3ca8a4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201011.218965:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa81c4c9a2f3ca8a4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201011.218971:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201011.218991:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa81c4c9a2f3ca8a4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.219007:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201011.219041:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa81c4c9a2f3ca8a4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.219049:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962493611600/0xa81c4c9a2f3ca89d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa81c4c9a2f3ca8a4 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.219063:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201011.219065:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201011.219067:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201011.219111:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569993472 00000100:00100000:2.0:1788201011.219114:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064569993600:0@lo:103: 00000100:00100000:1.0:1788201011.219115:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569993472 00000100:00100000:2.0:1788201011.219143:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201011.219150:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201011.219157:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:6666:x1875064569993472:12345-0@lo:101: 00010000:00010000:1.0:1788201011.219166:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201011.219174:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca8c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca8b9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201011.219186:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569993600 00010000:00010000:1.0:1788201011.219188:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca8b9 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201011.219189:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569993600 00010000:00010000:1.0:1788201011.219197:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca8b9 expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.219203:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f0c00, rc 0) 00000100:00100000:2.0:1788201011.219216:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201011.219222:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:3285:x1875064569993600:12345-0@lo:103: 00010000:00010000:2.0:1788201011.219231:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788201011.219232:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6666:x1875064569993472:12345-0@lo:101: Request processed in 77us (316us total) trans 0 rc 0/0 00010000:00010000:2.0:1788201011.219242:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca89d expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201011.219246:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1788201011.219252:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201011.219278:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:3285:x1875064569993600:12345-0@lo:103: Request processed in 56us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201011.219284:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201011.219296:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064569993600:0@lo:103: 00000100:00100000:2.0:1788201011.219311:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993472:0@lo:101: 00010000:00010000:2.0:1788201011.219332:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca8c0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.219400:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca8c0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201011.219487:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993728:0@lo:501: 00000100:00100000:2.0:1788201011.219513:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.219540:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba2c3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201011.219672:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569993728 00000100:00100000:3.0:1788201011.219676:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569993728 00000100:00100000:3.0:1788201011.219710:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201011.219717:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:6666:x1875064569993728:12345-0@lo:501: 00000100:00100000:3.0:1788201011.219974:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:6666:x1875064569993728:12345-0@lo:501: Request processed in 257us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201011.219981:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201011.220609:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993728:0@lo:501: 00000100:00100000:2.0:1788201011.220722:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993856:0@lo:503: 00000100:00100000:2.0:1788201011.220776:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.220807:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba2c3600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201011.222143:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569993856 00000100:00100000:0.0:1788201011.222153:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569993856 00000100:00100000:0.0:1788201011.222219:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201011.222228:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:6666:x1875064569993856:12345-0@lo:503: 00000100:00100000:0.0:1788201011.222489:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:6666:x1875064569993856:12345-0@lo:503: Request processed in 260us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201011.222496:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201011.222704:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993856:0@lo:503: 00000040:00080000:2.0:1788201011.223027:0:6666:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201011.223118:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993984:0@lo:502: 00000100:00100000:2.0:1788201011.223163:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.223390:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba2c3600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201011.228282:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569993984 00000100:00100000:1.0:1788201011.228298:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569993984 00000100:00100000:1.0:1788201011.228407:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201011.228419:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:6666:x1875064569993984:12345-0@lo:502: 00000100:00100000:1.0:1788201011.229023:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:6666:x1875064569993984:12345-0@lo:502: Request processed in 604us (5857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201011.229032:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201011.229156:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569993984:0@lo:502: 00000040:00080000:2.0:1788201011.229538:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788201011.229592:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788201011.229806:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788201011.229876:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788201011.229913:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788201011.229946:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788201011.229993:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994112:0@lo:502: 00000100:00100000:2.0:1788201011.230054:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.230099:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba2c3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201011.230147:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569994112 00000100:00100000:3.0:1788201011.230156:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569994112 00000100:00100000:3.0:1788201011.230216:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201011.230225:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:6666:x1875064569994112:12345-0@lo:502: 00000100:00100000:3.0:1788201011.230438:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:6666:x1875064569994112:12345-0@lo:502: Request processed in 213us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201011.230446:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788201011.230656:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994112:0@lo:502: 00000040:00080000:0.0:1788201011.230765:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788201011.230777:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788201011.231412:0:6685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788201011.231421:0:6685:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788201011.231429:0:6685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201011.231431:0:6685:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788201011.231436:0:6685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201011.231459:0:6685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff96248729b380) 00000020:00000080:0.0:1788201011.231482:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788201011.231488:0:6685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788201011.231587:0:6685:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9624902d7800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788201011.231596:0:6685:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788201011.231604:0:6685:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3ca8ce 00010000:00010000:2.0:1788201011.241105:0:6685:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788201011.242883:0:6685:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788201011.245512:0:6685:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788201011.245803:0:6685:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788201011.253514:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788201011.255372:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788201011.256869:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788201011.256881:0:6685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201011.256888:0:6685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201011.256891:0:6685:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788201011.256893:0:6685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201011.256897:0:6685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201011.256898:0:6685:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201011.256901:0:6685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201011.256903:0:6685:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201011.256957:0:6685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201011.256962:0:6685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201011.256963:0:6685:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788201011.256967:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788201011.257120:0:6666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788201011.257150:0:6666:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788201011.257175:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca8c0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.257186:0:6666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca8c0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201011.257193:0:6666:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9624902d7800 from 1 10000000:01000000:1.0:1788201011.257195:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201011.257229:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.257236:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.257246:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201011.257282:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba859180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994240:0@lo:101: 00000100:00100000:1.0:1788201011.257378:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201011.257430:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff96249027b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201011.257452:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569994240 00000100:00100000:1.0:1788201011.257459:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569994240 00000100:00100000:1.0:1788201011.257501:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201011.257510:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:6666:x1875064569994240:12345-0@lo:101: 00010000:00010000:1.0:1788201011.257524:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201011.257536:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca8dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca8d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.257558:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca8d5 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.257569:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca8d5 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.257577:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f1200, rc 0) 00000100:00100000:1.0:1788201011.257615:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6666:x1875064569994240:12345-0@lo:101: Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201011.257622:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201011.257668:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba859180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994240:0@lo:101: 00010000:00010000:1.0:1788201011.257681:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca8dc expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.257689:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca8dc expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201011.257776:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba859180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994368:0@lo:501: 00000100:00100000:1.0:1788201011.257800:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201011.257814:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff96249027b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201011.262860:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569994368 00000100:00100000:2.0:1788201011.262877:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569994368 00000100:00100000:2.0:1788201011.263597:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201011.263611:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6666:x1875064569994368:12345-0@lo:501: 00000100:00100000:2.0:1788201011.263960:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6666:x1875064569994368:12345-0@lo:501: Request processed in 353us (6158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201011.263968:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201011.266619:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba859180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994368:0@lo:501: 00000100:00100000:3.0:1788201011.266680:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994496:0@lo:503: 00000100:00100000:3.0:1788201011.266760:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201011.266805:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569994496 00000100:00100000:3.0:1788201011.266805:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b369c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201011.266812:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569994496 00000100:00100000:1.0:1788201011.266872:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201011.266881:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6666:x1875064569994496:12345-0@lo:503: 00000100:00100000:1.0:1788201011.267127:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6666:x1875064569994496:12345-0@lo:503: Request processed in 246us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201011.267135:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201011.269571:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994496:0@lo:503: 00000040:00080000:3.0:1788201011.269920:0:6666:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201011.270004:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994624:0@lo:502: 00000100:00100000:3.0:1788201011.270077:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201011.270125:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201011.273646:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569994624 00000100:00100000:2.0:1788201011.273666:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569994624 00000100:00100000:2.0:1788201011.273731:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201011.273770:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6666:x1875064569994624:12345-0@lo:502: 00000100:00100000:2.0:1788201011.274125:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6666:x1875064569994624:12345-0@lo:502: Request processed in 362us (4046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201011.274134:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201011.274335:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994624:0@lo:502: 00000040:00080000:1.0:1788201011.274702:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788201011.274757:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788201011.274796:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994752:0@lo:502: 00000100:00100000:1.0:1788201011.274857:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201011.274892:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff96249027b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201011.275777:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569994752 00000100:00100000:0.0:1788201011.275786:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569994752 00000100:00100000:0.0:1788201011.275848:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788201011.275858:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6666:x1875064569994752:12345-0@lo:502: 00000100:00100000:0.0:1788201011.276099:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6666:x1875064569994752:12345-0@lo:502: Request processed in 242us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201011.276106:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201011.276126:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994752:0@lo:502: 00000040:00080000:1.0:1788201011.276249:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788201011.276262:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788201011.279805:0:6689:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201011.279818:0:6689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201011.279820:0:6689:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788201011.279827:0:6689:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624902d7800 00000020:00000080:1.0:1788201011.279829:0:6689:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201011.279860:0:6689:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201011.279863:0:6689:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201011.279877:0:6689:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788201011.279880:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788201011.279970:0:6666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788201011.279994:0:6666:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201011.280016:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca8dc expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.280029:0:6666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca8dc expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201011.280074:0:6666:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788201011.280077:0:6666:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9624902d7800 10000000:01000000:2.0:1788201011.280081:0:6666:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9624902d7800 10000000:01000000:2.0:1788201011.280086:0:6666:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201011.280092:0:6666:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9624902d7800 from 1 10000000:01000000:2.0:1788201011.280095:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201011.280131:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.280140:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.280151:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201011.280178:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994880:0@lo:101: 00000100:00100000:2.0:1788201011.280257:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.280335:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623818af600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201011.280501:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569994880 00000100:00100000:0.0:1788201011.280509:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569994880 00000100:00100000:0.0:1788201011.280562:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788201011.280572:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6666:x1875064569994880:12345-0@lo:101: 00010000:00010000:0.0:1788201011.280588:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201011.280604:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca8e3 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.280631:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca8e3 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.280643:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca8e3 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.280653:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962480031c00, rc 0) 00000100:00100000:0.0:1788201011.280705:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6666:x1875064569994880:12345-0@lo:101: Request processed in 134us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201011.280712:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201011.280956:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569994880:0@lo:101: 00010000:00010000:2.0:1788201011.280972:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca8ea expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.280982:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca8ea expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201011.281092:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569995008:0@lo:501: 00000100:00100000:2.0:1788201011.281119:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.281149:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623818af600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201011.281390:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569995008 00000100:00100000:1.0:1788201011.281396:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569995008 00000100:00100000:1.0:1788201011.281421:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201011.281428:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6666:x1875064569995008:12345-0@lo:501: 00000100:00100000:1.0:1788201011.281844:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6666:x1875064569995008:12345-0@lo:501: Request processed in 404us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201011.281852:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201011.281889:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569995008:0@lo:501: 00000100:00100000:2.0:1788201011.281921:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569995136:0@lo:503: 00000100:00100000:2.0:1788201011.281966:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.281994:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623818af600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201011.282053:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569995136 00000100:00100000:0.0:1788201011.282065:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569995136 00000100:00100000:0.0:1788201011.282100:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201011.282108:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6666:x1875064569995136:12345-0@lo:503: 00000100:00100000:0.0:1788201011.282261:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6666:x1875064569995136:12345-0@lo:503: Request processed in 154us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201011.282268:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201011.282532:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569995136:0@lo:503: 00000040:00080000:2.0:1788201011.282814:0:6666:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201011.282885:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569995264:0@lo:502: 00000100:00100000:2.0:1788201011.282923:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.283057:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623818af600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201011.285463:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569995264 00000100:00100000:3.0:1788201011.285479:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569995264 00000100:00100000:3.0:1788201011.285628:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788201011.285640:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6666:x1875064569995264:12345-0@lo:502: 00000100:00100000:3.0:1788201011.285997:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6666:x1875064569995264:12345-0@lo:502: Request processed in 357us (3070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201011.286012:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201011.286158:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569995264:0@lo:502: 00000040:00080000:2.0:1788201011.286637:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788201011.286695:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788201011.286731:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788201011.286792:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788201011.286832:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788201011.286896:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788201011.286947:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788201011.286983:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788201011.287036:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788201011.287073:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788201011.287110:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788201011.287174:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788201011.287212:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788201011.287245:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788201011.287312:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788201011.287574:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788201011.287607:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788201011.287667:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788201011.287705:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788201011.287736:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788201011.287780:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788201011.287813:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788201011.287858:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788201011.287908:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788201011.287945:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788201011.287978:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788201011.288039:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788201011.288078:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788201011.288654:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569995392:0@lo:502: 00000100:00100000:2.0:1788201011.288735:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.288811:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623818af600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201011.288871:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569995392 00000100:00100000:3.0:1788201011.288879:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569995392 00000100:00100000:3.0:1788201011.288961:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201011.288972:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6666:x1875064569995392:12345-0@lo:502: 00000100:00100000:3.0:1788201011.289231:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6666:x1875064569995392:12345-0@lo:502: Request processed in 259us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201011.289239:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201011.289386:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569995392:0@lo:502: 00000040:00080000:2.0:1788201011.289481:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788201011.289493:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788201011.292249:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788201011.292263:0:6690:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff962487fc3380) 00000020:00000080:1.0:1788201011.292280:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788201011.292612:0:6690:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9624902d7800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788201011.292616:0:6690:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9624902d7800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788201011.292618:0:6690:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624902d7800 3 00010000:00080000:1.0:1788201011.292650:0:6690:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96248e16e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.156@tcp at head 00010000:00010000:1.0:1788201011.306782:0:6690:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788201011.307267:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788201011.307308:0:6690:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201011.307966:0:6690:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa81c4c9a2f3ca8f8 00000100:00080000:1.0:1788201011.307979:0:6690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201011.307985:0:6690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96248e16e000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201011.308036:0:6690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624ba859880 x1875064569995520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201011.308066:0:6690:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788201011.308178:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064569995520:0@lo:38: 00000100:00100000:0.0:1788201011.308252:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.308360:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201011.308372:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064569995648:0@lo:400: 00000100:00100000:1.0:1788201011.312153:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569995520 00000100:00100000:1.0:1788201011.312171:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569995520 00000100:00100000:1.0:1788201011.312228:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201011.312237:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875064569995520:12345-0@lo:38: 00010000:00080000:1.0:1788201011.312275:0:5827:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 143 last 0 00000020:00000080:1.0:1788201011.312661:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa81c4c9a2f3ca8ff 00000004:00100000:1.0:1788201011.312679:0:5827:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201011.312713:0:5827:0:(import.c:65:import_set_state_nolock()) ffff962381a3d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201011.315205:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201011.315309:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788201011.315331:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788201011.317203:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201011.317225:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569995648 00000100:00100000:0.0:1788201011.317234:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569995648 00000100:00100000:0.0:1788201011.317274:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201011.317284:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201011.317296:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064569995648:12345-0@lo:400: 00000100:00100000:0.0:1788201011.317440:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064569995648:12345-0@lo:400: Request processed in 146us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201011.317448:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788201011.317895:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96248517d180 x1875064569995648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201011.317911:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064569995648:0@lo:400: 00000100:00100000:1.0:1788201011.322710:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875064569995520:12345-0@lo:38: Request processed in 10462us (14447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201011.322725:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1788201011.325153:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:0.0:1788201011.325419:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9624ba859880 x1875064569995520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201011.325433:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201011.325446:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788201011.325457:0:3281:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788201011.325462:0:3281:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788201011.325466:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96248e16e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201011.325474:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064569995520:0@lo:38: 00000020:01000000:1.0:1788201011.325794:0:6666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788201011.325829:0:6666:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201011.325862:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca8ea expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.325872:0:6666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca8ea expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201011.325937:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201011.325940:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201011.325941:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201011.325942:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201011.325943:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201011.325945:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201011.325946:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201011.325947:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201011.325949:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201011.325950:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201011.325952:0:6666:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201011.325955:0:6666:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788201011.325957:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201011.325959:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201011.325960:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201011.325961:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201011.325961:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201011.325963:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201011.325969:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201011.325970:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788201011.325971:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788201011.325972:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201011.325973:0:6666:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201011.325993:0:6666:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788201011.326008:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba858a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569995776:0@lo:253: 00000100:00100000:1.0:1788201011.326066:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201011.326105:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff96249027b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201011.326240:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569995776 00000100:00100000:0.0:1788201011.326247:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569995776 00000100:00100000:0.0:1788201011.326301:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201011.326310:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6666:x1875064569995776:12345-0@lo:253: 20000000:01000000:0.0:1788201011.326369:0:5818:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788201011.326402:0:5818:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788201011.361931:0:5818:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201011.361956:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788201011.362084:0:5841:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201011.362092:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201011.362122:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.362145:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962493610000/0xa81c4c9a2f3ca865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca85e expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.362155:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.362201:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962493610000/0xa81c4c9a2f3ca865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca85e expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201011.362219:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962493610000/0xa81c4c9a2f3ca865 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca85e expref: 13 pid: 5820 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201011.362239:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064569995904:0@lo:104: 00000100:00100000:1.0:1788201011.362333:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201011.362447:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff962484d50d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201011.362751:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569995904 00000100:00100000:2.0:1788201011.362760:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569995904 00000100:00100000:2.0:1788201011.362821:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201011.362830:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064569995904:12345-0@lo:104: 00010000:00010000:2.0:1788201011.362853:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624c21f1600/0xa81c4c9a2f3ca85e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca865 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.362931:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201011.362939:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064569995904:12345-0@lo:104: Request processed in 110us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201011.362946:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788201011.362971:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201011.362978:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624c21f1600/0xa81c4c9a2f3ca85e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca865 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.362986:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624c21f1600 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:2.0:1788201011.362990:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624c21f1600/0xa81c4c9a2f3ca85e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca865 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.362998:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624c21f1600/0xa81c4c9a2f3ca85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca865 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201011.363006:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624c21f1600/0xa81c4c9a2f3ca85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca865 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201011.363012:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201011.363058:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624c21f1600/0xa81c4c9a2f3ca85e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca865 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.363065:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201011.363090:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624c21f1600/0xa81c4c9a2f3ca85e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca865 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.363106:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624c21f1600/0xa81c4c9a2f3ca85e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca865 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.363123:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201011.363125:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201011.363127:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201011.363147:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064569996032:0@lo:103: 00000100:00100000:2.0:1788201011.363183:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201011.363219:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569996032 00000100:00100000:2.0:1788201011.363224:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569996032 00010000:00010000:2.0:1788201011.363239:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962493610000/0xa81c4c9a2f3ca865 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca85e expref: 14 pid: 5820 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201011.363260:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201011.363267:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485697050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:3283:x1875064569996032:12345-0@lo:103: 00010000:00010000:2.0:1788201011.363278:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201011.363283:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962493610000/0xa81c4c9a2f3ca865 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca85e expref: 14 pid: 5820 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.363294:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962493610000/0xa81c4c9a2f3ca865 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca85e expref: 14 pid: 5820 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.363311:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.363326:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201011.363386:0:5810:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008489459s 00010000:00010000:2.0:1788201011.363403:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.363410:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.363417:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.363423:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.363428:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624c21f1000 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:2.0:1788201011.363431:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.363439:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.363448:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201011.363457:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201011.363489:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485697050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:3283:x1875064569996032:12345-0@lo:103: Request processed in 222us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201011.363496:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201011.363575:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064569996032:0@lo:103: 00010000:00010000:0.0:1788201011.363864:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962493610000/0xa81c4c9a2f3ca865 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca85e expref: 13 pid: 5820 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201011.363877:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064569995904:0@lo:104: 00010000:00010000:0.0:1788201011.363892:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.363901:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.363906:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201011.363913:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca906 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201011.387389:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:6666:x1875064569995776:12345-0@lo:253: Request processed in 61067us (61309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201011.387408:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201011.391186:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba858a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6666:1875064569995776:0@lo:253: 10000000:01000000:2.0:1788201011.391211:0:6666:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788201011.391215:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201011.391217:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201011.391219:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201011.391220:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201011.391222:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201011.391223:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201011.391225:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201011.391227:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788201011.391229:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788201011.391230:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201011.391232:0:6666:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788201011.391258:0:6666:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788201011.396875:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201011.397115:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201011.397465:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201011.397631:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201011.397870:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201011.398162:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788201011.403598:0:6666:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788201011.671720:0:6666:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788201011.671727:0:6666:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788201011.671762:0:6666:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788201011.671824:0:6666:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788201011.671850:0:6666:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788201011.671885:0:6666:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788201011.960805:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201012.991415:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201014.006817:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788201014.646675:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201014.646682:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9624902af800 from 21 10000000:01000000:2.0:1788201014.646687:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201014.646728:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201014.646739:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201014.646762:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201014.646818:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569996160:0@lo:101: 00000100:00100000:2.0:1788201014.646879:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201014.647024:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485154180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201014.651106:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569996160 00000100:00100000:1.0:1788201014.651129:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569996160 00000100:00100000:1.0:1788201014.651189:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201014.651207:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5822:x1875064569996160:12345-0@lo:101: 00010000:00010000:1.0:1788201014.651225:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201014.651242:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3ca914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca90d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201014.651268:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3ca914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca90d expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201014.651280:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3ca914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca90d expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201014.651290:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f1600, rc 0) 00000100:00100000:1.0:1788201014.651402:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:5822:x1875064569996160:12345-0@lo:101: Request processed in 197us (4521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201014.651409:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201014.651742:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569996160:0@lo:101: 00010000:00010000:3.0:1788201014.651759:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca914 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201014.651769:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca914 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201014.651846:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569996288:0@lo:501: 00000100:00100000:3.0:1788201014.651882:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201014.651922:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b36300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201014.652042:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569996288 00000100:00100000:0.0:1788201014.652046:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569996288 00000100:00100000:0.0:1788201014.652082:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201014.652090:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:5822:x1875064569996288:12345-0@lo:501: 00000100:00100000:0.0:1788201014.652491:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:5822:x1875064569996288:12345-0@lo:501: Request processed in 400us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201014.652499:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201014.652536:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569996288:0@lo:501: 00000100:00100000:0.0:1788201014.652567:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569996416:0@lo:503: 00000100:00100000:0.0:1788201014.652844:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201014.652863:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624883f7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201014.652876:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569996416 00000100:00100000:0.0:1788201014.652880:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569996416 00000100:00100000:0.0:1788201014.652898:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201014.652904:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:5822:x1875064569996416:12345-0@lo:503: 00000100:00100000:0.0:1788201014.653188:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:5822:x1875064569996416:12345-0@lo:503: Request processed in 283us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201014.653195:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201014.653231:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569996416:0@lo:503: 00000100:00100000:3.0:1788201014.659949:0:6829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6829:1875064569996544:0@lo:502: 00000100:00100000:3.0:1788201014.660054:0:6829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201014.660105:0:6829:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b36600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201014.660217:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569996544 00000100:00100000:1.0:1788201014.660225:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569996544 00000100:00100000:1.0:1788201014.660280:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201014.660290:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6829:x1875064569996544:12345-0@lo:502: 00000100:00100000:1.0:1788201014.660644:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6829:x1875064569996544:12345-0@lo:502: Request processed in 355us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201014.660652:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201014.661161:0:6829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6829:1875064569996544:0@lo:502: 00000100:00100000:2.0:1788201014.661230:0:6829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6829:1875064569996672:0@lo:502: 00000100:00100000:2.0:1788201014.661275:0:6829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201014.661309:0:6829:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485154e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201014.662728:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569996672 00000100:00100000:3.0:1788201014.662740:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569996672 00000100:00100000:3.0:1788201014.662810:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201014.662820:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6829:x1875064569996672:12345-0@lo:502: 00000100:00100000:3.0:1788201014.663089:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:6829:x1875064569996672:12345-0@lo:502: Request processed in 269us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201014.663096:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788201014.663206:0:6829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6829:1875064569996672:0@lo:502: 00000040:00080000:2.0:1788201014.663238:0:6829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788201014.663663:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788201014.663684:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201014.663694:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca914 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201014.663706:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca914 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201014.663715:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201014.663718:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9624902af800 from 4 10000000:01000000:3.0:1788201014.663720:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201014.663752:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201014.663760:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201014.663770:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201014.663802:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569996800:0@lo:101: 00000100:00100000:3.0:1788201014.663851:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201014.663891:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b36000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201014.664093:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569996800 00000100:00100000:1.0:1788201014.664099:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569996800 00000100:00100000:1.0:1788201014.664201:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201014.664209:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:5822:x1875064569996800:12345-0@lo:101: 00010000:00010000:1.0:1788201014.664220:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201014.664236:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca91b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201014.664267:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca91b expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201014.664277:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca91b expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201014.664287:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f1000, rc 0) 00000100:00100000:1.0:1788201014.664322:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064569996800:12345-0@lo:101: Request processed in 115us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201014.664328:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201014.664679:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569996800:0@lo:101: 00010000:00010000:3.0:1788201014.664691:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca922 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201014.664699:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca922 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201014.664748:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569996928:0@lo:256: 00000100:00100000:3.0:1788201014.664791:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201014.664819:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b36000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201014.664833:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569996928 00000100:00100000:3.0:1788201014.664837:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569996928 00000100:00100000:3.0:1788201014.664857:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201014.664863:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064569996928:12345-0@lo:256: 20000000:01000000:3.0:1788201014.664878:0:5820:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201014.664895:0:5820:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201014.664898:0:5820:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788201014.664975:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064569996928:12345-0@lo:256: Request processed in 112us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201014.664982:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201014.665030:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569996928:0@lo:256: 10000000:01000000:3.0:1788201014.665068:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201014.665074:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca922 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201014.665083:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca922 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201014.665095:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788201014.665098:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788201014.665100:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201014.666091:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201014.666102:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201014.666180:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201014.666206:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569997056:0@lo:101: 00000100:00100000:3.0:1788201014.666244:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201014.666317:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b36000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201014.675734:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569997056 00000100:00100000:2.0:1788201014.675751:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569997056 00000100:00100000:3.0:1788201014.675974:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201014.675988:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064569997056:12345-0@lo:101: 00010000:00010000:3.0:1788201014.676016:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201014.676033:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962493610400/0xa81c4c9a2f3ca930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca929 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201014.676061:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962493610400/0xa81c4c9a2f3ca930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca929 expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201014.676071:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962493610400/0xa81c4c9a2f3ca930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca929 expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201014.676080:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962493610400, rc 0) 00000100:00100000:3.0:1788201014.676189:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064569997056:12345-0@lo:101: Request processed in 205us (9944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201014.676196:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788201014.676711:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569997056:0@lo:101: 00010000:00010000:2.0:1788201014.676732:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca930 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201014.676743:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca930 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201014.676823:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569997184:0@lo:501: 00000100:00100000:2.0:1788201014.676860:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201014.684302:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485154e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201014.687220:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569997184 00000100:00100000:1.0:1788201014.687238:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569997184 00000100:00100000:1.0:1788201014.687296:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201014.687306:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064569997184:12345-0@lo:501: 00000100:00100000:1.0:1788201014.687773:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064569997184:12345-0@lo:501: Request processed in 468us (10911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201014.687791:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201014.689274:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569997184:0@lo:501: 00000100:00100000:1.0:1788201014.689327:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569997312:0@lo:503: 00000100:00100000:1.0:1788201014.689412:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201014.689448:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624881a56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201014.689467:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569997312 00000100:00100000:1.0:1788201014.689592:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569997312 00000100:00100000:1.0:1788201014.689630:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201014.689638:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064569997312:12345-0@lo:503: 00000100:00100000:1.0:1788201014.689979:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064569997312:12345-0@lo:503: Request processed in 341us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201014.689993:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201014.690038:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569997312:0@lo:503: 00000100:00100000:0.0:1788201014.694418:0:6833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6833:1875064569997440:0@lo:502: 00000100:00100000:0.0:1788201014.694569:0:6833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201014.694613:0:6833:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1b370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201014.694649:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569997440 00000100:00100000:0.0:1788201014.694655:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569997440 00000100:00100000:0.0:1788201014.694692:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201014.694701:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:6833:x1875064569997440:12345-0@lo:502: 00000100:00100000:0.0:1788201014.695006:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:6833:x1875064569997440:12345-0@lo:502: Request processed in 305us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201014.695014:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201014.695075:0:6833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6833:1875064569997440:0@lo:502: 00000020:01000000:0.0:1788201014.695104:0:6833:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788201014.695305:0:6833:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788201014.695314:0:6833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201014.695316:0:6833:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788201014.695322:0:6833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788201014.695326:0:6833:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.156@tcp to nid 0x20000c0a8c99c (192.168.201.156@tcp) 00000020:01000000:0.0:1788201014.695979:0:6833:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788201014.695984:0:6833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201014.695999:0:6833:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9624872999c0) 00000020:00000080:0.0:1788201014.696020:0:6833:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788201014.696026:0:6833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788201014.696317:0:6833:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788201014.696325:0:6833:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788201014.696332:0:6833:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa81c4c9a2f3ca93e 00010000:00080000:0.0:1788201014.696834:0:6833:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96249852b000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.156@tcp at head 00010000:00010000:0.0:1788201014.697058:0:6833:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788201014.779733:0:6833:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788201014.779754:0:6833:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788201014.780309:0:6833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201014.781317:0:6833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201014.781543:0:6833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788201014.781690:0:6833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788201014.782763:0:6845:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788201014.782771:0:6845:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788201014.784864:0:6833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201014.784880:0:6833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788201014.784916:0:6833:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788201014.784939:0:6833:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa81c4c9a2f3ca945 00000100:00080000:0.0:1788201014.784951:0:6833:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201014.784958:0:6833:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788201014.785004:0:6833:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962485739180 x1875064569997568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201014.785026:0:6833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788201014.785270:0:6833:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201014.785274:0:6833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201014.785277:0:6833:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788201014.785280:0:6833:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201014.785285:0:6833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201014.785286:0:6833:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201014.785289:0:6833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201014.785291:0:6833:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788201014.785321:0:6833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485738700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6833:1875064569997696:0@lo:502: 00000100:00100000:0.0:1788201014.785643:0:6833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201014.785691:0:6833:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624901106c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201014.785716:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064569997568:0@lo:8: 00000100:00100000:0.0:1788201014.785756:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201014.785854:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569997696 00000100:00100000:0.0:1788201014.785861:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569997696 00000100:00100000:0.0:1788201014.785892:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201014.785900:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:6833:x1875064569997696:12345-0@lo:502: 00000100:00100000:0.0:1788201014.787331:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:6833:x1875064569997696:12345-0@lo:502: Request processed in 1424us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201014.787935:0:6833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485738700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:6833:1875064569997696:0@lo:502: 00000020:01000000:2.0:1788201014.787989:0:6833:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201014.787997:0:6833:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201014.787999:0:6833:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788201014.788004:0:6833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1788201014.788204:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201014.788275:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569997568 00000100:00100000:0.0:1788201014.788284:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569997568 00000100:00100000:0.0:1788201014.788321:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201014.788329:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875064569997568:12345-0@lo:8: 00000100:00100000:3.0:1788201014.788472:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064569997824:0@lo:400: 00000100:00100000:3.0:1788201014.788654:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201014.788925:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201014.788935:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064569997952:0@lo:400: 00000100:00100000:3.0:1788201014.788965:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201014.789093:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569997824 00000100:00100000:3.0:1788201014.789099:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569997824 00010000:00080000:0.0:1788201014.790006:0:6668:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 146 last 0 00000020:00000080:0.0:1788201014.790173:0:6668:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa81c4c9a2f3ca94c 00002000:00100000:0.0:1788201014.790214:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96248736f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788201014.790219:0:6668:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788201014.790223:0:6668:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:1.0:1788201014.790724:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788201014.790751:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788201014.790761:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca930 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201014.790782:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca930 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201014.790793:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788201014.790796:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff962485b40000 from 1 10000000:01000000:1.0:1788201014.790798:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201014.790833:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201014.790842:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201014.790851:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201014.790872:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569998080:0@lo:101: 00000100:00100000:1.0:1788201014.790930:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201014.790966:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624982c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201014.790989:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569998080 00000100:00100000:1.0:1788201014.790995:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569998080 00002000:00100000:0.0:1788201014.791246:0:6668:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788201014.791824:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788201014.791851:0:6668:0:(import.c:65:import_set_state_nolock()) ffff962487369800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201014.791920:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1875064569997568:12345-0@lo:8: Request processed in 3590us (6163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201014.791929:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788201014.791992:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962485739180 x1875064569997568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201014.792004:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201014.792012:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788201014.792019:0:3281:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788201014.792025:0:3281:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788201014.792027:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788201014.792498:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201014.792514:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064569998080:12345-0@lo:101: 00010000:00010000:1.0:1788201014.792532:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201014.792548:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3ca95a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca953 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201014.793178:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3ca95a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca953 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201014.793192:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3ca95a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca953 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201014.793201:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f1a00, rc 0) 00000100:00100000:1.0:1788201014.793259:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064569998080:12345-0@lo:101: Request processed in 751us (2328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201014.793265:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:0.0:1788201014.793429:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788201014.793439:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064569997568:0@lo:8: 00000100:00100000:3.0:1788201014.793821:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569997952 00000100:00100000:3.0:1788201014.793828:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569997952 00000100:00100000:1.0:1788201014.793977:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569998080:0@lo:101: 00010000:00010000:1.0:1788201014.793994:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca95a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201014.794005:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca95a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201014.794081:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569998208:0@lo:501: 00000100:00100000:1.0:1788201014.794132:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201014.794164:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624982c9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201014.795007:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569998208 00000100:00100000:0.0:1788201014.795016:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569998208 00000100:00100000:0.0:1788201014.795075:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788201014.795084:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064569998208:12345-0@lo:501: 00000100:00100000:0.0:1788201014.795547:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064569998208:12345-0@lo:501: Request processed in 462us (1412us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201014.795555:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788201014.795881:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba858380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064569998208:0@lo:501: 10000000:01000000:0.0:1788201014.795916:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788201014.795925:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca95a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201014.795935:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca95a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201014.795956:0:6845:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788201014.796192:0:6845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 146868849355ns, next at 0ns, rc = 0 00000100:00080000:2.0:1788201014.799446:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201014.799505:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201014.799521:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064569997824:12345-0@lo:400: 00000100:00100000:2.0:1788201014.799685:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064569997824:12345-0@lo:400: Request processed in 169us (11031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201014.799692:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201014.800248:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201014.800260:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064569997952:12345-0@lo:400: 00000100:00100000:3.0:1788201014.800306:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064569997952:12345-0@lo:400: Request processed in 51us (11340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201014.800313:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788201014.802957:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962485739500 x1875064569997824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201014.802978:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064569997824:0@lo:400: 00010000:00080000:0.0:1788201014.803009:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962485738380 x1875064569997952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201014.803019:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064569997952:0@lo:400: 00000004:00080000:3.0:1788201014.881006:0:5847:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788201014.941107:0:6846:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788201014.941154:0:6846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064569998464:0@lo:7: 00000100:00100000:2.0:1788201014.941230:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201014.941279:0:6846:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487145840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201014.941302:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064569998336:0@lo:13: 00000100:00100000:2.0:1788201014.941364:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201014.941413:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569998464 00000100:00100000:2.0:1788201014.941422:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569998464 00000100:00100000:2.0:1788201014.941476:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201014.941486:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6846:x1875064569998464:12345-0@lo:7: 00000100:00080000:3.0:1788201014.944400:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201014.944435:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569998336 00000100:00100000:3.0:1788201014.944445:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569998336 00000100:00100000:3.0:1788201014.944509:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201014.944520:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875064569998336:12345-0@lo:13: 00002000:00000024:3.0:1788201014.944561:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788201014.944647:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875064569998336:12345-0@lo:13: Request processed in 129us (3316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201014.944655:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788201014.945489:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248517ea00 x1875064569998336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201014.945521:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064569998336:0@lo:13: 00002000:00080000:2.0:1788201014.947296:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788201014.947305:0:6671:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788201014.947438:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6846:x1875064569998464:12345-0@lo:7: Request processed in 5949us (6203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201014.947449:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788201014.947456:0:6846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248517fb80 x1875064569998464/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201030 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201014.947469:0:6846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064569998464:0@lo:7: 00000004:00080000:0.0:1788201014.947483:0:6846:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788201014.947525:0:6846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485738380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064569998592:0@lo:5: 00000100:00100000:0.0:1788201014.947590:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201014.947628:0:6846:0:(client.c:2702:ptlrpc_set_wait()) set ffff96248b9af540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201014.952187:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569998592 00000100:00100000:2.0:1788201014.952202:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569998592 00000100:00100000:2.0:1788201014.952262:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201014.952280:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6846:x1875064569998592:12345-0@lo:5: 00002000:00080000:2.0:1788201014.952315:0:6670:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788201014.952319:0:6670:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:0.0:1788201014.953487:0:6846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962485738380 x1875064569998592/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201030 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201014.953520:0:6846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485738380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064569998592:0@lo:5: 00000004:00080000:0.0:1788201014.953535:0:6846:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788201014.953647:0:6846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064569998720:0@lo:700: 00000100:00100000:1.0:1788201014.959625:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201014.959691:0:6846:0:(client.c:2702:ptlrpc_set_wait()) set ffff96248b9af540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201014.959810:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569998720 00000100:00100000:0.0:1788201014.959818:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569998720 00000100:00100000:0.0:1788201014.959875:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201014.959885:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+8:6846:x1875064569998720:12345-0@lo:700: 00000100:00100000:0.0:1788201014.959953:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6677:1875064569998848:0@lo:700: 00000100:00100000:0.0:1788201014.960001:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201014.960025:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff96248b9af180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201014.960044:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569998848 00000100:00100000:0.0:1788201014.960048:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569998848 00000100:00100000:0.0:1788201014.960071:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201014.960078:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6677:x1875064569998848:12345-0@lo:700: 00000100:00100000:2.0:1788201014.964823:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:6846:x1875064569998592:12345-0@lo:5: Request processed in 12534us (17221us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788201014.964840:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 40000000:02000000:1.0:1788201015.010961:0:5832:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788201015.019139:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6677:x1875064569998848:12345-0@lo:700: Request processed in 59053us (59128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201015.019159:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788201015.019227:0:6677:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962485739f80 x1875064569998848/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788201030 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201015.019243:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6677:1875064569998848:0@lo:700: 40000000:02000000:0.0:1788201015.019326:0:6677:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:2.0:1788201015.030529:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201015.081572:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788201015.081608:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1788201015.081710:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6846:x1875064569998720:12345-0@lo:700: Request processed in 121823us (122089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201015.081727:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788201015.081807:0:6846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962485739180 x1875064569998720/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788201030 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201015.081819:0:6846:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788201015.081833:0:6846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064569998720:0@lo:700: 00000004:02000040:2.0:1788201015.105790:0:6846:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788201015.109947:0:6846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064569998976:0@lo:5: 00000100:00100000:3.0:1788201015.110018:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201015.110127:0:6846:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b36780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201015.110236:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569998976 00000100:00100000:2.0:1788201015.110244:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569998976 00000100:00100000:2.0:1788201015.110382:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201015.110396:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6846:x1875064569998976:12345-0@lo:5: 00002000:00080000:2.0:1788201015.134014:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788201015.134152:0:6671:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788201015.149241:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6846:x1875064569998976:12345-0@lo:5: Request processed in 38839us (39212us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788201015.149269:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788201015.149670:0:6846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624ba199500 x1875064569998976/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201031 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201015.149750:0:6846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064569998976:0@lo:5: 00000004:00080000:3.0:1788201015.149775:0:6846:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788201016.055738:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201017.087404:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201018.102638:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201018.387821:0:7039:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788201019.138378:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201019.959315:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201019.959366:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064569999104:0@lo:13: 00000100:00100000:1.0:1788201019.959448:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201019.959565:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569999104 00000100:00100000:3.0:1788201019.959574:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569999104 00000100:00100000:3.0:1788201019.959650:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201019.959661:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875064569999104:12345-0@lo:13: 00002000:00000024:3.0:1788201019.959707:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201019.959760:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875064569999104:12345-0@lo:13: Request processed in 101us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201019.959767:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788201019.959814:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624ba199f80 x1875064569999104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201019.959832:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064569999104:0@lo:13: 00000100:00080000:1.0:1788201019.960099:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201019.960670:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201019.960693:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064569999488:0@lo:400: 00000100:00100000:3.0:1788201019.960736:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201019.960785:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569999488 00000100:00100000:3.0:1788201019.960806:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569999488 00000100:00100000:3.0:1788201019.960851:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201019.960861:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064569999488:12345-0@lo:400: 00000100:00100000:3.0:1788201019.960919:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064569999488:12345-0@lo:400: Request processed in 60us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201019.960926:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788201019.960950:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788201019.960971:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624ba19b800 x1875064569999488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201019.960983:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064569999488:0@lo:400: 00000100:00100000:1.0:1788201019.961175:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064569999232:0@lo:400: 00000100:00100000:1.0:1788201019.961211:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201019.961239:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201019.961245:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064569999360:0@lo:400: 00000100:00100000:1.0:1788201019.961271:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201019.962138:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569999232 00000100:00100000:3.0:1788201019.962147:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569999232 00000100:00100000:3.0:1788201019.962208:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201019.962218:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064569999232:12345-0@lo:400: 00000100:00100000:3.0:1788201019.962288:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064569999232:12345-0@lo:400: Request processed in 72us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201019.962303:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788201019.962381:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064569999232:0@lo:400: 00000100:00100000:3.0:1788201019.962383:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569999360 00000100:00100000:3.0:1788201019.962395:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569999360 00000100:00100000:3.0:1788201019.962450:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201019.962457:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064569999360:12345-0@lo:400: 00000100:00100000:3.0:1788201019.962498:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064569999360:12345-0@lo:400: Request processed in 42us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201019.962504:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788201019.962545:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624ba19b480 x1875064569999360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201019.962570:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064569999360:0@lo:400: 00010000:00010000:1.0:1788201020.151536:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788201020.651794:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788201021.176366:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201022.198672:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201023.224368:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201024.252542:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201025.078643:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201025.078674:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064569999616:0@lo:13: 00000100:00100000:3.0:1788201025.078750:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201025.078828:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569999616 00000100:00100000:3.0:1788201025.078836:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569999616 00000100:00100000:0.0:1788201025.079307:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064569999744:0@lo:400: 00000100:00100000:0.0:1788201025.079495:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201025.079540:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201025.079546:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064569999872:0@lo:400: 00000100:00100000:0.0:1788201025.079575:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201025.079621:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569999744 00000100:00100000:0.0:1788201025.079627:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569999744 00000100:00100000:0.0:1788201025.079660:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788201025.079669:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064569999744:12345-0@lo:400: 00000100:00100000:0.0:1788201025.079720:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064569999744:12345-0@lo:400: Request processed in 51us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201025.079727:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788201025.079758:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064569999872 00000100:00100000:0.0:1788201025.079762:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064569999872 00000100:00100000:0.0:1788201025.079788:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201025.079795:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064569999872:12345-0@lo:400: 00000100:00100000:0.0:1788201025.079826:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064569999872:12345-0@lo:400: Request processed in 32us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201025.079832:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788201025.079870:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248573b800 x1875064569999872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201025.080547:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201025.080561:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064569999616:12345-0@lo:13: 00002000:00000024:3.0:1788201025.080592:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201025.080644:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064569999616:12345-0@lo:13: Request processed in 88us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201025.080651:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788201025.080681:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201025.081197:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201025.081215:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570000000:0@lo:400: 00000100:00100000:2.0:1788201025.081266:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788201025.083278:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624ba19b480 x1875064569999616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201025.083294:0:3282:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788201025.083332:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064569999616:0@lo:13: 00000100:00100000:3.0:1788201025.083461:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570000000 00000100:00100000:3.0:1788201025.083472:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570000000 00000100:00100000:3.0:1788201025.083546:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201025.083557:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570000000:12345-0@lo:400: 00000100:00100000:3.0:1788201025.083661:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570000000:12345-0@lo:400: Request processed in 106us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201025.083669:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788201025.084412:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962485738000 x1875064570000000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201025.084427:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570000000:0@lo:400: 00000100:00100000:0.0:1788201025.085736:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064569999872:0@lo:400: 00000100:00100000:0.0:1788201025.085784:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064569999744:0@lo:400: 00000100:00080000:1.0:1788201025.090655:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201025.272115:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201026.297043:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201027.318632:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201028.344008:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201029.370327:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201030.199572:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570000512:0@lo:400: 00000100:00100000:0.0:1788201030.199676:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201030.199744:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201030.199750:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570000128:0@lo:400: 00000100:00100000:0.0:1788201030.199776:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201030.199805:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570000256:0@lo:400: 00000100:00100000:0.0:1788201030.199831:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201030.199850:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201030.199855:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570000384:0@lo:400: 00000100:00100000:0.0:1788201030.199876:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201030.199905:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570000512 00000100:00100000:0.0:1788201030.199913:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570000512 00000100:00100000:0.0:1788201030.199972:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201030.199983:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570000512:12345-0@lo:400: 00000100:00100000:0.0:1788201030.200037:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570000512:12345-0@lo:400: Request processed in 57us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201030.200044:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201030.200065:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570000128 00000100:00100000:0.0:1788201030.200068:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570000128 00000100:00100000:0.0:1788201030.200088:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788201030.200093:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570000128:12345-0@lo:400: 00000100:00100000:0.0:1788201030.200118:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570000128:12345-0@lo:400: Request processed in 25us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201030.200123:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788201030.200145:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570000256 00000100:00100000:0.0:1788201030.200148:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570000256 00000100:00100000:0.0:1788201030.200168:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570000384 00000100:00100000:0.0:1788201030.200170:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570000384 00000100:00100000:0.0:1788201030.200187:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201030.200192:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570000256:12345-0@lo:400: 00000100:00100000:0.0:1788201030.200232:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570000256:12345-0@lo:400: Request processed in 40us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201030.200239:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201030.200250:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201030.200255:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570000384:12345-0@lo:400: 00000100:00100000:0.0:1788201030.200276:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570000384:12345-0@lo:400: Request processed in 21us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201030.200281:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788201030.200298:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201030.200302:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201030.200337:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962485738000 x1875064570000384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201030.200377:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570000384:0@lo:400: 00010000:00080000:0.0:1788201030.200387:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248573b800 x1875064570000256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201030.200395:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570000256:0@lo:400: 00000100:00100000:0.0:1788201030.200421:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570000128:0@lo:400: 00010000:00080000:0.0:1788201030.200429:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962485739180 x1875064570000512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201030.200437:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570000512:0@lo:400: 00000100:00100000:3.0:1788201030.203461:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570000640:0@lo:13: 00000100:00100000:3.0:1788201030.203538:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201030.205033:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570000640 00000100:00100000:3.0:1788201030.205059:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570000640 00000100:00100000:3.0:1788201030.205413:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201030.205424:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570000640:12345-0@lo:13: 00002000:00000024:3.0:1788201030.206389:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201030.206483:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570000640:12345-0@lo:13: Request processed in 1060us (2942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201030.206492:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788201030.206625:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624ba19b480 x1875064570000640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201030.206648:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570000640:0@lo:13: 00010000:00010000:1.0:1788201030.390618:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201031.414901:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201031.723150:0:7610:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788201031.723155:0:7610:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788201031.723305:0:7610:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9624bfded000 00000020:01000004:2.0:1788201031.723321:0:7610:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788201031.723333:0:7610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788201031.723391:0:7610:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff962487eb4d40) 00000020:00000080:2.0:1788201031.723409:0:7610:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788201031.747503:0:7610:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788201031.747845:0:7610:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788201031.772416:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788201031.780623:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788201031.780657:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788201031.780721:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788201031.780751:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788201031.781791:0:7610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788201031.781805:0:7610:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788201031.781815:0:7610:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa81c4c9a2f3ca968 00000020:01000004:2.0:1788201031.781824:0:7610:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788201031.781844:0:7610:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.156@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788201031.781848:0:7610:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788201031.781854:0:7610:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788201031.781877:0:7610:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788201031.781881:0:7610:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788201031.815200:0:7610:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788201031.815241:0:7610:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.156@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788201031.815245:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788201031.815247:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201031.815249:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201031.815250:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201031.815251:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201031.815252:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201031.815253:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201031.815255:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788201031.815256:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788201031.815258:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201031.815259:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201031.815262:0:7610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788201031.815264:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201031.815265:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201031.815267:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201031.815268:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201031.815269:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201031.815270:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201031.815271:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201031.815272:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788201031.815272:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788201031.815273:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201031.815279:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201031.815306:0:7610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788201031.815329:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570000768:0@lo:253: 00000100:00100000:3.0:1788201031.815451:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201031.815860:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570000768 00000100:00100000:0.0:1788201031.815883:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570000768 00000100:00100000:0.0:1788201031.815950:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788201031.815960:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:7610:x1875064570000768:12345-0@lo:253: 20000000:01000000:0.0:1788201031.815992:0:5818:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788201031.815996:0:5818:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788201031.816002:0:5818:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788201031.816005:0:5818:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788201031.816929:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201031.817087:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788201031.817101:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788201031.817130:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788201031.817136:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788201031.817156:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788201031.817218:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788201031.817549:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788201031.817569:0:5818:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.156@tcp 20000000:01000000:0.0:1788201031.817571:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.156@tcp (null) (null) (null) 00000040:00080000:0.0:1788201031.817612:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788201031.817621:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788201031.817670:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788201031.817678:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.156@tcp (null) (null) 00000040:00080000:0.0:1788201031.817712:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788201031.817721:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788201031.817753:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788201031.817802:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788201031.818580:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788201031.818601:0:5818:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.156@tcp 20000000:01000000:0.0:1788201031.818603:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.156@tcp (null) (null) (null) 00000040:00080000:0.0:1788201031.818640:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788201031.818648:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788201031.818680:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788201031.818696:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.156@tcp (null) (null) 00000040:00080000:0.0:1788201031.818733:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788201031.818742:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788201031.818792:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788201031.818839:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788201031.818854:0:5818:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788201031.818857:0:5818:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788201031.818861:0:5818:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788201031.818875:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788201031.818878:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788201031.818914:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788201031.818916:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000100:00100000:3.0:1788201031.819488:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485952000 going to sleep for 11 seconds 20000000:01000000:3.0:1788201031.819849:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788201031.819897:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788201031.819927:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788201031.820327:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788201031.820504:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788201031.820543:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788201031.820557:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788201031.820559:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788201031.821540:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788201031.821651:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788201031.821689:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788201031.822229:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788201031.822464:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788201031.822543:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788201031.822562:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788201031.822564:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788201031.823030:0:7614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788201031.823235:0:7614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788201031.823388:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788201031.824030:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788201031.826920:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788201031.827022:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788201031.827110:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788201031.827113:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788201031.829764:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788201031.830548:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788201031.830604:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788201031.830763:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788201031.830785:0:5818:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788201031.830787:0:5818:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788201031.830796:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788201031.830817:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.830837:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca8b9 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.830844:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca8e3 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.830862:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3ca914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca90d expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.830868:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962493610400/0xa81c4c9a2f3ca930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca929 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.830875:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3ca95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca953 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.830881:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.830928:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3ca95a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca953 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.830942:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3ca95a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca953 expref: 16 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201031.830957:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba858a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5818:1875064570000896:0@lo:104: 00000100:00100000:1.0:1788201031.831026:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201031.833915:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962493610400/0xa81c4c9a2f3ca930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca929 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.833934:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962493610400/0xa81c4c9a2f3ca930 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca929 expref: 16 pid: 5820 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201031.833948:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5818:1875064570001024:0@lo:104: 00010000:00010000:1.0:1788201031.833998:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3ca914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca90d expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.834025:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3ca914 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca90d expref: 16 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201031.834103:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5818:1875064570001152:0@lo:104: 00010000:00010000:1.0:1788201031.834134:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8e3 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.834142:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8e3 expref: 16 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201031.834160:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5818:1875064570001280:0@lo:104: 00010000:00010000:1.0:1788201031.834231:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8b9 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.834241:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8b9 expref: 16 pid: 5820 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201031.834250:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba859180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5818:1875064570001408:0@lo:104: 00000100:00100000:1.0:1788201031.834336:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624a8733000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201031.834769:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201031.834797:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201031.834817:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201031.834825:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201031.834833:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201031.834845:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570000896 00000100:00100000:3.0:1788201031.834852:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570000896 00000100:00100000:3.0:1788201031.834888:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570001024 00000100:00100000:3.0:1788201031.834891:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570001024 00000100:00100000:3.0:1788201031.834899:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570001152 00000100:00100000:3.0:1788201031.834901:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570001152 00000100:00100000:3.0:1788201031.834909:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570001280 00000100:00100000:3.0:1788201031.834911:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570001280 00000100:00100000:3.0:1788201031.834917:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570001408 00000100:00100000:3.0:1788201031.834919:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570001408 00000100:00100000:3.0:1788201031.834929:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201031.834937:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+7:5818:x1875064570000896:12345-0@lo:104: 00010000:00010000:3.0:1788201031.834951:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca95a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.835133:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201031.835140:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+7:5818:x1875064570000896:12345-0@lo:104: Request processed in 204us (4113us total) trans 0 rc 0/0 00010000:00010000:2.0:1788201031.835219:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201031.835226:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca95a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.835235:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624c21f1800 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:2.0:1788201031.835239:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca95a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.835247:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca95a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201031.835254:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca95a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201031.835409:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201031.835444:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca95a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.835451:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201031.835468:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca95a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.835475:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624c21f1800/0xa81c4c9a2f3ca953 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca95a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.835498:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201031.835500:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201031.835502:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201031.835527:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570001536:0@lo:103: 00000100:00100000:2.0:1788201031.835559:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201031.835605:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570001536 00000100:00100000:2.0:1788201031.835609:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570001536 00010000:00010000:2.0:1788201031.836436:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3ca95a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca953 expref: 17 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201031.836469:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201031.836495:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3284:x1875064570001536:12345-0@lo:103: 00010000:00010000:2.0:1788201031.836510:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201031.836516:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3ca95a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca953 expref: 17 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.836528:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3ca95a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca953 expref: 17 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.836557:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201031.836603:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3284:x1875064570001536:12345-0@lo:103: Request processed in 126us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201031.836610:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201031.836728:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201031.836775:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201031.836783:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+6:5818:x1875064570001024:12345-0@lo:104: 00010000:00010000:3.0:1788201031.836793:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca930 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.836837:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201031.836842:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+6:5818:x1875064570001024:12345-0@lo:104: Request processed in 62us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201031.836847:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201031.836861:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201031.836867:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+5:5818:x1875064570001152:12345-0@lo:104: 00010000:00010000:3.0:1788201031.836875:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca914 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.836906:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201031.836911:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+5:5818:x1875064570001152:12345-0@lo:104: Request processed in 44us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201031.836916:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201031.836929:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201031.836935:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+4:5818:x1875064570001280:12345-0@lo:104: 00010000:00010000:3.0:1788201031.836941:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca8ea expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.836975:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788201031.836980:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+4:5818:x1875064570001280:12345-0@lo:104: Request processed in 46us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201031.836986:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201031.836999:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201031.837006:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5818:x1875064570001408:12345-0@lo:104: 00010000:00010000:3.0:1788201031.837013:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca8c0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201031.837148:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570001536:0@lo:103: 00010000:00010000:2.0:1788201031.837173:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201031.837179:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca930 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.837186:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962493610600 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:2.0:1788201031.837190:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca930 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.837199:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca930 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201031.837206:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca930 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201031.837212:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201031.837239:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca930 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.837245:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201031.837257:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca930 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201031.838158:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570001664:0@lo:103: 00010000:00010000:2.0:1788201031.838276:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962493610600/0xa81c4c9a2f3ca929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca930 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.838309:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201031.838313:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca914 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.838319:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5e00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:2.0:1788201031.838323:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca914 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.838330:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca914 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201031.838337:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca914 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201031.838358:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201031.838382:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca914 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.838388:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201031.838408:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca914 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.838415:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca90d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca914 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.838426:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201031.838429:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca8ea expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.838443:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5a00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:2.0:1788201031.838446:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca8ea expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.838453:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca8ea expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201031.838459:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca8ea expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201031.838464:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201031.838490:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca8ea expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.838496:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201031.838501:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca8ea expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.838507:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca8e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca8ea expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.838515:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201031.838518:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201031.838520:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201031.838531:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570001792:0@lo:103: 00010000:00010000:0.0:1788201031.838619:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3ca95a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca953 expref: 16 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201031.838645:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba858a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5818:1875064570000896:0@lo:104: 00000100:00100000:0.0:1788201031.838657:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5818:1875064570001024:0@lo:104: 00000100:00100000:0.0:1788201031.838664:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5818:1875064570001152:0@lo:104: 00000100:00100000:0.0:1788201031.838673:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5818:1875064570001280:0@lo:104: 00000100:00100000:0.0:1788201031.838681:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba859180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5818:1875064570001408:0@lo:104: 00010000:00010000:0.0:1788201031.838706:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201031.839053:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201031.839226:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570001664 00000100:00100000:0.0:1788201031.839234:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570001664 00010000:00010000:0.0:1788201031.839272:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962493610400/0xa81c4c9a2f3ca930 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca929 expref: 16 pid: 5820 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201031.839307:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201031.839324:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570001664:12345-0@lo:103: 00010000:00010000:0.0:1788201031.839336:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201031.839362:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962493610400/0xa81c4c9a2f3ca930 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca929 expref: 16 pid: 5820 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.839373:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962493610400/0xa81c4c9a2f3ca930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca929 expref: 16 pid: 5820 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.839389:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962493610400/0xa81c4c9a2f3ca930 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca929 expref: 16 pid: 5820 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.839401:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201031.839442:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:3285:x1875064570001664:12345-0@lo:103: Request processed in 120us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201031.839449:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201031.839493:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570001664:0@lo:103: 00010000:00010000:3.0:1788201031.839786:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201031.839794:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5818:x1875064570001408:12345-0@lo:104: Request processed in 2788us (4958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201031.839801:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788201031.839826:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201031.839832:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca8c0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.839839:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5c00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:3.0:1788201031.839842:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca8c0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.839850:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca8c0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201031.839856:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca8c0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201031.839862:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201031.839900:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca8c0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.839907:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201031.839917:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca8c0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.839923:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624829c5c00/0xa81c4c9a2f3ca8b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca8c0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.839938:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201031.839940:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201031.839942:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201031.840001:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201031.840007:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201031.840018:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570002048:0@lo:103: 00000100:00100000:0.0:1788201031.840059:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201031.840096:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570002048 00000100:00100000:0.0:1788201031.840101:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570002048 00010000:00010000:0.0:1788201031.840115:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8b9 expref: 15 pid: 5820 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201031.840135:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201031.840142:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:3285:x1875064570002048:12345-0@lo:103: 00010000:00010000:0.0:1788201031.840150:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201031.840163:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8b9 expref: 15 pid: 5820 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.840171:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8b9 expref: 15 pid: 5820 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.840182:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3ca8c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8b9 expref: 15 pid: 5820 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.840194:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201031.840223:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:3285:x1875064570002048:12345-0@lo:103: Request processed in 82us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201031.840230:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201031.840270:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570002048:0@lo:103: 00000100:00100000:2.0:1788201031.840982:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201031.841122:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201031.841134:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570001920:0@lo:103: 00000100:00100000:2.0:1788201031.841177:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201031.841614:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570001792 00000100:00100000:1.0:1788201031.841738:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570001792 00010000:00010000:1.0:1788201031.841772:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3ca914 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca90d expref: 14 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201031.841810:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570001920 00000100:00100000:0.0:1788201031.841814:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570001920 00010000:00010000:0.0:1788201031.841829:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8e3 expref: 15 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201031.841885:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201031.841893:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:3282:x1875064570001792:12345-0@lo:103: 00010000:00010000:0.0:1788201031.841905:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201031.841910:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3ca914 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca90d expref: 15 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.841921:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3ca914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca90d expref: 15 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.841936:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3ca914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca90d expref: 15 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.841960:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201031.842011:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:3282:x1875064570001792:12345-0@lo:103: Request processed in 119us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201031.842017:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201031.842033:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201031.842132:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570001792:0@lo:103: 00000100:00100000:0.0:1788201031.843552:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:3282:x1875064570001920:12345-0@lo:103: 00010000:00010000:0.0:1788201031.843569:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201031.843576:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8e3 expref: 13 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.843590:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8e3 expref: 13 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.843608:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca8ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8e3 expref: 13 pid: 5819 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.843637:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.843646:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.843661:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.843669:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.843675:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.843694:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.843701:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624c21f0e00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:0.0:1788201031.843705:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.843713:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.843731:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.843741:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201031.843800:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:3282:x1875064570001920:12345-0@lo:103: Request processed in 257us (2622us total) trans 0 rc 0/0 00010000:00010000:1.0:1788201031.845844:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.845882:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.845889:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca96f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201031.845912:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788201031.846517:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201031.846579:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570001920:0@lo:103: 00000100:00100000:1.0:1788201031.914725:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:7610:x1875064570000768:12345-0@lo:253: Request processed in 98754us (99261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201031.914742:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788201031.915512:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570000768:0@lo:253: 10000000:01000000:3.0:1788201031.915538:0:7610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788201031.915541:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201031.915543:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201031.915544:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201031.915545:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788201031.915546:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201031.915547:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201031.915549:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201031.915550:0:7610:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788201031.915552:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201031.915553:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201031.915580:0:7610:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9624bfded000 from lustre-OST0001 10000000:01000000:3.0:1788201031.915609:0:7610:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788201031.915611:0:7610:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788201031.915620:0:7610:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962485b40000 local copy 10000000:01000000:3.0:1788201031.915635:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788201031.915674:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.915699:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.915709:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201031.915727:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570002176:0@lo:101: 00000100:00100000:3.0:1788201031.915770:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201031.915826:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485016780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201031.916146:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570002176 00000100:00100000:0.0:1788201031.916154:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570002176 00000100:00100000:0.0:1788201031.916214:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201031.916224:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+11:7610:x1875064570002176:12345-0@lo:101: 00010000:00010000:0.0:1788201031.916242:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201031.916335:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca97d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca976 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.916381:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca97d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca976 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.916410:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca97d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca976 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.916421:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962480031c00, rc 0) 00000100:00100000:0.0:1788201031.916468:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:7610:x1875064570002176:12345-0@lo:101: Request processed in 245us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201031.916487:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201031.916657:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570002176:0@lo:101: 00010000:00010000:3.0:1788201031.916674:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa81c4c9a2f3ca97d expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.916684:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa81c4c9a2f3ca97d expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201031.916808:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570002304:0@lo:501: 00000100:00100000:3.0:1788201031.916842:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201031.916883:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485016780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201031.917003:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570002304 00000100:00100000:0.0:1788201031.917008:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570002304 00000100:00100000:0.0:1788201031.917115:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788201031.917124:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:7610:x1875064570002304:12345-0@lo:501: 00000100:00100000:0.0:1788201031.917440:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:7610:x1875064570002304:12345-0@lo:501: Request processed in 316us (596us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201031.917447:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788201031.917587:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570002304:0@lo:501: 10000000:01000000:3.0:1788201031.917601:0:7610:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788201031.917711:0:7610:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788201031.917719:0:7610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa81c4c9a2f3ca97d expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.917728:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa81c4c9a2f3ca97d expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.917743:0:7610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa81c4c9a2f3ca97d expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.917770:0:7610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788201031.917795:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9624bfded000 10000000:01000000:3.0:1788201031.917800:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788201031.917807:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788201031.917810:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201031.917814:0:7610:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788201031.917817:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788201031.917839:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.917846:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201031.917853:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201031.917867:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570002432:0@lo:101: 00000100:00100000:3.0:1788201031.917898:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201031.918032:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788201031.918136:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485016a80 going to sleep for 11 seconds 00010000:00010000:0.0:1788201031.918174:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa81c4c9a2f3ca97d expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.918182:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962493610800 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:0.0:1788201031.918186:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa81c4c9a2f3ca97d expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.918195:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa81c4c9a2f3ca97d expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201031.918202:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa81c4c9a2f3ca97d expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201031.918205:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570002432 00000100:00100000:1.0:1788201031.918211:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570002432 10000000:01000000:0.0:1788201031.918217:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201031.918236:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa81c4c9a2f3ca97d expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.918242:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201031.918263:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201031.918272:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:7610:x1875064570002432:12345-0@lo:101: 00010000:00010000:1.0:1788201031.918283:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201031.918297:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca98b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca984 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.918318:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca984 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.918328:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca984 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.918336:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f0e00, rc 0) 00000100:00100000:1.0:1788201031.918407:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:7610:x1875064570002432:12345-0@lo:101: Request processed in 136us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201031.918413:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788201031.918446:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570002432:0@lo:101: 00010000:00010000:2.0:1788201031.918460:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca98b expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.918468:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca98b expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201031.918553:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570002688:0@lo:501: 00000100:00100000:2.0:1788201031.918579:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201031.918600:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff962482acad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201031.918613:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570002688 00000100:00100000:2.0:1788201031.918617:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570002688 00000100:00100000:3.0:1788201031.918720:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570002560:0@lo:103: 00000100:00100000:3.0:1788201031.918749:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201031.918809:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570002560 00000100:00100000:1.0:1788201031.918814:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570002560 00010000:00010000:0.0:1788201031.918818:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa81c4c9a2f3ca97d expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.918825:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962493610800/0xa81c4c9a2f3ca976 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa81c4c9a2f3ca97d expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.918838:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201031.918840:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201031.918841:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201031.918843:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201031.918849:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:3285:x1875064570002560:12345-0@lo:103: 00010000:00010000:1.0:1788201031.918859:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201031.918872:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3ca97d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca976 expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201031.918884:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201031.918922:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:3285:x1875064570002560:12345-0@lo:103: Request processed in 74us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201031.918929:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201031.919608:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570002560:0@lo:103: 00000100:00100000:2.0:1788201031.919742:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788201031.919754:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:7610:x1875064570002688:12345-0@lo:501: 00000100:00100000:2.0:1788201031.920051:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:7610:x1875064570002688:12345-0@lo:501: Request processed in 301us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201031.920058:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788201031.920142:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570002688:0@lo:501: 00000100:00100000:3.0:1788201031.920179:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570002816:0@lo:503: 00000100:00100000:3.0:1788201031.920221:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201031.933598:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624850169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201031.936535:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570002816 00000100:00100000:0.0:1788201031.936550:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570002816 00000100:00100000:0.0:1788201031.936622:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788201031.936633:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:7610:x1875064570002816:12345-0@lo:503: 00000100:00100000:0.0:1788201031.936911:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:7610:x1875064570002816:12345-0@lo:503: Request processed in 279us (16689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201031.936919:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788201031.937211:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570002816:0@lo:503: 00000040:00080000:3.0:1788201031.937611:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201031.938464:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570002944:0@lo:502: 00000100:00100000:3.0:1788201031.939237:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201031.939744:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624850169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201031.943251:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570002944 00000100:00100000:0.0:1788201031.943395:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570002944 00000100:00100000:0.0:1788201031.943467:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788201031.943489:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:7610:x1875064570002944:12345-0@lo:502: 00000100:00100000:0.0:1788201031.944469:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:7610:x1875064570002944:12345-0@lo:502: Request processed in 988us (5230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201031.944500:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201031.951402:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570002944:0@lo:502: 00000040:00080000:3.0:1788201031.951792:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788201031.951862:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788201031.951897:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788201031.951963:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788201031.952005:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788201031.952040:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788201031.953379:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003072:0@lo:502: 00000100:00100000:3.0:1788201031.953472:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201031.953609:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624850169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201031.953664:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570003072 00000100:00100000:1.0:1788201031.953672:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570003072 00000100:00100000:1.0:1788201031.953786:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201031.953797:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:7610:x1875064570003072:12345-0@lo:502: 00000100:00100000:1.0:1788201031.954063:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:7610:x1875064570003072:12345-0@lo:502: Request processed in 268us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201031.954078:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788201031.954287:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003072:0@lo:502: 00000040:00080000:3.0:1788201031.954473:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788201031.954501:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788201031.957311:0:7619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201031.957323:0:7619:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788201031.957330:0:7619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201031.957333:0:7619:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788201031.957339:0:7619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201031.957420:0:7619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9624909d8000) 00000020:00000080:3.0:1788201031.957445:0:7619:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788201031.957452:0:7619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201031.957527:0:7619:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9624bfded000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788201031.957535:0:7619:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201031.957549:0:7619:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa81c4c9a2f3ca999 00010000:00010000:3.0:1788201031.962536:0:7619:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788201031.962871:0:7619:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788201031.967460:0:7619:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788201031.967740:0:7619:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788201031.973769:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788201031.974938:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788201031.977867:0:7619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788201031.977879:0:7619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201031.977885:0:7619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201031.977887:0:7619:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788201031.977891:0:7619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201031.977895:0:7619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201031.977896:0:7619:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201031.977899:0:7619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201031.977901:0:7619:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788201031.977960:0:7619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201031.977964:0:7619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201031.977965:0:7619:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788201031.977968:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788201031.978908:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788201031.978951:0:7610:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788201031.978976:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca98b expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.978988:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca98b expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201031.979012:0:7610:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9624bfded000 from 1 10000000:01000000:2.0:1788201031.979015:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201031.979074:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.979082:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201031.979093:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201031.979118:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003200:0@lo:101: 00000100:00100000:2.0:1788201031.979190:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201031.979228:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff962482aca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201031.979496:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570003200 00000100:00100000:0.0:1788201031.979504:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570003200 00000100:00100000:0.0:1788201031.979552:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788201031.979563:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:7610:x1875064570003200:12345-0@lo:101: 00010000:00010000:0.0:1788201031.979577:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201031.979591:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3ca9a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca9a0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.979615:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3ca9a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9a0 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.979645:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3ca9a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9a0 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.979655:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962480031a00, rc 0) 00000100:00100000:0.0:1788201031.979700:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:7610:x1875064570003200:12345-0@lo:101: Request processed in 139us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201031.979716:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788201031.979764:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003200:0@lo:101: 00010000:00010000:0.0:1788201031.979777:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9a7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201031.979786:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca9a7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201031.979877:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003328:0@lo:501: 00000100:00100000:0.0:1788201031.979903:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201031.979927:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba849d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201031.980388:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570003328 00000100:00100000:2.0:1788201031.980394:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570003328 00000100:00100000:2.0:1788201031.980433:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788201031.980442:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:7610:x1875064570003328:12345-0@lo:501: 00000100:00100000:2.0:1788201031.980711:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:7610:x1875064570003328:12345-0@lo:501: Request processed in 270us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201031.980717:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201031.980946:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003328:0@lo:501: 00000100:00100000:0.0:1788201031.980980:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003456:0@lo:503: 00000100:00100000:0.0:1788201031.981021:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201031.981054:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba849d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201031.981201:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570003456 00000100:00100000:0.0:1788201031.981205:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570003456 00000100:00100000:0.0:1788201031.981238:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788201031.981245:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:7610:x1875064570003456:12345-0@lo:503: 00000100:00100000:0.0:1788201031.984263:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:7610:x1875064570003456:12345-0@lo:503: Request processed in 3008us (3232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201031.984278:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201031.991128:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003456:0@lo:503: 00000040:00080000:1.0:1788201031.992009:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201031.992098:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003584:0@lo:502: 00000100:00100000:1.0:1788201031.992175:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201031.992272:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624a8733cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201031.994226:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570003584 00000100:00100000:0.0:1788201031.994237:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570003584 00000100:00100000:0.0:1788201031.994414:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788201031.994424:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:7610:x1875064570003584:12345-0@lo:502: 00000100:00100000:0.0:1788201031.994702:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:7610:x1875064570003584:12345-0@lo:502: Request processed in 279us (2526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201031.994710:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201031.994804:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003584:0@lo:502: 00000040:00080000:1.0:1788201031.995055:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788201031.995100:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788201031.995137:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003712:0@lo:502: 00000100:00100000:1.0:1788201031.995180:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201031.995979:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624a8733cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201031.996023:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570003712 00000100:00100000:2.0:1788201031.996087:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570003712 00000100:00100000:2.0:1788201031.996136:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788201031.996146:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:7610:x1875064570003712:12345-0@lo:502: 00000100:00100000:2.0:1788201031.996739:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:7610:x1875064570003712:12345-0@lo:502: Request processed in 593us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201031.996758:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788201031.996902:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003712:0@lo:502: 00000040:00080000:0.0:1788201032.002884:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788201032.002915:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788201032.004230:0:7623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201032.004242:0:7623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201032.004245:0:7623:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788201032.004251:0:7623:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624bfded000 00000020:00000080:0.0:1788201032.004254:0:7623:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201032.004503:0:7623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201032.004508:0:7623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201032.004510:0:7623:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788201032.004514:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788201032.004726:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788201032.004753:0:7610:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201032.004808:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9a7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201032.004821:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9a7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201032.004864:0:7610:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788201032.004867:0:7610:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9624bfded000 10000000:01000000:2.0:1788201032.004870:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9624bfded000 10000000:01000000:2.0:1788201032.004874:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201032.004879:0:7610:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9624bfded000 from 1 10000000:01000000:2.0:1788201032.004882:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201032.004920:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201032.004929:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201032.004940:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201032.004963:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003840:0@lo:101: 00000100:00100000:2.0:1788201032.005051:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201032.005101:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624850169c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201032.005214:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570003840 00000100:00100000:3.0:1788201032.005222:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570003840 00000100:00100000:3.0:1788201032.005281:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788201032.005292:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:7610:x1875064570003840:12345-0@lo:101: 00010000:00010000:3.0:1788201032.005306:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201032.005319:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3ca9b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca9ae expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201032.005371:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3ca9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9ae expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201032.005383:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3ca9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9ae expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201032.005391:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962493610e00, rc 0) 00000100:00100000:3.0:1788201032.005438:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:7610:x1875064570003840:12345-0@lo:101: Request processed in 148us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.005445:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788201032.005655:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003840:0@lo:101: 00010000:00010000:2.0:1788201032.005669:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9b5 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201032.005690:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca9b5 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201032.005795:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003968:0@lo:501: 00000100:00100000:2.0:1788201032.005821:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201032.005852:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624850169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201032.005962:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570003968 00000100:00100000:1.0:1788201032.005967:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570003968 00000100:00100000:1.0:1788201032.006002:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788201032.006010:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:7610:x1875064570003968:12345-0@lo:501: 00000100:00100000:1.0:1788201032.006254:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:7610:x1875064570003968:12345-0@lo:501: Request processed in 245us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201032.006466:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788201032.006687:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570003968:0@lo:501: 00000100:00100000:2.0:1788201032.006719:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570004096:0@lo:503: 00000100:00100000:2.0:1788201032.006764:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201032.006792:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624850169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201032.006889:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570004096 00000100:00100000:1.0:1788201032.006894:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570004096 00000100:00100000:1.0:1788201032.006928:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788201032.006935:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:7610:x1875064570004096:12345-0@lo:503: 00000100:00100000:1.0:1788201032.007192:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:7610:x1875064570004096:12345-0@lo:503: Request processed in 257us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201032.007200:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201032.007288:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570004096:0@lo:503: 00000040:00080000:2.0:1788201032.007745:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201032.007830:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570004224:0@lo:502: 00000100:00100000:2.0:1788201032.007873:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201032.007897:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624850169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201032.008021:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570004224 00000100:00100000:1.0:1788201032.008026:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570004224 00000100:00100000:1.0:1788201032.008137:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788201032.008146:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:7610:x1875064570004224:12345-0@lo:502: 00000100:00100000:1.0:1788201032.008508:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:7610:x1875064570004224:12345-0@lo:502: Request processed in 363us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201032.008516:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201032.008692:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570004224:0@lo:502: 00000040:00080000:2.0:1788201032.008987:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788201032.009125:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788201032.009168:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788201032.009218:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788201032.009323:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788201032.009728:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788201032.009769:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788201032.009802:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788201032.009869:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788201032.009904:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788201032.009929:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788201032.009967:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788201032.009994:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788201032.010120:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788201032.010188:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788201032.010237:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788201032.014909:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788201032.015066:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788201032.015103:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788201032.015132:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788201032.015181:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788201032.015219:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788201032.015319:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788201032.015499:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788201032.015538:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788201032.015572:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788201032.015745:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788201032.015793:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788201032.015829:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788201032.015915:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788201032.016248:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788201032.016457:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788201032.016507:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788201032.016559:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788201032.016594:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788201032.017094:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788201032.017137:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788201032.017185:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570004352:0@lo:502: 00000100:00100000:3.0:1788201032.017338:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.017467:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485154780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201032.017842:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570004352 00000100:00100000:1.0:1788201032.017850:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570004352 00000100:00100000:1.0:1788201032.017919:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788201032.017929:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:7610:x1875064570004352:12345-0@lo:502: 00000100:00100000:1.0:1788201032.018186:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:7610:x1875064570004352:12345-0@lo:502: Request processed in 257us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201032.018194:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201032.018655:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570004352:0@lo:502: 00000040:00080000:0.0:1788201032.018760:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788201032.018776:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788201032.020006:0:7624:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788201032.020022:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff962487298000) 00000020:00000080:0.0:1788201032.020110:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788201032.020327:0:7624:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9624bfded000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788201032.020332:0:7624:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9624bfded000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788201032.020335:0:7624:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624bfded000 3 00010000:00080000:0.0:1788201032.020432:0:7624:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962492c04000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.156@tcp at head 00010000:00010000:1.0:1788201032.026582:0:7624:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788201032.026706:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788201032.026748:0:7624:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201032.026766:0:7624:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa81c4c9a2f3ca9c3 00000100:00080000:1.0:1788201032.026780:0:7624:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201032.026786:0:7624:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff962492c04000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201032.026829:0:7624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624ba85ad80 x1875064570004480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201032.026855:0:7624:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788201032.027179:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875064570004480:0@lo:38: 00000100:00100000:0.0:1788201032.027250:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788201032.027493:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1788201032.027630:0:7626:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff962485738000 x1875064570004608/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201032.027651:0:7626:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba849900 going to sleep for 0 seconds 00000100:00100000:3.0:1788201032.027840:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570004864:0@lo:400: 00000100:00100000:3.0:1788201032.027872:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.027892:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201032.027898:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570004736:0@lo:400: 00000100:00100000:3.0:1788201032.027920:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.027944:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570004992:0@lo:400: 00000100:00100000:3.0:1788201032.027995:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.028030:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570004992 00000100:00100000:3.0:1788201032.028036:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570004992 00000100:00100000:3.0:1788201032.028082:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201032.028092:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570004992:12345-0@lo:400: 00000100:00100000:3.0:1788201032.028143:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570004992:12345-0@lo:400: Request processed in 53us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.028149:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788201032.028186:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624ba199f80 x1875064570004992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201032.028199:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570004992:0@lo:400: 00000020:01000000:3.0:1788201032.028224:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:1.0:1788201032.028412:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570004480 00000100:00100000:1.0:1788201032.028417:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570004480 00000100:00100000:1.0:1788201032.028436:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570004864 00000100:00100000:1.0:1788201032.028438:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570004864 00000100:00100000:1.0:1788201032.028455:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570004736 00000100:00100000:1.0:1788201032.028459:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570004736 00000100:00100000:1.0:1788201032.028483:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201032.028492:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570004864:12345-0@lo:400: 00000100:00100000:1.0:1788201032.028541:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570004864:12345-0@lo:400: Request processed in 51us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201032.028547:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201032.028559:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201032.028566:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570004736:12345-0@lo:400: 00000100:00100000:1.0:1788201032.028593:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570004736:12345-0@lo:400: Request processed in 28us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201032.028606:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201032.028618:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201032.028622:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3281:x1875064570004480:12345-0@lo:38: 00010000:00080000:1.0:1788201032.028642:0:5826:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:1.0:1788201032.028672:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa81c4c9a2f3ca9ca 00000004:00100000:1.0:1788201032.028686:0:5826:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201032.028718:0:5826:0:(import.c:65:import_set_state_nolock()) ffff962381a39000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201032.028755:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875064570004480:12345-0@lo:38: Request processed in 131us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201032.028761:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:01000000:3.0:1788201032.028927:0:7610:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201032.028942:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9b5 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201032.028953:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9b5 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788201032.029024:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624ba198e00 x1875064570004736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201032.029199:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201032.029204:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201032.029232:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624ba85ad80 x1875064570004480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201032.029241:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201032.029248:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788201032.029255:0:3281:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788201032.029271:0:3281:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788201032.029274:0:3281:0:(import.c:65:import_set_state_nolock()) ffff962492c04000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788201032.029280:0:3281:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000eeca5af6): req@ffff962485738000 x1875064570004608/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201032.029300:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875064570004480:0@lo:38: 00000100:00100000:3.0:1788201032.029425:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570004736:0@lo:400: 00010000:00080000:3.0:1788201032.029439:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624ba19a680 x1875064570004864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201032.029446:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570004864:0@lo:400: 00000020:01000004:3.0:1788201032.029501:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788201032.029507:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201032.029508:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201032.029509:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201032.029510:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201032.029511:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201032.029513:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201032.029514:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788201032.029515:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788201032.029517:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201032.029518:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201032.029522:0:7610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788201032.029524:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201032.029525:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201032.029526:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201032.029527:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201032.029527:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201032.029528:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201032.029529:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201032.029530:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788201032.029531:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788201032.029532:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201032.029532:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201032.029551:0:7610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788201032.029564:0:7610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570005120:0@lo:253: 00000100:00100000:3.0:1788201032.029605:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201032.029769:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570005120 00000100:00100000:0.0:1788201032.029775:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570005120 00000100:00100000:0.0:1788201032.029805:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788201032.029812:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:7610:x1875064570005120:12345-0@lo:253: 20000000:01000000:0.0:1788201032.029835:0:5818:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788201032.029849:0:5818:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788201032.034192:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201032.034242:0:7626:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba849900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201032.043488:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570004608 00000100:00100000:3.0:1788201032.043503:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570004608 00000100:00100000:3.0:1788201032.043574:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201032.043583:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7626:x1875064570004608:12345-0@lo:901: 00000100:00100000:3.0:1788201032.043996:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7626:x1875064570004608:12345-0@lo:901: Request processed in 413us (9808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.044004:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788201032.044086:0:7626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962485738000 x1875064570004608/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788201048 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201032.044102:0:7626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485738000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7626:1875064570004608:0@lo:901: 00000100:00100000:3.0:1788201032.044240:0:7610:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485952540 going to sleep for 11 seconds 00000100:00080000:0.0:1788201032.044291:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1788201032.075806:0:5818:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788201032.075826:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788201032.075993:0:5841:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201032.075999:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201032.076023:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201032.076054:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca91b expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201032.076063:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201032.076109:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca91b expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201032.076124:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca922 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca91b expref: 14 pid: 5818 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201032.076160:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba858000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570005248:0@lo:104: 00000100:00100000:1.0:1788201032.076231:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201032.076565:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624a8733240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201032.077119:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570005248 00000100:00100000:3.0:1788201032.077128:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570005248 00000100:00100000:3.0:1788201032.077187:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201032.077197:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570005248:12345-0@lo:104: 00010000:00010000:3.0:1788201032.077214:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca922 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201032.077294:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201032.077300:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570005248:12345-0@lo:104: Request processed in 105us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.077307:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788201032.077440:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201032.077447:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca922 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077456:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962493610a00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:0.0:1788201032.077460:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca922 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077496:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca922 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201032.077503:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca922 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201032.077508:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201032.077541:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca922 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077547:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201032.077565:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca922 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077571:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca91b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca922 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077588:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201032.077590:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201032.077592:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201032.077603:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570005376:0@lo:103: 00000100:00100000:0.0:1788201032.077654:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201032.077695:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570005376 00000100:00100000:0.0:1788201032.077698:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570005376 00010000:00010000:0.0:1788201032.077716:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca922 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca91b expref: 15 pid: 5818 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201032.077733:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201032.077739:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485696850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:3285:x1875064570005376:12345-0@lo:103: 00010000:00010000:0.0:1788201032.077754:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201032.077759:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca922 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca91b expref: 15 pid: 5818 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077769:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca922 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca91b expref: 15 pid: 5818 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077786:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077794:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201032.077807:0:5812:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008489459s 00010000:00010000:0.0:1788201032.077811:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077817:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077824:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077830:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077836:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624c21f0600 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:0.0:1788201032.077840:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077846:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077860:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201032.077868:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201032.077894:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485696850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:3285:x1875064570005376:12345-0@lo:103: Request processed in 155us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201032.077900:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201032.077954:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570005376:0@lo:103: 00010000:00010000:2.0:1788201032.078159:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca922 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca91b expref: 14 pid: 5818 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201032.078170:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba858000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570005248:0@lo:104: 00010000:00010000:2.0:1788201032.078194:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201032.078202:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201032.078207:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201032.078213:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f0600/0xa81c4c9a2f3ca9d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201032.085861:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:7610:x1875064570005120:12345-0@lo:253: Request processed in 56038us (56244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201032.085878:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788201032.086010:0:7610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:7610:1875064570005120:0@lo:253: 10000000:01000000:3.0:1788201032.086027:0:7610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788201032.086042:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201032.086044:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201032.086045:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201032.086047:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201032.086048:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201032.086049:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201032.086051:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201032.086053:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788201032.086055:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788201032.086056:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201032.086058:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788201032.086073:0:7610:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788201032.101713:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201032.102080:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201032.102325:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201032.102555:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201032.102766:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201032.102994:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788201032.106206:0:7610:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788201032.323922:0:7610:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788201032.323930:0:7610:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788201032.323970:0:7610:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788201032.324045:0:7610:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788201032.324077:0:7610:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788201032.324106:0:7610:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788201032.450792:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201033.465841:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201034.490155:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201035.319863:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201035.319890:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570005504:0@lo:13: 00000100:00100000:1.0:1788201035.319967:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201035.320155:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570005504 00000100:00100000:2.0:1788201035.320163:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570005504 00000100:00100000:2.0:1788201035.320230:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201035.320240:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570005504:12345-0@lo:13: 00002000:00000024:2.0:1788201035.320295:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201035.320357:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570005504:12345-0@lo:13: Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201035.320364:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788201035.320587:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788201035.320619:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba858000 x1875064570005504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201035.320635:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570005504:0@lo:13: 00010000:00010000:1.0:1788201035.515399:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201036.534749:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201037.377574:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570005632:0@lo:400: 00000100:00100000:2.0:1788201037.377644:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201037.377696:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570006144:0@lo:400: 00000100:00100000:2.0:1788201037.377792:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201037.377815:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201037.377820:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570006016:0@lo:400: 00000100:00100000:2.0:1788201037.377844:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201037.377875:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570005632 00000100:00100000:2.0:1788201037.377882:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570005632 00000100:00100000:2.0:1788201037.377924:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788201037.377933:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:3283:x1875064570005632:12345-0@lo:400: 00000100:00100000:2.0:1788201037.377979:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:3283:x1875064570005632:12345-0@lo:400: Request processed in 47us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201037.377985:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788201037.378014:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570006144 00000100:00100000:2.0:1788201037.378017:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570006144 00000100:00100000:2.0:1788201037.378046:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201037.378052:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570006144:12345-0@lo:400: 00000100:00100000:2.0:1788201037.378158:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570006144:12345-0@lo:400: Request processed in 105us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201037.378164:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788201037.378181:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201037.378207:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570005632:0@lo:400: 00010000:00080000:2.0:1788201037.378221:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517dc00 x1875064570006144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201037.378233:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570006144:0@lo:400: 00000100:00100000:1.0:1788201037.378700:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570006016 00000100:00100000:1.0:1788201037.378769:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570006016 00000100:00100000:1.0:1788201037.378804:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201037.378812:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570006016:12345-0@lo:400: 00000100:00100000:1.0:1788201037.378857:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570006016:12345-0@lo:400: Request processed in 46us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201037.378863:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201037.378884:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570005888:0@lo:400: 00000100:00100000:1.0:1788201037.378915:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201037.378937:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201037.378943:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570005760:0@lo:400: 00000100:00100000:1.0:1788201037.378976:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201037.379007:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570005888 00000100:00100000:1.0:1788201037.379011:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570005888 00000100:00100000:1.0:1788201037.379034:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570005760 00000100:00100000:1.0:1788201037.379038:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570005760 00000100:00100000:1.0:1788201037.379051:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201037.379058:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570005888:12345-0@lo:400: 00000100:00100000:1.0:1788201037.379174:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570005888:12345-0@lo:400: Request processed in 116us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201037.379180:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201037.379192:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201037.379198:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570005760:12345-0@lo:400: 00000100:00100000:1.0:1788201037.379223:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570005760:12345-0@lo:400: Request processed in 25us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201037.379228:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788201037.379261:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517d180 x1875064570005760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201037.379272:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570005760:0@lo:400: 00010000:00080000:1.0:1788201037.379280:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517ca80 x1875064570005888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201037.379287:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570005888:0@lo:400: 00000100:00080000:2.0:1788201037.380321:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201037.380327:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201037.380609:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517f100 x1875064570006016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201037.380635:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570006016:0@lo:400: 00010000:00010000:3.0:1788201037.558638:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201038.582507:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201038.949729:0:7968:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788201039.606511:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201040.439628:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570006272:0@lo:13: 00000100:00100000:0.0:1788201040.439700:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201040.439884:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570006272 00000100:00100000:1.0:1788201040.439892:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570006272 00000100:00100000:1.0:1788201040.439955:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201040.439966:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570006272:12345-0@lo:13: 00002000:00000024:1.0:1788201040.440000:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201040.440058:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570006272:12345-0@lo:13: Request processed in 93us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201040.440065:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788201040.440158:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba859180 x1875064570006272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201040.440176:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570006272:0@lo:13: 00000100:00080000:2.0:1788201040.440642:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201040.635971:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201041.656277:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788201041.974698:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201041.974708:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9624902d7800 from 30 10000000:01000000:3.0:1788201041.974714:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201041.974765:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201041.974777:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201041.975212:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201041.975241:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570006400:0@lo:101: 00000100:00100000:3.0:1788201041.975321:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201041.976460:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487c74900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201041.986720:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570006400 00000100:00100000:2.0:1788201041.986735:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570006400 00000100:00100000:2.0:1788201041.988195:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788201041.988212:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:5822:x1875064570006400:12345-0@lo:101: 00010000:00010000:2.0:1788201041.988230:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201041.988248:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624829c5000/0xa81c4c9a2f3ca9df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca9d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201041.988276:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624829c5000/0xa81c4c9a2f3ca9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9d8 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201041.988287:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624829c5000/0xa81c4c9a2f3ca9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9d8 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201041.988297:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5000, rc 0) 00000100:00100000:2.0:1788201041.990845:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064570006400:12345-0@lo:101: Request processed in 2628us (15512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201041.990858:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788201041.992547:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570006400:0@lo:101: 00010000:00010000:3.0:1788201041.992578:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201041.992592:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca9df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201041.992674:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570006528:0@lo:501: 00000100:00100000:3.0:1788201041.992738:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201041.992947:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487c74900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201041.993031:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570006528 00000100:00100000:2.0:1788201041.993038:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570006528 00000100:00100000:2.0:1788201041.993094:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201041.993103:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064570006528:12345-0@lo:501: 00000100:00100000:2.0:1788201041.993493:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064570006528:12345-0@lo:501: Request processed in 390us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201041.993869:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788201041.994674:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570006528:0@lo:501: 00000100:00100000:3.0:1788201041.994722:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570006656:0@lo:503: 00000100:00100000:3.0:1788201041.994776:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201041.994822:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487c74900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201041.994854:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570006656 00000100:00100000:3.0:1788201041.994861:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570006656 00000100:00100000:3.0:1788201041.994906:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788201041.994915:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064570006656:12345-0@lo:503: 00000100:00100000:3.0:1788201041.995877:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064570006656:12345-0@lo:503: Request processed in 959us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201041.995887:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788201041.995947:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570006656:0@lo:503: 00000100:00100000:1.0:1788201042.013111:0:8076:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8076:1875064570006784:0@lo:502: 00000100:00100000:1.0:1788201042.013207:0:8076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201042.013257:0:8076:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201042.013542:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570006784 00000100:00100000:3.0:1788201042.013551:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570006784 00000100:00100000:3.0:1788201042.013601:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788201042.013612:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:8076:x1875064570006784:12345-0@lo:502: 00000100:00100000:3.0:1788201042.013939:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:8076:x1875064570006784:12345-0@lo:502: Request processed in 329us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.013947:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788201042.014529:0:8076:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8076:1875064570006784:0@lo:502: 00000100:00100000:1.0:1788201042.014582:0:8076:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8076:1875064570006912:0@lo:502: 00000100:00100000:1.0:1788201042.014621:0:8076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201042.014652:0:8076:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201042.015539:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570006912 00000100:00100000:3.0:1788201042.015549:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570006912 00000100:00100000:3.0:1788201042.015588:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788201042.015596:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:8076:x1875064570006912:12345-0@lo:502: 00000100:00100000:3.0:1788201042.015834:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:8076:x1875064570006912:12345-0@lo:502: Request processed in 238us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.015841:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788201042.016632:0:8076:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8076:1875064570006912:0@lo:502: 00000040:00080000:1.0:1788201042.016667:0:8076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788201042.016870:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788201042.016887:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201042.016896:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201042.016906:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201042.016928:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788201042.016930:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788201042.016933:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201042.016961:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201042.016969:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201042.016978:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201042.016995:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570007040:0@lo:101: 00000100:00100000:0.0:1788201042.017038:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201042.017078:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487f4d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201042.017893:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570007040 00000100:00100000:1.0:1788201042.017901:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570007040 00000100:00100000:1.0:1788201042.017951:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788201042.017961:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064570007040:12345-0@lo:101: 00010000:00010000:1.0:1788201042.017974:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201042.017989:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca9ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca9e6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201042.018012:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9e6 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201042.018022:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9e6 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201042.018030:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f1000, rc 0) 00000100:00100000:1.0:1788201042.018103:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064570007040:12345-0@lo:101: Request processed in 143us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201042.018109:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788201042.018361:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570007040:0@lo:101: 00010000:00010000:0.0:1788201042.018385:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201042.018394:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca9ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201042.018461:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570007168:0@lo:501: 00000100:00100000:0.0:1788201042.018494:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201042.018525:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487f4d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201042.018544:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570007168 00000100:00100000:0.0:1788201042.018548:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570007168 00000100:00100000:0.0:1788201042.018572:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788201042.018588:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064570007168:12345-0@lo:501: 00000100:00100000:0.0:1788201042.019740:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064570007168:12345-0@lo:501: Request processed in 1147us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201042.019750:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788201042.024897:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570007168:0@lo:501: 00000100:00100000:2.0:1788201042.024989:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570007296:0@lo:503: 00000100:00100000:2.0:1788201042.025062:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.025106:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962493656c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201042.025163:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570007296 00000100:00100000:1.0:1788201042.025169:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570007296 00000100:00100000:1.0:1788201042.025245:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788201042.025254:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064570007296:12345-0@lo:503: 00000100:00100000:1.0:1788201042.025646:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064570007296:12345-0@lo:503: Request processed in 392us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201042.025654:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788201042.025742:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570007296:0@lo:503: 00000100:00100000:0.0:1788201042.030148:0:8078:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8078:1875064570007424:0@lo:502: 00000100:00100000:0.0:1788201042.030232:0:8078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201042.030278:0:8078:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487f4dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201042.030473:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570007424 00000100:00100000:3.0:1788201042.030480:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570007424 00000100:00100000:3.0:1788201042.030529:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788201042.030538:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:8078:x1875064570007424:12345-0@lo:502: 00000100:00100000:3.0:1788201042.030801:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:8078:x1875064570007424:12345-0@lo:502: Request processed in 263us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.030809:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201042.030903:0:8078:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8078:1875064570007424:0@lo:502: 00000020:01000000:0.0:1788201042.030930:0:8078:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201042.030940:0:8078:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201042.030942:0:8078:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201042.030946:0:8078:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201042.030948:0:8078:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788201042.030963:0:8078:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8078:1875064570007552:0@lo:502: 00000100:00100000:0.0:1788201042.030993:0:8078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201042.031021:0:8078:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487f4dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201042.031065:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570007552 00000100:00100000:3.0:1788201042.031069:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570007552 00000100:00100000:3.0:1788201042.031106:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201042.031113:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:8078:x1875064570007552:12345-0@lo:502: 00000100:00100000:3.0:1788201042.031219:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:8078:x1875064570007552:12345-0@lo:502: Request processed in 107us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.031226:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788201042.031391:0:8078:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8078:1875064570007552:0@lo:502: 00000020:01000000:0.0:1788201042.031408:0:8078:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201042.031412:0:8078:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201042.031414:0:8078:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788201042.031417:0:8078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788201042.031643:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788201042.031664:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788201042.031675:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201042.031686:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201042.031697:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201042.031700:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9624902af800 from 30 10000000:01000000:3.0:1788201042.031703:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201042.031731:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201042.031738:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201042.031755:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201042.031769:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570007680:0@lo:101: 00000100:00100000:3.0:1788201042.031800:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201042.031824:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962490282780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201042.031872:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570007680 00000100:00100000:0.0:1788201042.031876:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570007680 00000100:00100000:0.0:1788201042.031908:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788201042.031915:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064570007680:12345-0@lo:101: 00010000:00010000:0.0:1788201042.031923:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201042.031941:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962480031800/0xa81c4c9a2f3ca9fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3ca9f4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201042.031963:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962480031800/0xa81c4c9a2f3ca9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9f4 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201042.031972:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962480031800/0xa81c4c9a2f3ca9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9f4 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201042.031982:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962480031800, rc 0) 00000100:00100000:0.0:1788201042.032012:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570007680:12345-0@lo:101: Request processed in 98us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201042.032017:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788201042.032192:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570007680:0@lo:101: 00010000:00010000:3.0:1788201042.032205:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201042.032213:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3ca9fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201042.032253:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570007808:0@lo:501: 00000100:00100000:3.0:1788201042.032279:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201042.032311:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962490282780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201042.032392:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570007808 00000100:00100000:0.0:1788201042.032397:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570007808 00000100:00100000:0.0:1788201042.032422:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788201042.032429:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570007808:12345-0@lo:501: 00000100:00100000:0.0:1788201042.032651:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570007808:12345-0@lo:501: Request processed in 222us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201042.032658:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201042.032840:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570007808:0@lo:501: 00000100:00100000:3.0:1788201042.032867:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570007936:0@lo:503: 00000100:00100000:3.0:1788201042.032903:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201042.032925:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962490282780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201042.032967:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570007936 00000100:00100000:0.0:1788201042.032971:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570007936 00000100:00100000:0.0:1788201042.033028:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788201042.033035:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570007936:12345-0@lo:503: 00000100:00100000:0.0:1788201042.033184:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570007936:12345-0@lo:503: Request processed in 148us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201042.033191:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201042.033250:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570007936:0@lo:503: 00000100:00100000:0.0:1788201042.041793:0:8079:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8079:1875064570008064:0@lo:502: 00000100:00100000:0.0:1788201042.041890:0:8079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201042.041944:0:8079:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c80c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201042.042642:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570008064 00000100:00100000:3.0:1788201042.042652:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570008064 00000100:00100000:3.0:1788201042.042704:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788201042.042714:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:8079:x1875064570008064:12345-0@lo:502: 00000100:00100000:3.0:1788201042.044515:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:8079:x1875064570008064:12345-0@lo:502: Request processed in 1794us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.044537:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788201042.047555:0:8079:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8079:1875064570008064:0@lo:502: 00000100:00100000:0.0:1788201042.050952:0:8079:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8079:1875064570008192:0@lo:502: 00000100:00100000:0.0:1788201042.051045:0:8079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201042.051201:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570008192 00000100:00100000:3.0:1788201042.051209:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570008192 00000100:00100000:0.0:1788201042.051253:0:8079:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c80780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201042.051505:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201042.051516:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:8079:x1875064570008192:12345-0@lo:502: 00000100:00100000:3.0:1788201042.051828:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:8079:x1875064570008192:12345-0@lo:502: Request processed in 314us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.051836:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788201042.056917:0:8079:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8079:1875064570008192:0@lo:502: 00000040:00080000:2.0:1788201042.056977:0:8079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788201042.058169:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788201042.058266:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201042.058279:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201042.058293:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3ca9fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201042.058312:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201042.058315:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9624902af800 from 5 10000000:01000000:1.0:1788201042.058318:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201042.058443:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201042.058452:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201042.058471:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201042.058558:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570008320:0@lo:101: 00000100:00100000:1.0:1788201042.058621:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201042.058728:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201042.063544:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570008320 00000100:00100000:3.0:1788201042.063559:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570008320 00000100:00100000:3.0:1788201042.063617:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201042.063626:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570008320:12345-0@lo:101: 00010000:00010000:3.0:1788201042.063645:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201042.063665:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962493610800/0xa81c4c9a2f3caa09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3caa02 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201042.063692:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962493610800/0xa81c4c9a2f3caa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caa02 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201042.063703:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962493610800/0xa81c4c9a2f3caa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caa02 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201042.063712:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962493610800, rc 0) 00000100:00100000:3.0:1788201042.064018:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570008320:12345-0@lo:101: Request processed in 392us (5395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.064026:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788201042.067597:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba859880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570008320:0@lo:101: 00010000:00010000:2.0:1788201042.067628:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caa09 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201042.067640:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3caa09 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201042.067717:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570008448:0@lo:256: 00000100:00100000:2.0:1788201042.067785:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.067820:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962493656600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201042.068259:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570008448 00000100:00100000:3.0:1788201042.068267:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570008448 00000100:00100000:3.0:1788201042.068365:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201042.068558:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570008448:12345-0@lo:256: 20000000:01000000:3.0:1788201042.068583:0:5820:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201042.068601:0:5820:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201042.068604:0:5820:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788201042.068700:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570008448:12345-0@lo:256: Request processed in 326us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.068708:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788201042.069308:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570008448:0@lo:256: 10000000:01000000:2.0:1788201042.069479:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201042.069490:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caa09 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201042.069771:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caa09 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201042.069797:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788201042.069801:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788201042.069804:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201042.069843:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201042.069856:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201042.069865:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201042.069881:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570008576:0@lo:101: 00000100:00100000:2.0:1788201042.069925:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.069952:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962493656600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201042.070018:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570008576 00000100:00100000:3.0:1788201042.070024:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570008576 00000100:00100000:3.0:1788201042.070066:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788201042.070074:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570008576:12345-0@lo:101: 00010000:00010000:3.0:1788201042.070161:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201042.070176:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962493610400/0xa81c4c9a2f3caa17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3caa10 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201042.071325:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962493610400/0xa81c4c9a2f3caa17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caa10 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201042.071469:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962493610400/0xa81c4c9a2f3caa17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caa10 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201042.071479:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962493610400, rc 0) 00000100:00100000:3.0:1788201042.071644:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570008576:12345-0@lo:101: Request processed in 1569us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.071651:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788201042.071790:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570008576:0@lo:101: 00010000:00010000:2.0:1788201042.071809:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caa17 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201042.071818:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3caa17 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201042.071891:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570008704:0@lo:501: 00000100:00100000:2.0:1788201042.071924:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.071952:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962493656600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201042.072074:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570008704 00000100:00100000:3.0:1788201042.072080:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570008704 00000100:00100000:3.0:1788201042.072131:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788201042.072150:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570008704:12345-0@lo:501: 00000100:00100000:3.0:1788201042.072891:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570008704:12345-0@lo:501: Request processed in 739us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.072899:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201042.073063:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570008704:0@lo:501: 00000100:00100000:2.0:1788201042.073116:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570008832:0@lo:503: 00000100:00100000:2.0:1788201042.073159:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.073181:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962493656600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201042.076213:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570008832 00000100:00100000:3.0:1788201042.076229:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570008832 00000100:00100000:3.0:1788201042.076296:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201042.076316:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570008832:12345-0@lo:503: 00000100:00100000:3.0:1788201042.077388:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570008832:12345-0@lo:503: Request processed in 1059us (4213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.077399:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788201042.079044:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570008832:0@lo:503: 00000100:00100000:3.0:1788201042.086282:0:8082:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8082:1875064570008960:0@lo:502: 00000100:00100000:3.0:1788201042.086607:0:8082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201042.086665:0:8082:0:(client.c:2702:ptlrpc_set_wait()) set ffff962491ea9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201042.086735:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570008960 00000100:00100000:2.0:1788201042.086750:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570008960 00000100:00100000:2.0:1788201042.086803:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788201042.086813:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:8082:x1875064570008960:12345-0@lo:502: 00000100:00100000:2.0:1788201042.087214:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:8082:x1875064570008960:12345-0@lo:502: Request processed in 401us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201042.087223:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788201042.087568:0:8082:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8082:1875064570008960:0@lo:502: 00000020:01000000:3.0:1788201042.087601:0:8082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201042.087610:0:8082:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788201042.087616:0:8082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201042.087618:0:8082:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788201042.087622:0:8082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201042.087626:0:8082:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.156@tcp to nid 0x20000c0a8c99c (192.168.201.156@tcp) 00000020:01000000:3.0:1788201042.087649:0:8082:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788201042.087651:0:8082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201042.087666:0:8082:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9624909dcd40) 00000020:00000080:3.0:1788201042.087688:0:8082:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788201042.087691:0:8082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201042.087765:0:8082:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788201042.087771:0:8082:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788201042.087787:0:8082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa81c4c9a2f3caa25 00010000:00080000:3.0:1788201042.087822:0:8082:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9624bfdea800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.156@tcp at head 00010000:00010000:3.0:1788201042.088053:0:8082:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788201042.088651:0:8082:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788201042.088665:0:8082:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788201042.089588:0:8082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201042.089840:0:8082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201042.089894:0:8082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788201042.089956:0:8082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788201042.106602:0:8084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788201042.106613:0:8084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788201042.111840:0:8082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201042.111856:0:8082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201042.111895:0:8082:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788201042.111932:0:8082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa81c4c9a2f3caa2c 00000100:00080000:3.0:1788201042.111944:0:8082:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201042.111949:0:8082:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9624bfdea800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1788201042.111986:0:8082:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96248c842680 x1875064570009088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201042.112019:0:8082:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788201042.112065:0:8082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201042.112071:0:8082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201042.112073:0:8082:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788201042.112076:0:8082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201042.112152:0:8082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201042.112155:0:8082:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201042.112161:0:8082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201042.112163:0:8082:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788201042.112622:0:8082:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8082:1875064570009216:0@lo:502: 00000100:00100000:3.0:1788201042.112710:0:8082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201042.112759:0:8082:0:(client.c:2702:ptlrpc_set_wait()) set ffff962491ea9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201042.112832:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570009088:0@lo:8: 00000100:00100000:2.0:1788201042.112876:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.113040:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570009344:0@lo:400: 00000100:00100000:2.0:1788201042.113068:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201042.113179:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570009216 00000100:00100000:0.0:1788201042.113187:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570009216 00000100:00100000:0.0:1788201042.113232:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788201042.113242:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:8082:x1875064570009216:12345-0@lo:502: 00000100:00100000:0.0:1788201042.113539:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:8082:x1875064570009216:12345-0@lo:502: Request processed in 298us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201042.113547:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201042.113641:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570009088 00000100:00100000:3.0:1788201042.113651:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570009088 00000100:00100000:3.0:1788201042.113679:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201042.113684:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875064570009088:12345-0@lo:8: 00010000:00080000:3.0:1788201042.113707:0:6668:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1788201042.113732:0:6668:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa81c4c9a2f3caa33 00002000:00100000:3.0:1788201042.113744:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96248cec7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788201042.113748:0:6668:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788201042.113751:0:6668:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788201042.113868:0:6668:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788201042.114026:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201042.114051:0:6668:0:(import.c:65:import_set_state_nolock()) ffff96248cec0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201042.114224:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570009472:0@lo:400: 00000100:00100000:2.0:1788201042.114255:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.114320:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570009600:0@lo:400: 00000100:00100000:2.0:1788201042.114365:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.114396:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788201042.114404:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788201042.114528:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570009728:0@lo:400: 00000100:00100000:2.0:1788201042.114558:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201042.115232:0:6671:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201042.115244:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570009600 00000100:00100000:0.0:1788201042.115250:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570009600 00000100:00100000:0.0:1788201042.115310:0:6671:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201042.115321:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788201042.115330:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570009600:12345-0@lo:400: 00000100:00100000:0.0:1788201042.115402:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570009600:12345-0@lo:400: Request processed in 74us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201042.115410:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201042.116227:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1875064570009088:12345-0@lo:8: Request processed in 2535us (3344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.116237:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201042.116311:0:8082:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8082:1875064570009216:0@lo:502: 00000020:01000000:3.0:1788201042.116386:0:8082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201042.116397:0:8082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201042.116401:0:8082:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788201042.116406:0:8082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00080000:2.0:1788201042.116626:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201042.116657:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517fb80 x1875064570009600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201042.116670:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570009600:0@lo:400: 00000020:01000000:2.0:1788201042.116716:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788201042.116735:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788201042.116745:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caa17 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201042.116773:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caa17 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201042.116783:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788201042.116786:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff962485b40000 from 1 10000000:01000000:2.0:1788201042.116789:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788201042.116820:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201042.116828:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201042.116837:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201042.116855:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570009856:0@lo:101: 00000100:00100000:2.0:1788201042.116903:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.116934:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962493656e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201042.116956:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570009856 00000100:00100000:2.0:1788201042.116961:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570009856 00000100:00100000:2.0:1788201042.116995:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788201042.117001:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570009856:12345-0@lo:101: 00010000:00010000:2.0:1788201042.117013:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201042.117025:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624829c4c00/0xa81c4c9a2f3caa41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3caa3a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201042.117048:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624829c4c00/0xa81c4c9a2f3caa41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caa3a expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201042.117070:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624829c4c00/0xa81c4c9a2f3caa41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caa3a expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201042.117079:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c4c00, rc 0) 00000100:00100000:2.0:1788201042.117127:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570009856:12345-0@lo:101: Request processed in 126us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201042.117132:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788201042.117167:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570009856:0@lo:101: 00010000:00010000:2.0:1788201042.117180:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caa41 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201042.117189:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3caa41 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201042.117227:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570009984:0@lo:501: 00000100:00100000:2.0:1788201042.117250:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.117264:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962493656e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201042.117277:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570009984 00000100:00100000:2.0:1788201042.117280:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570009984 00000100:00100000:2.0:1788201042.117315:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788201042.117323:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570009984:12345-0@lo:501: 00000100:00100000:2.0:1788201042.117600:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570009984:12345-0@lo:501: Request processed in 277us (347us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201042.117607:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788201042.117639:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570009984:0@lo:501: 10000000:01000000:2.0:1788201042.117657:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788201042.117669:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caa41 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201042.117677:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caa41 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788201042.117777:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c842680 x1875064570009088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201042.117787:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201042.117794:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788201042.117808:0:3281:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788201042.117814:0:3281:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788201042.117818:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9624bfdea800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788201042.117839:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788201042.117845:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570009088:0@lo:8: 00000004:00080000:0.0:1788201042.117870:0:8084:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788201042.117996:0:8084:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 174190653785ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788201042.118766:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570009344 00000100:00100000:1.0:1788201042.118775:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570009344 00000100:00100000:1.0:1788201042.118815:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570009472 00000100:00100000:1.0:1788201042.118819:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570009472 00000100:00100000:1.0:1788201042.118842:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570009728 00000100:00100000:1.0:1788201042.118845:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570009728 00000100:00100000:1.0:1788201042.118861:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201042.118868:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570009344:12345-0@lo:400: 00000100:00100000:1.0:1788201042.118934:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570009344:12345-0@lo:400: Request processed in 66us (5864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201042.118940:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201042.118954:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201042.118960:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570009472:12345-0@lo:400: 00000100:00100000:1.0:1788201042.118991:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570009472:12345-0@lo:400: Request processed in 33us (4737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201042.118997:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201042.119007:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201042.119013:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570009728:12345-0@lo:400: 00000100:00100000:1.0:1788201042.119053:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570009728:12345-0@lo:400: Request processed in 40us (4493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201042.119071:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788201042.120780:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517d880 x1875064570009344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201042.120799:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570009344:0@lo:400: 00010000:00080000:1.0:1788201042.120844:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517df80 x1875064570009472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201042.120855:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570009472:0@lo:400: 00010000:00080000:1.0:1788201042.120882:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517f800 x1875064570009728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201042.120891:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570009728:0@lo:400: 00000100:00080000:1.0:1788201042.120906:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788201042.222621:0:5847:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788201042.284241:0:8086:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788201042.284274:0:8086:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c841c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1875064570010240:0@lo:7: 00000100:00100000:3.0:1788201042.284381:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201042.284430:0:8086:0:(client.c:2702:ptlrpc_set_wait()) set ffff962492916240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201042.284450:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570010240 00000100:00100000:3.0:1788201042.284458:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570010240 00000100:00100000:3.0:1788201042.284513:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201042.284521:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8086:x1875064570010240:12345-0@lo:7: 00000100:00100000:1.0:1788201042.287496:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570010112:0@lo:13: 00000100:00100000:1.0:1788201042.287571:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201042.287636:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201042.287651:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570010112 00000100:00100000:1.0:1788201042.287658:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570010112 00000100:00100000:1.0:1788201042.287706:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201042.287715:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875064570010112:12345-0@lo:13: 00002000:00000024:1.0:1788201042.287745:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788201042.287805:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875064570010112:12345-0@lo:13: Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201042.287812:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788201042.287868:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c842d80 x1875064570010112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201042.287899:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570010112:0@lo:13: 00002000:00080000:3.0:1788201042.291600:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788201042.291608:0:6671:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788201042.291734:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8086:x1875064570010240:12345-0@lo:7: Request processed in 7210us (7349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.291745:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788201042.294921:0:8086:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c841c00 x1875064570010240/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201058 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201042.294942:0:8086:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c841c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1875064570010240:0@lo:7: 00000004:00080000:2.0:1788201042.294957:0:8086:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788201042.295063:0:8086:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c840a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1875064570010368:0@lo:5: 00000100:00100000:3.0:1788201042.295188:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201042.295267:0:8086:0:(client.c:2702:ptlrpc_set_wait()) set ffff962492916840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201042.298547:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570010368 00000100:00100000:2.0:1788201042.298561:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570010368 00000100:00100000:2.0:1788201042.299434:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201042.299448:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8086:x1875064570010368:12345-0@lo:5: 00002000:00080000:2.0:1788201042.299484:0:6670:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788201042.299488:0:6670:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788201042.299950:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8086:x1875064570010368:12345-0@lo:5: Request processed in 505us (4759us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788201042.299958:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788201042.301283:0:8086:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c840a80 x1875064570010368/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201058 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201042.301318:0:8086:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c840a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1875064570010368:0@lo:5: 00000004:00080000:2.0:1788201042.301335:0:8086:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788201042.301570:0:8086:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1875064570010496:0@lo:700: 00000100:00100000:2.0:1788201042.301621:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.301666:0:8086:0:(client.c:2702:ptlrpc_set_wait()) set ffff962493656300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201042.301718:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570010496 00000100:00100000:0.0:1788201042.301724:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570010496 00000100:00100000:0.0:1788201042.301772:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201042.301790:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8086:x1875064570010496:12345-0@lo:700: 00000100:00100000:0.0:1788201042.301826:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6677:1875064570010624:0@lo:700: 00000100:00100000:0.0:1788201042.301855:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201042.301870:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c80780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201042.301980:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570010624 00000100:00100000:2.0:1788201042.301985:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570010624 00000100:00100000:2.0:1788201042.302019:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201042.302027:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6677:x1875064570010624:12345-0@lo:700: 40000000:02000000:0.0:1788201042.366384:0:5832:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788201042.373112:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6677:x1875064570010624:12345-0@lo:700: Request processed in 71076us (71245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201042.373128:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788201042.373268:0:6677:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248573a680 x1875064570010624/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788201058 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201042.373283:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6677:1875064570010624:0@lo:700: 40000000:02000000:0.0:1788201042.373309:0:6677:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1788201042.459254:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788201042.459273:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788201042.459532:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8086:x1875064570010496:12345-0@lo:700: Request processed in 157739us (157905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201042.459545:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788201042.459630:0:8086:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517fb80 x1875064570010496/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788201058 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201042.459641:0:8086:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788201042.459656:0:8086:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1875064570010496:0@lo:700: 00000004:02000040:2.0:1788201042.484646:0:8086:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788201042.488602:0:8086:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1875064570010752:0@lo:5: 00000100:00100000:2.0:1788201042.488669:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.488776:0:8086:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba849d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201042.488920:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570010752 00000100:00100000:0.0:1788201042.488929:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570010752 00000100:00100000:0.0:1788201042.489017:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201042.489027:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8086:x1875064570010752:12345-0@lo:5: 00002000:00080000:2.0:1788201042.498585:0:6668:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788201042.498606:0:6668:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788201042.502086:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8086:x1875064570010752:12345-0@lo:5: Request processed in 13043us (13398us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788201042.502101:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788201042.502237:0:8086:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517fb80 x1875064570010752/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788201058 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201042.502255:0:8086:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8086:1875064570010752:0@lo:5: 00000004:00080000:2.0:1788201042.502269:0:8086:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788201042.678970:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201043.702443:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788201044.353728:0:7629:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788201044.734747:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201045.560454:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201045.560482:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570010880:0@lo:13: 00000100:00100000:3.0:1788201045.560555:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201045.560677:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570010880 00000100:00100000:1.0:1788201045.560684:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570010880 00000100:00100000:1.0:1788201045.560751:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201045.560761:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570010880:12345-0@lo:13: 00002000:00000024:1.0:1788201045.560796:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201045.560845:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570010880:12345-0@lo:13: Request processed in 86us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201045.560852:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788201045.560888:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba85a300 x1875064570010880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201045.560907:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570010880:0@lo:13: 00000100:00080000:3.0:1788201045.561137:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201045.750573:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201045.949434:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201045.949569:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559501696 00000100:00100000:2.0:1788201045.949579:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559501696 00000100:00100000:2.0:1788201045.949628:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 112 00000100:00100000:2.0:1788201045.949652:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2340:x1875064559501696:12345-192.168.201.56@tcp:250: 00010000:00080000:2.0:1788201045.949682:0:5819:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 274e2ee8-531e-4f2c-b7b0-1bae27cf6659@192.168.201.56@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:2.0:1788201045.949723:0:5819:0:(genops.c:1406:class_connect()) connect: client 274e2ee8-531e-4f2c-b7b0-1bae27cf6659, cookie 0xa81c4c9a2f3caa48 00000100:00080000:2.0:1788201045.949867:0:5819:0:(import.c:65:import_set_state_nolock()) ffff9624b9a30000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201045.949937:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+5:2340:x1875064559501696:12345-192.168.201.56@tcp:250: Request processed in 286us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201045.949945:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 112 00000100:00100000:3.0:1788201045.954103:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201045.954181:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559501568 00000100:00100000:2.0:1788201045.954192:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559501568 00000100:00100000:2.0:1788201045.954251:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 113 00000100:00100000:2.0:1788201045.954260:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+5:5569:x1875064559501568:12345-192.168.201.56@tcp:101: 00010000:00010000:2.0:1788201045.954288:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201045.954306:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624829c4600/0xa81c4c9a2f3caa4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd997df expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.954335:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624829c4600/0xa81c4c9a2f3caa4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd997df expref: 6 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.954386:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624829c4600/0xa81c4c9a2f3caa4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd997df expref: 6 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.954395:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c4600, rc 0) 00000100:00100000:2.0:1788201045.954453:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+6:5569:x1875064559501568:12345-192.168.201.56@tcp:101: Request processed in 195us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201045.954602:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 113 00000100:00100000:1.0:1788201045.988489:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201045.988640:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559501824 00000100:00100000:0.0:1788201045.988656:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559501824 00000100:00100000:0.0:1788201045.988737:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:0.0:1788201045.988748:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+6:5569:x1875064559501824:12345-192.168.201.56@tcp:501: 00000100:00100000:0.0:1788201045.989192:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+6:5569:x1875064559501824:12345-192.168.201.56@tcp:501: Request processed in 444us (711us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201045.989199:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:1.0:1788201046.004845:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201046.004961:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559501952 00000100:00100000:0.0:1788201046.004973:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559501952 00000100:00100000:0.0:1788201046.005102:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 115 00000100:00100000:0.0:1788201046.005114:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+6:5569:x1875064559501952:12345-192.168.201.56@tcp:101: 00010000:00010000:0.0:1788201046.005133:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201046.005153:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962480030800/0xa81c4c9a2f3caa56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd997e6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201046.005183:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962480030800/0xa81c4c9a2f3caa56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd997e6 expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201046.005195:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962480030800/0xa81c4c9a2f3caa56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd997e6 expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201046.005204:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962480030800, rc 0) 00000100:00100000:1.0:1788201046.012850:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+7:5569:x1875064559501952:12345-192.168.201.56@tcp:101: Request processed in 7721us (8003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201046.012864:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 115 00000100:00100000:3.0:1788201046.022954:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201046.023106:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559502080 00000100:00100000:2.0:1788201046.023116:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559502080 00000100:00100000:2.0:1788201046.023193:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 116 00000100:00100000:2.0:1788201046.023204:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+7:5569:x1875064559502080:12345-192.168.201.56@tcp:501: 00000100:00100000:2.0:1788201046.023537:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+8:5569:x1875064559502080:12345-192.168.201.56@tcp:501: Request processed in 333us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201046.023545:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 116 00000100:00100000:2.0:1788201046.026392:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201046.026483:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559502208 00000100:00100000:1.0:1788201046.026493:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559502208 00000100:00100000:1.0:1788201046.026547:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 117 00000100:00100000:1.0:1788201046.026558:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+8:5569:x1875064559502208:12345-192.168.201.56@tcp:503: 00000100:00100000:1.0:1788201046.026957:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+8:5569:x1875064559502208:12345-192.168.201.56@tcp:503: Request processed in 398us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201046.026965:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 117 00000100:00100000:1.0:1788201046.030814:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201046.034898:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559502336 00000100:00100000:0.0:1788201046.034915:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559502336 00000100:00100000:0.0:1788201046.034996:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 118 00000100:00100000:0.0:1788201046.035007:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+8:5588:x1875064559502336:12345-192.168.201.56@tcp:502: 00000100:00100000:0.0:1788201046.035416:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+8:5588:x1875064559502336:12345-192.168.201.56@tcp:502: Request processed in 410us (4611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201046.035434:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 118 00000100:00100000:3.0:1788201046.085734:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201046.085858:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559502464 00000100:00100000:2.0:1788201046.085868:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559502464 00000100:00100000:2.0:1788201046.085916:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 119 00000100:00100000:2.0:1788201046.085926:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+8:5588:x1875064559502464:12345-192.168.201.56@tcp:502: 00000100:00100000:2.0:1788201046.086227:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+8:5588:x1875064559502464:12345-192.168.201.56@tcp:502: Request processed in 301us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201046.086244:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 119 00000100:00100000:2.0:1788201046.104890:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201046.105302:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559502592 00000100:00100000:1.0:1788201046.105312:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559502592 00000100:00100000:1.0:1788201046.105411:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:1.0:1788201046.105421:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+8:5569:x1875064559502592:12345-192.168.201.56@tcp:101: 00010000:00010000:1.0:1788201046.105438:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201046.105465:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3caa5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd99810 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201046.105494:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3caa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99810 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201046.105505:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3caa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99810 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201046.105515:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f1600, rc 0) 00000100:00100000:1.0:1788201046.105574:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:5569:x1875064559502592:12345-192.168.201.56@tcp:101: Request processed in 154us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201046.105581:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:1.0:1788201046.112628:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201046.114338:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559502720 00000100:00100000:0.0:1788201046.114432:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559502720 00000100:00100000:0.0:1788201046.114681:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 121 00000100:00100000:0.0:1788201046.114693:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:5569:x1875064559502720:12345-192.168.201.56@tcp:256: 20000000:01000000:0.0:1788201046.114735:0:5818:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788201046.114761:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788201046.114765:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788201046.114768:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788201046.114771:0:5818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788201046.120196:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:5569:x1875064559502720:12345-192.168.201.56@tcp:256: Request processed in 5493us (7566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201046.120211:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 121 00000100:00100000:2.0:1788201046.130403:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201046.130504:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559502848 00000100:00100000:0.0:1788201046.130516:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559502848 00000100:00100000:0.0:1788201046.130574:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 122 00000100:00100000:0.0:1788201046.130584:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:5569:x1875064559502848:12345-192.168.201.56@tcp:101: 00010000:00010000:0.0:1788201046.130603:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201046.130621:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3caa64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd99817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201046.130658:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3caa64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99817 expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201046.130671:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3caa64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99817 expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201046.130686:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962480031c00, rc 0) 00000100:00100000:0.0:1788201046.130762:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5569:x1875064559502848:12345-192.168.201.56@tcp:101: Request processed in 179us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201046.130769:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 122 00000100:00100000:3.0:1788201046.137848:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201046.137982:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559502976 00000100:00100000:0.0:1788201046.138001:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559502976 00000100:00100000:0.0:1788201046.138057:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 123 00000100:00100000:0.0:1788201046.138065:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5569:x1875064559502976:12345-192.168.201.56@tcp:501: 00000100:00100000:0.0:1788201046.138389:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5569:x1875064559502976:12345-192.168.201.56@tcp:501: Request processed in 323us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201046.138396:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 123 00000100:00100000:3.0:1788201046.143178:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201046.143375:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559503104 00000100:00100000:1.0:1788201046.143386:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559503104 00000100:00100000:1.0:1788201046.143448:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 124 00000100:00100000:1.0:1788201046.143460:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5569:x1875064559503104:12345-192.168.201.56@tcp:503: 00000100:00100000:1.0:1788201046.144305:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5569:x1875064559503104:12345-192.168.201.56@tcp:503: Request processed in 842us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201046.144314:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 124 00000100:00100000:3.0:1788201046.151275:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201046.151500:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559503232 00000100:00100000:2.0:1788201046.151513:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559503232 00000100:00100000:2.0:1788201046.151573:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 125 00000100:00100000:2.0:1788201046.151584:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5593:x1875064559503232:12345-192.168.201.56@tcp:502: 00000100:00100000:2.0:1788201046.151863:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5593:x1875064559503232:12345-192.168.201.56@tcp:502: Request processed in 280us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201046.151880:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 125 00000100:00100000:2.0:1788201046.155481:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201046.155577:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559503360 00000100:00100000:1.0:1788201046.155589:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559503360 00000100:00100000:1.0:1788201046.155648:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 126 00000100:00100000:1.0:1788201046.155658:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5593:x1875064559503360:12345-192.168.201.56@tcp:502: 00000100:00100000:1.0:1788201046.155920:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5593:x1875064559503360:12345-192.168.201.56@tcp:502: Request processed in 263us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201046.155928:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 126 00000100:00100000:3.0:1788201046.168132:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201046.168644:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559503488 00000100:00100000:1.0:1788201046.168654:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559503488 00000100:00100000:1.0:1788201046.168703:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:1.0:1788201046.168712:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2340:x1875064559503488:12345-192.168.201.56@tcp:38: 00010000:00080000:1.0:1788201046.168747:0:6693:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0@192.168.201.56@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:1.0:1788201046.168792:0:6693:0:(genops.c:1406:class_connect()) connect: client 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0, cookie 0xa81c4c9a2f3caa6b 00000004:00100000:1.0:1788201046.168819:0:6693:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:1.0:1788201046.168825:0:6693:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788201046.200316:0:6693:0:(import.c:65:import_set_state_nolock()) ffff96248cec6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201046.200634:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2340:x1875064559503488:12345-192.168.201.56@tcp:38: Request processed in 31920us (32509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201046.200646:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:3.0:1788201046.710416:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201046.710464:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201046.710611:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559503744 00000100:00100000:1.0:1788201046.710621:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559503744 00000100:00100000:1.0:1788201046.710697:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559503616 00000100:00100000:1.0:1788201046.710700:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559503616 00000100:00100000:1.0:1788201046.710725:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:1.0:1788201046.710736:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+7:5569:x1875064559503744:12345-192.168.201.56@tcp:41: 00000004:00000024:1.0:1788201046.710791:0:5826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201046.710860:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+7:5569:x1875064559503744:12345-192.168.201.56@tcp:41: Request processed in 125us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201046.710880:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:1.0:1788201046.710897:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:1.0:1788201046.710903:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:0:x1875064559503616:12345-192.168.201.56@tcp:41: 00000004:00000024:1.0:1788201046.710915:0:5826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201046.710935:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:0:x1875064559503616:12345-192.168.201.56@tcp:41: Request processed in 33us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201046.710940:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00080000:3.0:1788201046.711151:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201046.721909:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201046.722025:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559503872 00000100:00100000:1.0:1788201046.722037:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559503872 00000100:00100000:1.0:1788201046.722111:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:1.0:1788201046.722123:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:5569:x1875064559503872:12345-192.168.201.56@tcp:40: 00000100:00100000:1.0:1788201046.722228:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:5569:x1875064559503872:12345-192.168.201.56@tcp:40: Request processed in 97us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201046.722236:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:3.0:1788201046.735774:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201046.735818:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201046.735845:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201046.736177:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559504000 00000100:00100000:0.0:1788201046.736189:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559504000 00000100:00100000:0.0:1788201046.736241:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559504128 00000100:00100000:0.0:1788201046.736244:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559504128 00000100:00100000:0.0:1788201046.736265:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:0.0:1788201046.736275:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559504000:12345-192.168.201.56@tcp:8: 00010000:00080000:0.0:1788201046.736306:0:8088:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0@192.168.201.56@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:0.0:1788201046.736337:0:8088:0:(genops.c:1406:class_connect()) connect: client 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0, cookie 0xa81c4c9a2f3caa72 00002000:00100000:0.0:1788201046.736376:0:8088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0/ffff962492c00000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201046.736388:0:8088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788201046.736712:0:8088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788201046.736742:0:8088:0:(import.c:65:import_set_state_nolock()) ffff962492c06800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201046.736811:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2340:x1875064559504000:12345-192.168.201.56@tcp:8: Request processed in 536us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201046.736819:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:0.0:1788201046.736840:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:0.0:1788201046.736859:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559504128:12345-192.168.201.56@tcp:8: 00010000:00080000:0.0:1788201046.736874:0:8088:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0@192.168.201.56@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:0.0:1788201046.736890:0:8088:0:(genops.c:1406:class_connect()) connect: client 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0, cookie 0xa81c4c9a2f3caa79 00002000:00100000:0.0:1788201046.736896:0:8088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0/ffff962492c03000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201046.736912:0:8088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788201046.737122:0:8088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788201046.737138:0:8088:0:(import.c:65:import_set_state_nolock()) ffff962492c05800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201046.737163:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2340:x1875064559504128:12345-192.168.201.56@tcp:8: Request processed in 302us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201046.737169:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:2.0:1788201046.737543:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559504256 00000100:00100000:2.0:1788201046.737549:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559504256 00000100:00100000:2.0:1788201046.737609:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:2.0:1788201046.737617:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:5569:x1875064559504256:12345-192.168.201.56@tcp:33: 00000004:00080000:3.0:1788201046.780714:0:5828:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 43032us 00010000:00010000:1.0:1788201046.781525:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:3.0:1788201046.807212:0:5828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1788201046.807458:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:5569:x1875064559504256:12345-192.168.201.56@tcp:33: Request processed in 69837us (71692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201046.807473:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:3.0:1788201047.124413:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201047.126555:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559504384 00000100:00100000:0.0:1788201047.126571:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559504384 00000100:00100000:0.0:1788201047.126637:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:0.0:1788201047.126646:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:5610:x1875064559504384:12345-192.168.201.56@tcp:101: 00010000:00010000:0.0:1788201047.126665:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201047.126690:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3caa80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99841 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.126756:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3caa87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.126770:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3caa87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.126784:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3caa87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201047.127012:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788201047.127023:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201047.127101:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3caa87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.127128:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3caa80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99841 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.127144:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3caa87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99841 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.127153:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624a8e9fd00) 00010000:00010000:0.0:1788201047.127156:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201047.127160:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962481512a00, rc 0) 00000100:00100000:0.0:1788201047.127238:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+7:5610:x1875064559504384:12345-192.168.201.56@tcp:101: Request processed in 593us (2843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201047.127245:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:3.0:1788201047.607136:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201047.607176:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570011008:0@lo:13: 00000100:00100000:3.0:1788201047.607293:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.607584:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570011008 00000100:00100000:1.0:1788201047.607594:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570011008 00000100:00100000:1.0:1788201047.607682:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201047.607694:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570011008:12345-0@lo:13: 00002000:00000024:1.0:1788201047.607726:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201047.607780:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570011008:12345-0@lo:13: Request processed in 89us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.607788:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788201047.607869:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788201047.607927:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517df80 x1875064570011008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201047.607940:0:3282:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788201047.608001:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570011136:0@lo:400: 00000100:00100000:1.0:1788201047.608038:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.608086:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570011648:0@lo:400: 00000100:00100000:1.0:1788201047.608115:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.608137:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201047.608143:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570011264:0@lo:400: 00000100:00100000:1.0:1788201047.608163:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.608192:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570011648 00000100:00100000:1.0:1788201047.608196:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570011648 00000100:00100000:1.0:1788201047.608247:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570011264 00000100:00100000:1.0:1788201047.608251:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570011264 00000100:00100000:1.0:1788201047.608272:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201047.608279:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570011648:12345-0@lo:400: 00000100:00100000:1.0:1788201047.608320:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570011648:12345-0@lo:400: Request processed in 42us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.608326:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201047.608337:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201047.608369:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570011264:12345-0@lo:400: 00000100:00100000:1.0:1788201047.608403:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570011264:12345-0@lo:400: Request processed in 61us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.608411:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201047.608464:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570011264:0@lo:400: 00000100:00100000:1.0:1788201047.608478:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570011648:0@lo:400: 00000100:00100000:1.0:1788201047.608527:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570011520:0@lo:400: 00000100:00100000:1.0:1788201047.608558:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.608582:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201047.608589:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570011392:0@lo:400: 00000100:00100000:1.0:1788201047.608611:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.608646:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570011392 00000100:00100000:1.0:1788201047.608650:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570011392 00000100:00100000:1.0:1788201047.608674:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201047.608680:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570011392:12345-0@lo:400: 00000100:00100000:1.0:1788201047.608715:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570011392:12345-0@lo:400: Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.608720:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201047.608752:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570011392:0@lo:400: 00000100:00100000:1.0:1788201047.608779:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570011136 00000100:00100000:1.0:1788201047.608782:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570011136 00000100:00100000:1.0:1788201047.608811:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788201047.608817:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570011136:12345-0@lo:400: 00000100:00100000:1.0:1788201047.608851:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570011136:12345-0@lo:400: Request processed in 35us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.608857:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788201047.608896:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570011136:0@lo:400: 00000100:00100000:1.0:1788201047.608927:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570011520 00000100:00100000:1.0:1788201047.608930:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570011520 00000100:00100000:1.0:1788201047.608967:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201047.608974:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570011520:12345-0@lo:400: 00000100:00100000:1.0:1788201047.609012:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570011520:12345-0@lo:400: Request processed in 38us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.609018:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788201047.609041:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962485738000 x1875064570011520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201047.609052:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570011520:0@lo:400: 00000100:00080000:1.0:1788201047.609086:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201047.609091:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201047.609323:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570011008:0@lo:13: 00010000:00010000:3.0:1788201047.798597:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201048.824755:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201049.630085:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201049.631127:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559504512 00000100:00100000:1.0:1788201049.631145:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559504512 00000100:00100000:1.0:1788201049.631279:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:1.0:1788201049.631293:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+7:5662:x1875064559504512:12345-192.168.201.56@tcp:41: 00000004:00000024:1.0:1788201049.631391:0:5826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201049.631506:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+7:5662:x1875064559504512:12345-192.168.201.56@tcp:41: Request processed in 215us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201049.631515:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00080000:3.0:1788201049.631851:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201049.637087:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201049.637189:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559504640 00000100:00100000:1.0:1788201049.637201:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559504640 00000100:00100000:1.0:1788201049.637324:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:1.0:1788201049.637336:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:5662:x1875064559504640:12345-192.168.201.56@tcp:13: 00002000:00000024:1.0:1788201049.637426:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201049.638946:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:5662:x1875064559504640:12345-192.168.201.56@tcp:13: Request processed in 1604us (1865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201049.638957:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00080000:3.0:1788201049.640160:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201049.646583:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201049.646785:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559504768 00000100:00100000:2.0:1788201049.646798:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559504768 00000100:00100000:2.0:1788201049.646892:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:2.0:1788201049.646905:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:5662:x1875064559504768:12345-192.168.201.56@tcp:13: 00002000:00000024:2.0:1788201049.646963:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201049.647060:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:5662:x1875064559504768:12345-192.168.201.56@tcp:13: Request processed in 158us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201049.647070:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00080000:3.0:1788201049.647142:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201049.848562:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788201050.343164:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 00000100:00100000:0.0:1788201050.679124:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201050.679171:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570011776:0@lo:13: 00000100:00100000:0.0:1788201050.679264:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201050.679599:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570011776 00000100:00100000:1.0:1788201050.679610:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570011776 00000100:00100000:1.0:1788201050.679692:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201050.679703:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570011776:12345-0@lo:13: 00002000:00000024:1.0:1788201050.679733:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201050.679787:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570011776:12345-0@lo:13: Request processed in 86us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201050.679795:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788201050.679868:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba85aa00 x1875064570011776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201050.679889:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570011776:0@lo:13: 00000100:00080000:0.0:1788201050.680010:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788201050.787688:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 00010000:00010000:1.0:1788201050.870976:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788201051.332808:0:5847:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 00010000:00010000:2.0:1788201051.901963:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201051.965277:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201051.965337:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201051.965438:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201051.965467:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201051.965576:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559504896 00000100:00100000:2.0:1788201051.965591:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559504896 00000100:00100000:2.0:1788201051.965679:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 128 00000100:00100000:2.0:1788201051.965691:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2341:x1875064559504896:12345-192.168.201.56@tcp:400: 00000100:00100000:2.0:1788201051.965796:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2341:x1875064559504896:12345-192.168.201.56@tcp:400: Request processed in 107us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201051.965804:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 128 00000100:00100000:3.0:1788201051.966378:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559505152 00000100:00100000:3.0:1788201051.966386:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559505152 00000100:00100000:3.0:1788201051.966448:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559505280 00000100:00100000:3.0:1788201051.966472:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559505280 00000100:00100000:3.0:1788201051.966503:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:3.0:1788201051.966514:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2341:x1875064559505152:12345-192.168.201.56@tcp:400: 00000100:00100000:3.0:1788201051.966581:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2341:x1875064559505152:12345-192.168.201.56@tcp:400: Request processed in 71us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201051.966589:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00080000:0.0:1788201051.966768:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201051.966780:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201051.966809:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:3.0:1788201051.966818:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2341:x1875064559505280:12345-192.168.201.56@tcp:400: 00000100:00100000:3.0:1788201051.966847:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2341:x1875064559505280:12345-192.168.201.56@tcp:400: Request processed in 31us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201051.966853:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:1.0:1788201051.967027:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559505024 00000100:00100000:1.0:1788201051.967033:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559505024 00000100:00100000:1.0:1788201051.967082:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:1.0:1788201051.967089:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2341:x1875064559505024:12345-192.168.201.56@tcp:400: 00000100:00100000:1.0:1788201051.967173:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2341:x1875064559505024:12345-192.168.201.56@tcp:400: Request processed in 84us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201051.967180:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00080000:0.0:1788201051.967337:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201052.726866:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570011904:0@lo:13: 00000100:00100000:1.0:1788201052.726996:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201052.727659:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570011904 00000100:00100000:0.0:1788201052.727671:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570011904 00000100:00100000:0.0:1788201052.727754:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201052.727769:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570011904:12345-0@lo:13: 00002000:00000024:0.0:1788201052.727821:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201052.727890:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570011904:12345-0@lo:13: Request processed in 123us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201052.727898:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788201052.728105:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201052.728156:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0df80 x1875064570011904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201052.728180:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570011904:0@lo:13: 00000100:00100000:3.0:1788201052.728549:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570012160:0@lo:400: 00000100:00100000:1.0:1788201052.728769:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570012032:0@lo:400: 00000100:00100000:0.0:1788201052.728860:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570012416:0@lo:400: 00000100:00100000:3.0:1788201052.728911:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201052.744850:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570012160 00000100:00100000:1.0:1788201052.744882:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570012160 00000100:00100000:1.0:1788201052.744978:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201052.744992:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570012160:12345-0@lo:400: 00000100:00100000:1.0:1788201052.745107:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570012160:12345-0@lo:400: Request processed in 117us (16195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201052.745139:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201052.745199:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201052.745237:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570012032 00000100:00100000:1.0:1788201052.745241:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570012032 00000100:00100000:1.0:1788201052.745270:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788201052.745277:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570012032:12345-0@lo:400: 00000100:00100000:1.0:1788201052.745310:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570012032:12345-0@lo:400: Request processed in 35us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201052.745316:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788201052.745411:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570012032:0@lo:400: 00000100:00100000:1.0:1788201052.745428:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570012544:0@lo:400: 00000100:00100000:1.0:1788201052.745463:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201052.745486:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570012544 00000100:00100000:1.0:1788201052.745489:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570012544 00000100:00100000:1.0:1788201052.745526:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201052.745534:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570012544:12345-0@lo:400: 00000100:00100000:1.0:1788201052.745566:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570012544:12345-0@lo:400: Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201052.745572:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788201052.745589:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201052.745615:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570012544:0@lo:400: 00000100:00100000:0.0:1788201052.752432:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201052.752565:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570012416 00000100:00100000:0.0:1788201052.752577:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570012416 00000100:00100000:0.0:1788201052.752660:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201052.752673:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570012416:12345-0@lo:400: 00000100:00100000:0.0:1788201052.752987:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570012416:12345-0@lo:400: Request processed in 317us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201052.752996:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788201052.753025:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201052.753069:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c842d80 x1875064570012416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201052.753087:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570012416:0@lo:400: 00000100:00100000:0.0:1788201052.758532:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570012288:0@lo:400: 00000100:00100000:0.0:1788201052.758660:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201052.759147:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570012288 00000100:00100000:1.0:1788201052.759169:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570012288 00000100:00100000:1.0:1788201052.759251:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201052.759264:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570012288:12345-0@lo:400: 00000100:00100000:1.0:1788201052.759361:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570012288:12345-0@lo:400: Request processed in 99us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201052.759381:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788201052.760608:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201052.760673:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570012288:0@lo:400: 00000100:00100000:3.0:1788201052.761311:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570012160:0@lo:400: 00010000:00010000:0.0:1788201052.919489:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201053.830338:0:8280:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788201053.950559:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201054.976847:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201055.799771:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570012672:0@lo:13: 00000100:00100000:1.0:1788201055.799917:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201055.800434:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570012672 00000100:00100000:2.0:1788201055.800444:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570012672 00000100:00100000:2.0:1788201055.800530:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201055.800547:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570012672:12345-0@lo:13: 00002000:00000024:2.0:1788201055.800588:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201055.800644:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570012672:12345-0@lo:13: Request processed in 104us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201055.800667:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788201055.801623:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788201055.801673:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517df80 x1875064570012672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201055.801696:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570012672:0@lo:13: 00010000:00010000:2.0:1788201055.998577:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201057.015363:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201057.077760:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201057.077817:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201057.077859:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201057.077884:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201057.077998:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559505536 00000100:00100000:0.0:1788201057.078009:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559505536 00000100:00100000:0.0:1788201057.078089:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:0.0:1788201057.078100:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2342:x1875064559505536:12345-192.168.201.56@tcp:400: 00000100:00100000:0.0:1788201057.078193:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2342:x1875064559505536:12345-192.168.201.56@tcp:400: Request processed in 96us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201057.078201:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00080000:0.0:1788201057.078234:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201057.078271:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559505664 00000100:00100000:0.0:1788201057.078274:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559505664 00000100:00100000:0.0:1788201057.078304:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559505792 00000100:00100000:0.0:1788201057.078307:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559505792 00000100:00100000:0.0:1788201057.078326:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:0.0:1788201057.078333:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2341:x1875064559505664:12345-192.168.201.56@tcp:400: 00000100:00100000:0.0:1788201057.078408:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2341:x1875064559505664:12345-192.168.201.56@tcp:400: Request processed in 75us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201057.078414:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:0.0:1788201057.078426:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:0.0:1788201057.078432:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2342:x1875064559505792:12345-192.168.201.56@tcp:400: 00000100:00100000:0.0:1788201057.078490:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2342:x1875064559505792:12345-192.168.201.56@tcp:400: Request processed in 58us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201057.078496:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00080000:0.0:1788201057.078545:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201057.078547:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201057.079076:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559505408 00000100:00100000:3.0:1788201057.079083:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559505408 00000100:00100000:3.0:1788201057.079125:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00100000:3.0:1788201057.079132:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2341:x1875064559505408:12345-192.168.201.56@tcp:400: 00000100:00100000:3.0:1788201057.079169:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2341:x1875064559505408:12345-192.168.201.56@tcp:400: Request processed in 38us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201057.079175:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00100000:2.0:1788201057.846736:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570012928:0@lo:400: 00000100:00100000:2.0:1788201057.846823:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201057.846887:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96249058a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570013440:0@lo:400: 00000100:00100000:2.0:1788201057.846913:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201057.847018:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570013184:0@lo:400: 00000100:00100000:1.0:1788201057.847057:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201057.847091:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201057.847097:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570012800:0@lo:400: 00000100:00100000:1.0:1788201057.847124:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201057.847145:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570013312:0@lo:400: 00000100:00100000:1.0:1788201057.847167:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201057.847205:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96249058b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570013056:0@lo:400: 00000100:00100000:1.0:1788201057.847238:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201057.847275:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570012928 00000100:00100000:1.0:1788201057.847282:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570012928 00000100:00100000:1.0:1788201057.847328:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570013312 00000100:00100000:1.0:1788201057.847331:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570013312 00000100:00100000:1.0:1788201057.847379:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570013056 00000100:00100000:1.0:1788201057.847382:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570013056 00000100:00100000:1.0:1788201057.847399:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201057.847408:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96249058ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570012928:12345-0@lo:400: 00000100:00100000:1.0:1788201057.847458:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96249058ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570012928:12345-0@lo:400: Request processed in 50us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201057.847477:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201057.847494:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201057.847500:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570013312:12345-0@lo:400: 00000100:00100000:1.0:1788201057.847532:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570013312:12345-0@lo:400: Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201057.847538:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201057.847550:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201057.847556:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570013056:12345-0@lo:400: 00000100:00100000:1.0:1788201057.847583:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570013056:12345-0@lo:400: Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201057.847589:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201057.847607:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570013440 00000100:00100000:1.0:1788201057.847610:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570013440 00000100:00100000:1.0:1788201057.847637:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570013184 00000100:00100000:1.0:1788201057.847640:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570013184 00000100:00100000:1.0:1788201057.847658:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201057.847664:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570013440:12345-0@lo:400: 00000100:00100000:1.0:1788201057.847692:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570013440:12345-0@lo:400: Request processed in 28us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201057.847698:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201057.847710:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201057.847716:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570013184:12345-0@lo:400: 00000100:00100000:1.0:1788201057.847742:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570013184:12345-0@lo:400: Request processed in 27us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201057.847748:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201057.847766:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570012800 00000100:00100000:1.0:1788201057.847776:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570012800 00000100:00100000:1.0:1788201057.847803:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788201057.847809:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570012800:12345-0@lo:400: 00000100:00100000:1.0:1788201057.847840:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570012800:12345-0@lo:400: Request processed in 32us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201057.847847:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1788201057.847879:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201057.847883:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201057.847886:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201057.847918:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96249058b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570013056:0@lo:400: 00010000:00080000:2.0:1788201057.848132:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96249058a680 x1875064570013440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201057.848143:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96249058a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570013440:0@lo:400: 00000100:00100000:2.0:1788201057.848164:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570012928:0@lo:400: 00000100:00100000:1.0:1788201057.848713:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570013568:0@lo:13: 00000100:00100000:1.0:1788201057.848749:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201057.848792:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570012800:0@lo:400: 00000100:00100000:1.0:1788201057.848803:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570013312:0@lo:400: 00010000:00080000:1.0:1788201057.848815:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962490588000 x1875064570013184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201057.848824:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570013184:0@lo:400: 00000100:00100000:0.0:1788201057.849060:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570013568 00000100:00100000:0.0:1788201057.849067:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570013568 00000100:00100000:0.0:1788201057.849109:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201057.849118:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570013568:12345-0@lo:13: 00002000:00000024:0.0:1788201057.849150:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201057.849213:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570013568:12345-0@lo:13: Request processed in 96us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201057.849220:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788201057.849376:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0c000 x1875064570013568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201057.849391:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570013568:0@lo:13: 00010000:00010000:0.0:1788201058.042193:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201058.113664:0:8427:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2f84ae00 20000000:00000080:0.0:1788201058.113681:0:8427:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9624bfd52c00 uarg=0000000000000000 20000000:01000000:0.0:1788201058.113725:0:8427:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788201058.113728:0:8427:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788201058.113730:0:8427:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788201058.113736:0:8427:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788201058.113741:0:8427:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788201058.113755:0:8427:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788201058.113758:0:8427:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788201058.113996:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788201058.113999:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788201058.125034:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788201058.127750:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788201058.128434:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788201058.128481:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1788201058.128496:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788201058.128499:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788201058.131667:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788201058.137017:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788201058.137132:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788201058.137538:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1788201058.137559:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788201058.137561:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788201058.151609:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788201058.153491:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788201058.153551:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788201058.153619:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788201058.153637:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788201058.153639:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788201058.158842:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788201058.159582:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788201058.159659:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788201058.159694:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1788201058.159712:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788201058.159733:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.159752:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca98b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca984 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.159768:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3ca9b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9ae expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.159774:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624829c5000/0xa81c4c9a2f3ca9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9d8 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.159780:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca9ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9e6 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.159785:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962480031800/0xa81c4c9a2f3ca9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9f4 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.159921:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962493610400/0xa81c4c9a2f3caa17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caa10 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.159929:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624829c4c00/0xa81c4c9a2f3caa41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caa3a expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.159937:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624829c4600/0xa81c4c9a2f3caa4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd997df expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.159944:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962480030800/0xa81c4c9a2f3caa56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd997e6 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.159950:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.159996:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962480030800/0xa81c4c9a2f3caa56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd997e6 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.160032:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962480030800/0xa81c4c9a2f3caa56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd997e6 expref: 9 pid: 5819 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201058.160050:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570013696:192.168.201.56@tcp:104: 00010000:00010000:0.0:1788201058.160276:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624829c4600/0xa81c4c9a2f3caa4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd997df expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.160285:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9624829c4600/0xa81c4c9a2f3caa4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd997df expref: 9 pid: 5820 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201058.160293:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570013824:192.168.201.56@tcp:104: 00010000:00010000:0.0:1788201058.160320:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624829c4c00/0xa81c4c9a2f3caa41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3caa3a expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.160327:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624829c4c00/0xa81c4c9a2f3caa41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa3a expref: 18 pid: 5820 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201058.160336:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570013952:0@lo:104: 00000100:00100000:0.0:1788201058.160407:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201058.160449:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962493610400/0xa81c4c9a2f3caa17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3caa10 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.160457:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962493610400/0xa81c4c9a2f3caa17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa10 expref: 18 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201058.160465:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570014080:0@lo:104: 00000100:00100000:0.0:1788201058.160493:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201058.160528:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962480031800/0xa81c4c9a2f3ca9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9f4 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.160536:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962480031800/0xa81c4c9a2f3ca9fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9f4 expref: 18 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201058.160544:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570014208:0@lo:104: 00010000:00010000:0.0:1788201058.160568:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9e6 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.160575:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca9ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9e6 expref: 18 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201058.160582:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570014336:0@lo:104: 00010000:00010000:0.0:1788201058.160602:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624829c5000/0xa81c4c9a2f3ca9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9d8 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.160609:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624829c5000/0xa81c4c9a2f3ca9df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9d8 expref: 18 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201058.160616:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570014464:0@lo:104: 00010000:00010000:0.0:1788201058.160636:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3ca9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9ae expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.160643:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3ca9b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9ae expref: 18 pid: 5820 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201058.160650:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570014592:0@lo:104: 00010000:00010000:0.0:1788201058.160671:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca984 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.160689:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca98b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca984 expref: 18 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201058.160697:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570014720:0@lo:104: 00000100:00100000:0.0:1788201058.160716:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485952540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201058.160942:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201058.160960:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201058.160972:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201058.160981:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201058.160988:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201058.160996:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201058.161004:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570013952 00000100:00100000:1.0:1788201058.161009:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570013952 00000100:00100000:1.0:1788201058.161058:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570014080 00000100:00100000:1.0:1788201058.161060:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570014080 00000100:00100000:1.0:1788201058.161068:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570014208 00000100:00100000:1.0:1788201058.161070:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570014208 00000100:00100000:1.0:1788201058.161076:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570014336 00000100:00100000:1.0:1788201058.161078:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570014336 00000100:00100000:1.0:1788201058.161084:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570014464 00000100:00100000:1.0:1788201058.161085:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570014464 00000100:00100000:1.0:1788201058.161092:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570014592 00000100:00100000:1.0:1788201058.161093:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570014592 00000100:00100000:1.0:1788201058.161100:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570014720 00000100:00100000:1.0:1788201058.161102:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570014720 00000100:00100000:1.0:1788201058.161113:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201058.161120:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+9:8427:x1875064570013952:12345-0@lo:104: 00010000:00010000:1.0:1788201058.161131:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3caa41 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161197:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201058.161202:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+9:8427:x1875064570013952:12345-0@lo:104: Request processed in 83us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.161214:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201058.161229:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201058.161233:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9e31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+8:8427:x1875064570014080:12345-0@lo:104: 00010000:00010000:1.0:1788201058.161240:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3caa17 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161267:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201058.161271:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9e31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+8:8427:x1875064570014080:12345-0@lo:104: Request processed in 38us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.161275:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201058.161303:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201058.161308:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+7:8427:x1875064570014208:12345-0@lo:104: 00010000:00010000:1.0:1788201058.161313:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca9fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161332:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788201058.161336:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+7:8427:x1875064570014208:12345-0@lo:104: Request processed in 29us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.161361:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201058.161371:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201058.161376:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+6:8427:x1875064570014336:12345-0@lo:104: 00010000:00010000:1.0:1788201058.161382:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca9ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161402:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788201058.161406:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+6:8427:x1875064570014336:12345-0@lo:104: Request processed in 31us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.161416:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201058.161424:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201058.161428:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+5:8427:x1875064570014464:12345-0@lo:104: 00010000:00010000:1.0:1788201058.161434:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca9df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161453:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788201058.161457:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+5:8427:x1875064570014464:12345-0@lo:104: Request processed in 28us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.161462:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201058.161472:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201058.161476:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+4:8427:x1875064570014592:12345-0@lo:104: 00010000:00010000:1.0:1788201058.161482:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca9b5 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161506:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788201058.161511:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+4:8427:x1875064570014592:12345-0@lo:104: Request processed in 34us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.161516:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201058.161528:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201058.161534:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:8427:x1875064570014720:12345-0@lo:104: 00010000:00010000:1.0:1788201058.161540:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca98b expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161563:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788201058.161567:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:8427:x1875064570014720:12345-0@lo:104: Request processed in 34us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.161578:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788201058.161595:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788201058.161601:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3caa41 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161607:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5800 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201058.161612:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3caa41 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161620:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3caa41 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201058.161627:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3caa41 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201058.161632:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201058.161665:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3caa41 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161671:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201058.161694:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3caa41 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161700:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3caa3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3caa41 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161712:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788201058.161715:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3caa17 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161731:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5600 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201058.161734:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3caa17 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161740:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3caa17 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201058.161745:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3caa17 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201058.161749:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201058.161763:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3caa17 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161768:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201058.161773:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3caa17 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161778:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624829c5600/0xa81c4c9a2f3caa10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3caa17 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.161786:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788201058.161788:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca9fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201058.162505:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570013952:0@lo:104: 00000100:00100000:0.0:1788201058.162518:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570014080:0@lo:104: 00000100:00100000:0.0:1788201058.162526:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570014208:0@lo:104: 00000100:00100000:0.0:1788201058.162534:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570014336:0@lo:104: 00000100:00100000:0.0:1788201058.162541:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570014464:0@lo:104: 00000100:00100000:0.0:1788201058.162549:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570014592:0@lo:104: 00000100:00100000:0.0:1788201058.162555:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570014720:0@lo:104: 00010000:00010000:1.0:1788201058.162771:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962493610a00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201058.162775:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca9fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.162985:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca9fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201058.162993:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca9fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201058.162998:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201058.163044:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.163050:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201058.163075:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.163082:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962493610a00/0xa81c4c9a2f3ca9f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.163095:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201058.163098:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca9ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.163103:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962480030e00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201058.163106:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca9ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.163113:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca9ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201058.163119:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca9ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201058.163129:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788201058.163224:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570015104:0@lo:103: 00000100:00100000:2.0:1788201058.163279:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201058.163336:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570015104 00000100:00100000:2.0:1788201058.163367:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570015104 00010000:00010000:2.0:1788201058.163396:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962480031800/0xa81c4c9a2f3ca9fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9f4 expref: 19 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201058.163422:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201058.163429:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96249058a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570015104:12345-0@lo:103: 00010000:00010000:2.0:1788201058.163439:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201058.163444:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962480031800/0xa81c4c9a2f3ca9fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9f4 expref: 19 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201058.163452:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962480031800/0xa81c4c9a2f3ca9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9f4 expref: 19 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201058.163474:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962480031800/0xa81c4c9a2f3ca9fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9f4 expref: 19 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201058.163488:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201058.163519:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96249058a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3282:x1875064570015104:12345-0@lo:103: Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201058.163525:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201058.163560:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570015104:0@lo:103: 00010000:00010000:1.0:1788201058.163625:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.163631:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201058.163705:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.163712:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3ca9e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.163721:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201058.163724:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca9df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.163729:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962493610c00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201058.163732:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca9df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.163737:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca9df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201058.163743:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca9df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201058.163748:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201058.163762:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.163767:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201058.163780:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.163785:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962493610c00/0xa81c4c9a2f3ca9d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201058.163953:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201058.163963:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570015232:0@lo:103: 00000100:00100000:2.0:1788201058.163988:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201058.164049:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201058.164053:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca9b5 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.164060:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5e00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201058.164062:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca9b5 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.164068:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca9b5 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201058.164074:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca9b5 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201058.164078:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201058.164102:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9b5 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.164107:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201058.164112:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9b5 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.164118:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624829c5e00/0xa81c4c9a2f3ca9ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9b5 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.164127:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788201058.164218:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570015232 00000100:00100000:0.0:1788201058.164224:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570015232 00010000:00010000:0.0:1788201058.164241:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca9ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9e6 expref: 18 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201058.164259:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201058.164265:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96249058b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3282:x1875064570015232:12345-0@lo:103: 00010000:00010000:0.0:1788201058.164275:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201058.164279:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca9ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9e6 expref: 18 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.164288:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9e6 expref: 18 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.164311:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f1000/0xa81c4c9a2f3ca9ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9e6 expref: 18 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.164322:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201058.164380:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96249058b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3282:x1875064570015232:12345-0@lo:103: Request processed in 114us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201058.164386:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201058.164466:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570015232:0@lo:103: 00010000:00010000:1.0:1788201058.164514:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca98b expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.164521:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962493611000 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201058.164524:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca98b expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.164531:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca98b expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201058.164538:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca98b expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201058.164543:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201058.164711:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca98b expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.164718:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201058.164732:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca98b expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.164739:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962493611000/0xa81c4c9a2f3ca984 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca98b expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.164755:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201058.164757:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201058.164758:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201058.164766:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201058.164779:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570014848:0@lo:103: 00000100:00100000:1.0:1788201058.164821:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201058.164847:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570015360:0@lo:103: 00000100:00100000:1.0:1788201058.164875:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201058.164894:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201058.164900:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570014976:0@lo:103: 00000100:00100000:1.0:1788201058.164920:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201058.164933:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570015488:0@lo:103: 00000100:00100000:1.0:1788201058.164950:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201058.164968:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201058.164975:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570015616:0@lo:103: 00000100:00100000:1.0:1788201058.164999:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201058.165027:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570014848 00000100:00100000:1.0:1788201058.165032:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570014848 00010000:00010000:1.0:1788201058.165052:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624829c4c00/0xa81c4c9a2f3caa41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa3a expref: 17 pid: 5820 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201058.165065:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570015360 00000100:00100000:1.0:1788201058.165068:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570015360 00010000:00010000:1.0:1788201058.165078:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624829c5000/0xa81c4c9a2f3ca9df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9d8 expref: 18 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201058.165087:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570014976 00000100:00100000:1.0:1788201058.165089:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570014976 00010000:00010000:1.0:1788201058.165098:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962493610400/0xa81c4c9a2f3caa17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa10 expref: 19 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201058.165106:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570015488 00000100:00100000:1.0:1788201058.165108:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570015488 00010000:00010000:1.0:1788201058.165115:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3ca9b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9ae expref: 20 pid: 5820 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201058.165122:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570015616 00000100:00100000:1.0:1788201058.165129:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570015616 00010000:00010000:1.0:1788201058.165151:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca98b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca984 expref: 21 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201058.165165:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201058.165170:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+21:3284:x1875064570014848:12345-0@lo:103: 00010000:00010000:1.0:1788201058.165178:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201058.165182:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624829c4c00/0xa81c4c9a2f3caa41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa3a expref: 21 pid: 5820 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165189:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624829c4c00/0xa81c4c9a2f3caa41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa3a expref: 21 pid: 5820 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165200:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624829c4c00/0xa81c4c9a2f3caa41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa3a expref: 21 pid: 5820 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165210:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201058.165236:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+20:3284:x1875064570014848:12345-0@lo:103: Request processed in 66us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.165242:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201058.165255:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201058.165260:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570015360:12345-0@lo:103: 00010000:00010000:1.0:1788201058.165267:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201058.165270:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624829c5000/0xa81c4c9a2f3ca9df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9d8 expref: 19 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165278:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624829c5000/0xa81c4c9a2f3ca9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9d8 expref: 19 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165286:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624829c5000/0xa81c4c9a2f3ca9df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9d8 expref: 19 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165300:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201058.165318:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3284:x1875064570015360:12345-0@lo:103: Request processed in 59us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.165323:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201058.165333:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201058.165338:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3284:x1875064570014976:12345-0@lo:103: 00010000:00010000:1.0:1788201058.165383:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201058.165388:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962493610400/0xa81c4c9a2f3caa17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa10 expref: 17 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165396:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962493610400/0xa81c4c9a2f3caa17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa10 expref: 17 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165405:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962493610400/0xa81c4c9a2f3caa17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa10 expref: 17 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165413:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201058.165432:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064570014976:12345-0@lo:103: Request processed in 93us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.165437:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201058.165450:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201058.165455:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:3284:x1875064570015488:12345-0@lo:103: 00010000:00010000:1.0:1788201058.165461:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201058.165465:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3ca9b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9ae expref: 15 pid: 5820 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165473:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3ca9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9ae expref: 15 pid: 5820 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165491:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3ca9b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9ae expref: 15 pid: 5820 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165498:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201058.165519:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:3284:x1875064570015488:12345-0@lo:103: Request processed in 65us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.165525:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201058.165538:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201058.165543:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485694050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:3283:x1875064570015616:12345-0@lo:103: 00010000:00010000:1.0:1788201058.165550:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201058.165553:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca98b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca984 expref: 13 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165562:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca984 expref: 13 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165571:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3ca98b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca984 expref: 13 pid: 5819 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.165581:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201058.165602:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485694050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:3283:x1875064570015616:12345-0@lo:103: Request processed in 59us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.165607:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201058.165662:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570015616:0@lo:103: 00000100:00100000:1.0:1788201058.165683:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570014976:0@lo:103: 00000100:00100000:1.0:1788201058.165688:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570015488:0@lo:103: 00000100:00100000:1.0:1788201058.165702:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570014848:0@lo:103: 00000100:00100000:1.0:1788201058.165707:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570015360:0@lo:103: 00000100:00100000:0.0:1788201058.171263:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201058.171291:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201058.171433:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559506048 00000100:00100000:1.0:1788201058.171445:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559506048 00010000:00010000:1.0:1788201058.171491:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624829c4600/0xa81c4c9a2f3caa4f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd997df expref: 10 pid: 5820 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201058.171523:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559505920 00000100:00100000:1.0:1788201058.171526:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559505920 00010000:00010000:1.0:1788201058.171536:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962480030800/0xa81c4c9a2f3caa56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd997e6 expref: 11 pid: 5819 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201058.171548:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:1.0:1788201058.171557:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+11:2342:x1875064559506048:12345-192.168.201.56@tcp:103: 00010000:00010000:1.0:1788201058.171575:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201058.171580:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624829c4600/0xa81c4c9a2f3caa4f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd997df expref: 11 pid: 5820 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.171590:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624829c4600/0xa81c4c9a2f3caa4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd997df expref: 11 pid: 5820 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.171609:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201058.171675:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+11:2342:x1875064559506048:12345-192.168.201.56@tcp:103: Request processed in 119us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.171682:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:1.0:1788201058.171701:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:1.0:1788201058.171706:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2342:x1875064559505920:12345-192.168.201.56@tcp:103: 00010000:00010000:1.0:1788201058.171729:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201058.171734:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962480030800/0xa81c4c9a2f3caa56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd997e6 expref: 10 pid: 5819 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.171742:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962480030800/0xa81c4c9a2f3caa56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd997e6 expref: 10 pid: 5819 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.171753:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.171761:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.171776:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.171781:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.171788:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.171793:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.171799:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962481512000 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:1.0:1788201058.171809:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.171816:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.171833:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201058.171842:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201058.171858:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2342:x1875064559505920:12345-192.168.201.56@tcp:103: Request processed in 152us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201058.171864:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 20 00010000:00010000:0.0:1788201058.178600:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962480030800/0xa81c4c9a2f3caa56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd997e6 expref: 9 pid: 5819 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201058.178624:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570013696:192.168.201.56@tcp:104: 00010000:00010000:0.0:1788201058.178640:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624829c4600/0xa81c4c9a2f3caa4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd997df expref: 8 pid: 5820 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201058.178662:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875064570013824:192.168.201.56@tcp:104: 00010000:00010000:0.0:1788201058.178707:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.178717:0:8427:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.178722:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201058.178728:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa8e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.062740:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201059.511821:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201059.512032:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559506176 00000100:00100000:0.0:1788201059.512042:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559506176 00000100:00100000:0.0:1788201059.512106:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 132 00000100:00100000:0.0:1788201059.512115:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+8:5583:x1875064559506176:12345-192.168.201.56@tcp:101: 00010000:00010000:0.0:1788201059.512132:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201059.512151:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd99848 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.512179:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99848 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.512188:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99848 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.512196:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962481512000, rc 0) 00000100:00100000:0.0:1788201059.512259:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:5583:x1875064559506176:12345-192.168.201.56@tcp:101: Request processed in 146us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201059.512266:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 132 00000100:00100000:1.0:1788201059.517306:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201059.517521:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559506304 00000100:00100000:3.0:1788201059.517533:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559506304 00000100:00100000:3.0:1788201059.517588:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 133 00000100:00100000:3.0:1788201059.517598:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:5583:x1875064559506304:12345-192.168.201.56@tcp:501: 00000100:00100000:3.0:1788201059.518088:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:5583:x1875064559506304:12345-192.168.201.56@tcp:501: Request processed in 489us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201059.518096:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 133 00000100:00100000:3.0:1788201059.523482:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201059.523635:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559506432 00000100:00100000:2.0:1788201059.523655:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559506432 00000100:00100000:2.0:1788201059.523710:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 134 00000100:00100000:2.0:1788201059.523720:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:5583:x1875064559506432:12345-192.168.201.56@tcp:503: 00000100:00100000:2.0:1788201059.523971:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:5583:x1875064559506432:12345-192.168.201.56@tcp:503: Request processed in 252us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201059.523979:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 134 00000100:00100000:1.0:1788201059.528537:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201059.529050:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559506560 00000100:00100000:0.0:1788201059.529067:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559506560 00000100:00100000:0.0:1788201059.529126:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 135 00000100:00100000:0.0:1788201059.529136:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:6057:x1875064559506560:12345-192.168.201.56@tcp:502: 00000100:00100000:0.0:1788201059.529484:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:6057:x1875064559506560:12345-192.168.201.56@tcp:502: Request processed in 347us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201059.529492:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 135 00000100:00100000:1.0:1788201059.541107:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201059.541461:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559506688 00000100:00100000:3.0:1788201059.541475:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559506688 00000100:00100000:3.0:1788201059.541539:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 136 00000100:00100000:3.0:1788201059.541550:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:6057:x1875064559506688:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201059.542136:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:6057:x1875064559506688:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 585us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201059.542145:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 136 00000100:00100000:3.0:1788201059.551085:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201059.561666:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559506816 00000100:00100000:2.0:1788201059.561680:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559506816 00000100:00100000:2.0:1788201059.561749:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 137 00000100:00100000:2.0:1788201059.561759:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:5583:x1875064559506816:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201059.561781:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201059.561839:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3caa9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd9984f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201059.562059:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3caa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9984f expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201059.562073:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3caa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9984f expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201059.562082:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5c00, rc 0) 00000100:00100000:2.0:1788201059.562148:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5583:x1875064559506816:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 391us (11076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201059.562155:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 137 00000100:00100000:1.0:1788201059.568639:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201059.568739:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559506944 00000100:00100000:3.0:1788201059.568749:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559506944 00000100:00100000:3.0:1788201059.568809:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 138 00000100:00100000:3.0:1788201059.568818:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5583:x1875064559506944:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201059.569134:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5583:x1875064559506944:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 Request processed in 316us (503us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201059.569149:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 138 10000000:01000000:2.0:1788201059.574495:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201059.574506:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9624bfded000 from 39 10000000:01000000:2.0:1788201059.574513:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201059.574572:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c4600/0xa81c4c9a2f3caaa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201059.574586:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c4600/0xa81c4c9a2f3caaa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201059.574598:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c4600/0xa81c4c9a2f3caaa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201059.574625:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570015744:0@lo:101: 00000100:00100000:2.0:1788201059.574705:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201059.574853:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624982c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201059.579606:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570015744 00000100:00100000:0.0:1788201059.579622:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570015744 00000100:00100000:0.0:1788201059.579698:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788201059.579709:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+12:5822:x1875064570015744:12345-0@lo:101: 00010000:00010000:0.0:1788201059.579726:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201059.579744:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962481512800/0xa81c4c9a2f3caaaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3caaa3 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.579774:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962481512800/0xa81c4c9a2f3caaaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caaa3 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.580106:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962481512800/0xa81c4c9a2f3caaaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caaa3 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.580120:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962481512800, rc 0) 00000100:00100000:0.0:1788201059.580210:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:5822:x1875064570015744:12345-0@lo:101: Request processed in 502us (5503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201059.580217:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788201059.580752:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570015744:0@lo:101: 00010000:00010000:2.0:1788201059.580774:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c4600/0xa81c4c9a2f3caaa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caaaa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201059.580818:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c4600/0xa81c4c9a2f3caaa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3caaaa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201059.581576:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570015872:0@lo:501: 00000100:00100000:2.0:1788201059.581630:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201059.581741:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624982c9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201059.582729:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570015872 00000100:00100000:1.0:1788201059.582739:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570015872 00000100:00100000:1.0:1788201059.583367:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788201059.583380:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:5822:x1875064570015872:12345-0@lo:501: 00000100:00100000:1.0:1788201059.583726:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:5822:x1875064570015872:12345-0@lo:501: Request processed in 349us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201059.583734:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788201059.584244:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570015872:0@lo:501: 00000100:00100000:2.0:1788201059.584299:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570016000:0@lo:503: 00000100:00100000:2.0:1788201059.584378:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201059.584407:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624982c9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201059.584516:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570016000 00000100:00100000:3.0:1788201059.584524:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570016000 00000100:00100000:3.0:1788201059.584560:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788201059.584568:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:5822:x1875064570016000:12345-0@lo:503: 00000100:00100000:3.0:1788201059.584726:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:5822:x1875064570016000:12345-0@lo:503: Request processed in 159us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201059.584733:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788201059.585452:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570016000:0@lo:503: 00000100:00100000:1.0:1788201059.586816:0:8444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8444:1875064570016128:0@lo:502: 00000100:00100000:1.0:1788201059.587297:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201059.587375:0:8444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624885b7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201059.587634:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570016128 00000100:00100000:3.0:1788201059.587641:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570016128 00000100:00100000:3.0:1788201059.587711:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788201059.587720:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:8444:x1875064570016128:12345-0@lo:502: 00000100:00100000:3.0:1788201059.588036:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:8444:x1875064570016128:12345-0@lo:502: Request processed in 317us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201059.588044:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788201059.588706:0:8444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8444:1875064570016128:0@lo:502: 00000100:00100000:1.0:1788201059.588766:0:8444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8444:1875064570016256:0@lo:502: 00000100:00100000:1.0:1788201059.590850:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201059.590915:0:8444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624885b7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201059.591124:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570016256 00000100:00100000:0.0:1788201059.591132:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570016256 00000100:00100000:0.0:1788201059.591184:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788201059.591192:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:8444:x1875064570016256:12345-0@lo:502: 00000100:00100000:0.0:1788201059.591486:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:8444:x1875064570016256:12345-0@lo:502: Request processed in 284us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201059.591494:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788201059.592044:0:8444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8444:1875064570016256:0@lo:502: 00000040:00080000:1.0:1788201059.592089:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788201059.592373:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788201059.592394:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201059.592404:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c4600/0xa81c4c9a2f3caaa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caaaa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201059.592415:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c4600/0xa81c4c9a2f3caaa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caaaa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201059.592426:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788201059.592428:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788201059.592431:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788201059.592462:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5000/0xa81c4c9a2f3caab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201059.592470:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c5000/0xa81c4c9a2f3caab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201059.592497:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c5000/0xa81c4c9a2f3caab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201059.592515:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570016384:0@lo:101: 00000100:00100000:2.0:1788201059.592556:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201059.592590:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624982c99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201059.593590:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570016384 00000100:00100000:3.0:1788201059.593599:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570016384 00000100:00100000:3.0:1788201059.593639:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788201059.593647:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+13:5822:x1875064570016384:12345-0@lo:101: 00010000:00010000:3.0:1788201059.593661:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201059.593677:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962493610600/0xa81c4c9a2f3caab8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3caab1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.593704:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962493610600/0xa81c4c9a2f3caab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caab1 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.593714:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962493610600/0xa81c4c9a2f3caab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caab1 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.593734:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962493610600, rc 0) 00000100:00100000:3.0:1788201059.593802:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064570016384:12345-0@lo:101: Request processed in 155us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201059.593808:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788201059.598880:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570016384:0@lo:101: 00010000:00010000:2.0:1788201059.598919:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c5000/0xa81c4c9a2f3caab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caab8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201059.598932:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c5000/0xa81c4c9a2f3caab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3caab8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201059.599024:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570016512:0@lo:501: 00000100:00100000:2.0:1788201059.599086:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201059.599137:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624982c99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201059.600074:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570016512 00000100:00100000:3.0:1788201059.600087:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570016512 00000100:00100000:3.0:1788201059.600146:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788201059.600156:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064570016512:12345-0@lo:501: 00000100:00100000:3.0:1788201059.600542:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064570016512:12345-0@lo:501: Request processed in 386us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201059.600549:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788201059.600756:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570016512:0@lo:501: 00000100:00100000:2.0:1788201059.600812:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570016640:0@lo:503: 00000100:00100000:2.0:1788201059.600870:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201059.600913:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624982c99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201059.601362:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570016640 00000100:00100000:1.0:1788201059.601370:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570016640 00000100:00100000:1.0:1788201059.601415:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788201059.601423:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064570016640:12345-0@lo:503: 00000100:00100000:1.0:1788201059.601599:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064570016640:12345-0@lo:503: Request processed in 177us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201059.601606:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201059.604501:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570016640:0@lo:503: 00000100:00100000:2.0:1788201059.605704:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8445:1875064570016768:0@lo:502: 00000100:00100000:2.0:1788201059.605772:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201059.606007:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570016768 00000100:00100000:1.0:1788201059.606014:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570016768 00000100:00100000:1.0:1788201059.606068:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788201059.606077:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:8445:x1875064570016768:12345-0@lo:502: 00000100:00100000:1.0:1788201059.606328:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:8445:x1875064570016768:12345-0@lo:502: Request processed in 252us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201059.606336:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788201059.607023:0:8445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624982c9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201059.607184:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8445:1875064570016768:0@lo:502: 00000020:01000000:3.0:1788201059.607232:0:8445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201059.607242:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201059.607245:0:8445:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201059.607252:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788201059.607288:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8445:1875064570016896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201059.607336:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201059.607407:0:8445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624883f7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201059.607604:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570016896 00000100:00100000:0.0:1788201059.607610:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570016896 00000100:00100000:0.0:1788201059.607652:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788201059.607662:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:8445:x1875064570016896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201059.607880:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:8445:x1875064570016896:12345-0@lo:502:llog_process_th.0 Request processed in 219us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201059.608016:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788201059.608288:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8445:1875064570016896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201059.608316:0:8445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201059.608322:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201059.608324:0:8445:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788201059.608329:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788201059.609214:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788201059.609255:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788201059.609266:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5000/0xa81c4c9a2f3caab1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caab8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.609278:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c5000/0xa81c4c9a2f3caab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caab8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201059.609288:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201059.609291:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9624902d7800 from 39 10000000:01000000:0.0:1788201059.609294:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201059.609327:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.609334:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.609375:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201059.609398:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570017024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201059.609449:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201059.609695:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570017024 00000100:00100000:1.0:1788201059.609701:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570017024 00000100:00100000:1.0:1788201059.609745:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788201059.609754:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+14:5822:x1875064570017024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201059.609767:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201059.609796:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624c21f1800/0xa81c4c9a2f3caac6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3caabf expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201059.609820:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f1800/0xa81c4c9a2f3caac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caabf expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201059.609840:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624c21f1800/0xa81c4c9a2f3caac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caabf expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201059.609874:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f1800, rc 0) 00000100:00100000:1.0:1788201059.610046:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064570017024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 293us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201059.610052:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788201059.610642:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962484d50900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201059.610666:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570017024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201059.610681:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.610699:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201059.610759:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570017152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201059.613366:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201059.613421:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962484d50900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201059.613859:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570017152 00000100:00100000:1.0:1788201059.613869:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570017152 00000100:00100000:1.0:1788201059.613929:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788201059.613939:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064570017152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201059.614260:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064570017152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201059.614268:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788201059.614472:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570017152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201059.614544:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570017280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201059.614592:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201059.614622:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624883f7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201059.614801:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570017280 00000100:00100000:1.0:1788201059.614806:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570017280 00000100:00100000:1.0:1788201059.614841:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788201059.614849:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064570017280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201059.615810:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064570017280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 955us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201059.615827:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788201059.620606:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570017280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201059.621538:0:8446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8446:1875064570017408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201059.621609:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201059.621749:0:8446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624883f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201059.622625:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570017408 00000100:00100000:1.0:1788201059.622634:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570017408 00000100:00100000:1.0:1788201059.622734:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788201059.622744:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:8446:x1875064570017408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201059.624434:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:8446:x1875064570017408:12345-0@lo:502:llog_process_th.0 Request processed in 1683us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201059.624446:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788201059.624646:0:8446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8446:1875064570017408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201059.624713:0:8446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8446:1875064570017536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201059.624758:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201059.628889:0:8446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624883f7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201059.630198:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570017536 00000100:00100000:0.0:1788201059.630211:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570017536 00000100:00100000:0.0:1788201059.630432:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788201059.630443:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:8446:x1875064570017536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201059.631164:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:8446:x1875064570017536:12345-0@lo:502:llog_process_th.0 Request processed in 720us (6402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201059.631174:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788201059.637316:0:8446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8446:1875064570017536:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201059.637387:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788201059.637699:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788201059.637727:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201059.637739:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.637752:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201059.637764:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788201059.637766:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788201059.637769:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201059.637829:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.637865:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.637875:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201059.638114:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570017664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201059.638175:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201059.638238:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962484d50cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201059.638409:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570017664 00000100:00100000:1.0:1788201059.638416:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570017664 00000100:00100000:1.0:1788201059.638468:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788201059.638477:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+15:5822:x1875064570017664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201059.638491:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201059.638504:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3caad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3caacd expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201059.638528:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3caad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caacd expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201059.638539:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3caad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caacd expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201059.638547:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f1a00, rc 0) 00000100:00100000:1.0:1788201059.638593:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570017664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201059.638599:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788201059.640568:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570017664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201059.640593:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.640604:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201059.640690:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570017792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201059.640743:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201059.640802:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962484d50cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201059.641130:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570017792 00000100:00100000:1.0:1788201059.641136:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570017792 00000100:00100000:1.0:1788201059.641182:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788201059.641189:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570017792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201059.642422:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570017792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1226us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201059.642435:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788201059.649486:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570017792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201059.649714:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570017920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201059.649809:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201059.649862:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962484d50cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201059.649983:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570017920 00000100:00100000:3.0:1788201059.649989:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570017920 00000100:00100000:3.0:1788201059.650056:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788201059.650063:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570017920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201059.650271:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570017920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201059.650278:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788201059.650687:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570017920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201059.651509:0:8447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8447:1875064570018048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201059.651564:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201059.651598:0:8447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624885b7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201059.651654:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570018048 00000100:00100000:2.0:1788201059.651664:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570018048 00000100:00100000:2.0:1788201059.651698:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788201059.651704:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:8447:x1875064570018048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201059.652026:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:8447:x1875064570018048:12345-0@lo:502:llog_process_th.0 Request processed in 320us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201059.652033:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788201059.652753:0:8447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8447:1875064570018048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201059.652794:0:8447:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201059.652803:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201059.652805:0:8447:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788201059.652810:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788201059.652841:0:8447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8447:1875064570018176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201059.653037:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201059.653086:0:8447:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b37900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201059.653452:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570018176 00000100:00100000:3.0:1788201059.653459:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570018176 00000100:00100000:3.0:1788201059.653515:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788201059.653524:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:8447:x1875064570018176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201059.653736:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:8447:x1875064570018176:12345-0@lo:502:llog_process_th.0 Request processed in 213us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201059.653742:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788201059.654447:0:8447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8447:1875064570018176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201059.654482:0:8447:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201059.654488:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201059.654490:0:8447:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788201059.654494:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788201059.654686:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788201059.654710:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788201059.654730:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.654743:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201059.654755:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201059.654759:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9624902af800 from 39 10000000:01000000:0.0:1788201059.654762:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201059.654812:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481513a00/0xa81c4c9a2f3caadb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.655016:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962481513a00/0xa81c4c9a2f3caadb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.655030:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962481513a00/0xa81c4c9a2f3caadb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201059.655052:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570018304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201059.655100:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201059.655134:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962484d50cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201059.655633:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570018304 00000100:00100000:3.0:1788201059.655641:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570018304 00000100:00100000:3.0:1788201059.655681:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201059.655690:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570018304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201059.655703:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201059.655717:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962493610000/0xa81c4c9a2f3caae2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3caadb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.655743:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962493610000/0xa81c4c9a2f3caae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caadb expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.655753:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962493610000/0xa81c4c9a2f3caae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caadb expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.655762:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962493610000, rc 0) 00000100:00100000:3.0:1788201059.655829:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570018304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201059.656417:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788201059.656526:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570018304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201059.656543:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962481513a00/0xa81c4c9a2f3caadb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caae2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201059.656554:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962481513a00/0xa81c4c9a2f3caadb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3caae2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201059.656620:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570018432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201059.656659:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201059.656787:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624885b7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201059.661861:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570018432 00000100:00100000:2.0:1788201059.661876:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570018432 00000100:00100000:2.0:1788201059.662269:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788201059.662278:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570018432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201059.662757:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570018432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 479us (6096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201059.662765:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788201059.670588:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570018432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201059.670666:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570018560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201059.670767:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201059.671408:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570018560 00000100:00100000:3.0:1788201059.671417:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570018560 00000100:00100000:3.0:1788201059.671467:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788201059.671477:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570018560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201059.671790:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624885b7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201059.679958:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570018560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 8473us (9181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201059.679973:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788201059.680164:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570018560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201059.680745:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96249058bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8448:1875064570018688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201059.680804:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201059.680852:0:8448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624982c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201059.680900:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570018688 00000100:00100000:1.0:1788201059.680908:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570018688 00000100:00100000:1.0:1788201059.680948:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788201059.680955:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:8448:x1875064570018688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201059.681203:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:8448:x1875064570018688:12345-0@lo:502:llog_process_th.0 Request processed in 247us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201059.681210:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788201059.681436:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96249058bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8448:1875064570018688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201059.681486:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8448:1875064570018816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201059.681517:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201059.681540:0:8448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba849b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201059.681726:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570018816 00000100:00100000:2.0:1788201059.681731:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570018816 00000100:00100000:2.0:1788201059.681763:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788201059.681769:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:8448:x1875064570018816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201059.682191:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:8448:x1875064570018816:12345-0@lo:502:llog_process_th.0 Request processed in 420us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201059.682197:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788201059.686621:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8448:1875064570018816:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788201059.686769:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788201059.687107:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788201059.687136:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201059.687147:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481513a00/0xa81c4c9a2f3caadb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caae2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.687159:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962481513a00/0xa81c4c9a2f3caadb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caae2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201059.687170:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788201059.687188:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788201059.687191:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201059.687248:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481512200/0xa81c4c9a2f3caae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.687257:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962481512200/0xa81c4c9a2f3caae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.687268:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962481512200/0xa81c4c9a2f3caae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201059.687290:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570018944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201059.687392:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201059.687434:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962484d50900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201059.687621:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570018944 00000100:00100000:3.0:1788201059.687628:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570018944 00000100:00100000:3.0:1788201059.687676:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788201059.687684:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570018944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201059.687699:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201059.687713:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962493611600/0xa81c4c9a2f3caaf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3caae9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.687737:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962493611600/0xa81c4c9a2f3caaf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caae9 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.687745:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962493611600/0xa81c4c9a2f3caaf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caae9 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.687753:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962493611600, rc 0) 00000100:00100000:3.0:1788201059.687798:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570018944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201059.687805:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788201059.688084:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570018944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201059.688098:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962481512200/0xa81c4c9a2f3caae9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caaf0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201059.688107:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962481512200/0xa81c4c9a2f3caae9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3caaf0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201059.688163:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570019072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201059.688194:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201059.688221:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962484d50900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201059.688316:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570019072 00000100:00100000:2.0:1788201059.688320:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570019072 00000100:00100000:2.0:1788201059.688379:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788201059.688387:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570019072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201059.688647:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570019072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201059.688654:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788201059.688774:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570019072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201059.688805:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570019200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201059.688842:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201059.689099:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962484d50900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201059.693307:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570019200 00000100:00100000:1.0:1788201059.693324:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570019200 00000100:00100000:0.0:1788201059.693531:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788201059.693542:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570019200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201059.693832:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570019200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 291us (4988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201059.693841:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788201059.696442:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570019200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201059.699122:0:8449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8449:1875064570019328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201059.699214:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201059.699409:0:8449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c800c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201059.711015:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570019328 00000100:00100000:2.0:1788201059.711031:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570019328 00000100:00100000:2.0:1788201059.711098:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788201059.711109:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:8449:x1875064570019328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201059.711448:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:8449:x1875064570019328:12345-0@lo:502:llog_process_th.0 Request processed in 340us (12233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201059.711456:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788201059.711670:0:8449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8449:1875064570019328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201059.711709:0:8449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201059.711719:0:8449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201059.711722:0:8449:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788201059.711728:0:8449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788201059.711764:0:8449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8449:1875064570019456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201059.711809:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201059.711863:0:8449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624885b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201059.712146:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570019456 00000100:00100000:0.0:1788201059.712153:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570019456 00000100:00100000:0.0:1788201059.712185:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788201059.712193:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:8449:x1875064570019456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201059.712424:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:8449:x1875064570019456:12345-0@lo:502:llog_process_th.0 Request processed in 230us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201059.712431:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788201059.712755:0:8449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8449:1875064570019456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201059.712781:0:8449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201059.712786:0:8449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201059.712788:0:8449:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788201059.712792:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788201059.713131:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788201059.713152:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788201059.713163:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481512200/0xa81c4c9a2f3caae9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caaf0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.713260:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962481512200/0xa81c4c9a2f3caae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caaf0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201059.713271:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788201059.713273:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff962485b40000 from 1 10000000:01000000:3.0:1788201059.713276:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788201059.713304:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.713312:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.713321:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201059.713371:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570019584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201059.713417:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201059.713452:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba849cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201059.713583:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570019584 00000100:00100000:2.0:1788201059.713591:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570019584 00000100:00100000:2.0:1788201059.713633:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788201059.713641:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570019584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201059.713655:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201059.713668:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624829c4c00/0xa81c4c9a2f3caafe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3caaf7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201059.713690:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624829c4c00/0xa81c4c9a2f3caafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caaf7 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201059.713699:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624829c4c00/0xa81c4c9a2f3caafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caaf7 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201059.713720:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c4c00, rc 0) 00000100:00100000:2.0:1788201059.713755:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570019584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201059.713761:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788201059.714068:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570019584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201059.714081:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.714090:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201059.714138:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570019712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201059.714164:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201059.714190:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba849cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201059.714981:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570019712 00000100:00100000:2.0:1788201059.714988:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570019712 00000100:00100000:2.0:1788201059.715033:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788201059.715041:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570019712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201059.715304:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570019712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (1139us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201059.715312:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788201059.715494:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570019712:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788201059.715525:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788201059.715533:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201059.715543:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201060.086632:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201060.919249:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570019840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201060.919379:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201060.919674:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570019840 00000100:00100000:1.0:1788201060.919685:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570019840 00000100:00100000:1.0:1788201060.919834:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201060.919852:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570019840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201060.919904:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201060.919991:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570019840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201060.920000:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788201060.920059:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962490589880 x1875064570019840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201060.920082:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570019840:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201060.921207:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201061.114063:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201061.385291:0:8486:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe651a1fb0 20000000:00000080:3.0:1788201061.385309:0:8486:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9624b9e31800 uarg=0000000000000000 20000000:01000000:3.0:1788201061.385696:0:8486:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788201061.385701:0:8486:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788201061.385707:0:8486:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788201061.386713:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788201061.386870:0:8486:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788201061.391194:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788201061.391255:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788201061.391309:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788201061.391336:0:8486:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788201061.391395:0:8486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.391413:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962480030000/0xa81c4c9a2f3ca87a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca873 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.391422:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca8dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca8d5 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.391429:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3ca9a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3ca9a0 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.391453:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3caa64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99817 expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.391461:0:8486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.391502:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3caa64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99817 expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.391518:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3caa64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99817 expref: 9 pid: 5820 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201061.392624:0:8486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875064570019968:192.168.201.56@tcp:104: 00010000:00010000:3.0:1788201061.392801:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3ca9a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9a0 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.392811:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3ca9a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9a0 expref: 18 pid: 5818 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201061.392821:0:8486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875064570020096:0@lo:104: 00000100:00100000:3.0:1788201061.392864:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201061.392913:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8d5 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.392920:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca8dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8d5 expref: 18 pid: 5820 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201061.392928:0:8486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875064570020224:0@lo:104: 00000100:00100000:3.0:1788201061.392980:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201061.393018:0:5808:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201061.393031:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570020096 00000100:00100000:3.0:1788201061.393039:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570020096 00000100:00100000:3.0:1788201061.393084:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570020224 00000100:00100000:3.0:1788201061.393087:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570020224 00000100:00100000:3.0:1788201061.393101:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201061.393109:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+4:8486:x1875064570020096:12345-0@lo:104: 00010000:00010000:3.0:1788201061.393124:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca9a7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.393178:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201061.393183:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+4:8486:x1875064570020096:12345-0@lo:104: Request processed in 75us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201061.393191:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201061.393212:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201061.393219:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1eab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:8486:x1875064570020224:12345-0@lo:104: 00010000:00010000:3.0:1788201061.393226:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca8dc expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.393259:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201061.393264:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1eab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:8486:x1875064570020224:12345-0@lo:104: Request processed in 46us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201061.393270:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788201061.393309:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201061.393315:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca9a7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.393324:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5a00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:3.0:1788201061.393333:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca9a7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.393368:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca9a7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201061.393376:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca9a7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201061.393383:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201061.393410:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9a7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.393416:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201061.393434:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9a7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.393440:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3ca9a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca9a7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.393453:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201061.393456:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca8dc expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.393462:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624c21f1e00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:3.0:1788201061.393465:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca8dc expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.393470:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca8dc expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201061.393488:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca8dc expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201061.393493:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201061.393508:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca8dc expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.393513:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201061.393519:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca8dc expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.393717:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624c21f1e00/0xa81c4c9a2f3ca8d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca8dc expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.393727:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201061.393729:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201061.393730:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201061.393818:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962480030000/0xa81c4c9a2f3ca87a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3ca873 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.393828:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962480030000/0xa81c4c9a2f3ca87a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca873 expref: 18 pid: 5818 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201061.393839:0:8486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875064570020608:0@lo:104: 00000100:00100000:3.0:1788201061.393867:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201061.393930:0:8486:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba849e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201061.393951:0:8486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875064570020096:0@lo:104: 00000100:00100000:3.0:1788201061.393959:0:8486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875064570020224:0@lo:104: 00010000:00010000:1.0:1788201061.397129:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201061.397173:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570020352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201061.397244:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201061.397288:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201061.397295:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570020480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201061.397316:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201061.397467:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570020352 00000100:00100000:0.0:1788201061.397475:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570020352 00010000:00010000:0.0:1788201061.397515:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3ca9a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9a0 expref: 19 pid: 5818 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201061.397555:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570020480 00000100:00100000:0.0:1788201061.397567:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570020480 00010000:00010000:0.0:1788201061.397580:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca8dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8d5 expref: 20 pid: 5820 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201061.397594:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788201061.397602:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+20:3284:x1875064570020352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201061.397629:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201061.397635:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3ca9a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9a0 expref: 20 pid: 5818 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201061.397646:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3ca9a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9a0 expref: 20 pid: 5818 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201061.397663:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3ca9a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca9a0 expref: 20 pid: 5818 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201061.397679:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201061.397716:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570020352:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201061.397722:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788201061.397738:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201061.397757:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3284:x1875064570020480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201061.397768:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201061.397772:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca8dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8d5 expref: 18 pid: 5820 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201061.397781:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8d5 expref: 18 pid: 5820 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201061.397791:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f1200/0xa81c4c9a2f3ca8dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca8d5 expref: 18 pid: 5820 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201061.397799:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201061.397821:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3284:x1875064570020480:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201061.397837:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201061.398141:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570020480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201061.398151:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570020352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201061.398234:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570020608 00000100:00100000:2.0:1788201061.398239:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570020608 00000100:00100000:2.0:1788201061.398539:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201061.398547:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:8486:x1875064570020608:12345-0@lo:104: 00010000:00010000:2.0:1788201061.398570:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624829c5200/0xa81c4c9a2f3ca873 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca87a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201061.398629:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201061.398635:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:8486:x1875064570020608:12345-0@lo:104: Request processed in 90us (4768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201061.398641:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788201061.398819:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201061.398832:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624829c5200/0xa81c4c9a2f3ca873 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3ca87a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.398840:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5200 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:3.0:1788201061.398844:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5200/0xa81c4c9a2f3ca873 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3ca87a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.398853:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624829c5200/0xa81c4c9a2f3ca873 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3ca87a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201061.398860:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5200/0xa81c4c9a2f3ca873 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3ca87a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201061.398866:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201061.398897:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624829c5200/0xa81c4c9a2f3ca873 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca87a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.398903:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201061.398923:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624829c5200/0xa81c4c9a2f3ca873 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca87a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.398930:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624829c5200/0xa81c4c9a2f3ca873 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3ca87a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.398947:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201061.398949:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201061.398951:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201061.398972:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570020736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201061.399008:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201061.399058:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570020736 00000100:00100000:3.0:1788201061.399063:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570020736 00010000:00010000:3.0:1788201061.399087:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962480030000/0xa81c4c9a2f3ca87a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca873 expref: 17 pid: 5818 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201061.399107:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201061.399114:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba198e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3282:x1875064570020736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201061.399123:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201061.399128:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962480030000/0xa81c4c9a2f3ca87a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca873 expref: 17 pid: 5818 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.399137:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962480030000/0xa81c4c9a2f3ca87a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca873 expref: 17 pid: 5818 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.399150:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201061.399176:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba198e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3282:x1875064570020736:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201061.399182:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201061.399212:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570020736:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201061.399457:0:8486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962480030000/0xa81c4c9a2f3ca87a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3ca873 expref: 16 pid: 5818 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201061.399470:0:8486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875064570020608:0@lo:104: 00000100:00100000:1.0:1788201061.400249:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201061.400902:0:8486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875064570019968:192.168.201.56@tcp:104: 00010000:00010000:0.0:1788201061.400935:0:8486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201061.401878:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559507072 00000100:00100000:3.0:1788201061.401888:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559507072 00010000:00010000:3.0:1788201061.401923:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3caa64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99817 expref: 10 pid: 5820 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201061.402141:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:3.0:1788201061.402151:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2341:x1875064559507072:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201061.402167:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201061.402173:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3caa64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99817 expref: 10 pid: 5820 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.402184:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3caa64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99817 expref: 10 pid: 5820 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.402213:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3caa64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99817 expref: 10 pid: 5820 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.402227:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.402234:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.402248:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.402254:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.402260:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.402267:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.402273:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962493611a00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:3.0:1788201061.402277:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.402283:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.402304:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201061.402323:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201061.402394:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:2341:x1875064559507072:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 244us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201061.402401:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 24 00010000:00010000:2.0:1788201061.402632:0:8486:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201061.402641:0:8486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201061.402651:0:8486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab05 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201062.144683:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201062.195133:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201062.195196:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201062.195247:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201062.195286:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201062.195310:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559507328 00000100:00100000:1.0:1788201062.195312:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559507456 00000100:00100000:1.0:1788201062.195320:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559507456 00000100:00100000:2.0:1788201062.195320:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559507328 00000100:00100000:3.0:1788201062.195373:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559507200 00000100:00100000:3.0:1788201062.195377:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559507200 00000100:00100000:2.0:1788201062.195403:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:3.0:1788201062.195403:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 171 00000100:00100000:2.0:1788201062.195413:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2344:x1875064559507328:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201062.195413:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:2344:x1875064559507200:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201062.195499:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2344:x1875064559507328:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 87us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201062.195507:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:0.0:1788201062.195509:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559507584 00000100:00100000:0.0:1788201062.195513:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559507584 00000100:00100000:1.0:1788201062.199139:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:1.0:1788201062.199157:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2344:x1875064559507456:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201062.199365:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:0.0:1788201062.199374:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2344:x1875064559507584:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201062.199687:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:2344:x1875064559507200:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 4272us (4562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201062.199698:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 171 00000100:00080000:2.0:1788201062.202784:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201062.202795:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201062.202799:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201062.205888:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2344:x1875064559507584:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 6504us (10589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201062.205904:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:1.0:1788201062.207362:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2344:x1875064559507456:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 8186us (12139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201062.207376:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:3.0:1788201062.969017:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570020864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201062.969096:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201062.969768:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570020864 00000100:00100000:0.0:1788201062.969778:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570020864 00000100:00100000:0.0:1788201062.969857:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201062.969867:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570020864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201062.969907:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201062.969980:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570020864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201062.969987:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788201062.970035:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0d880 x1875064570020864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201062.970077:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570020864:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201062.970237:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201062.972409:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570021120:0@lo:400:kworker.0 00000100:00100000:3.0:1788201062.972514:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201062.972554:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788201062.972581:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570020992:0@lo:400:kworker.0 00000100:00100000:3.0:1788201062.972611:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201062.972635:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570021504:0@lo:400:kworker.0 00000100:00100000:3.0:1788201062.972656:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201062.972685:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570021120 00000100:00100000:3.0:1788201062.972692:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570021120 00000100:00100000:1.0:1788201062.972824:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570020992 00000100:00100000:1.0:1788201062.972828:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570020992 00000100:00100000:1.0:1788201062.972862:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788201062.972871:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570020992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201062.972921:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570020992:12345-0@lo:400:kworker.0 Request processed in 51us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201062.972927:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788201062.972984:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570020992:0@lo:400:kworker.0 00000100:00100000:3.0:1788201062.973239:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570021504 00000100:00100000:3.0:1788201062.973243:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570021504 00000100:00100000:3.0:1788201062.973286:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201062.973292:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570021120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201062.973329:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570021120:12345-0@lo:400:kworker.0 Request processed in 37us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201062.973336:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201062.973372:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201062.973379:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570021504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201062.973409:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570021504:12345-0@lo:400:kworker.0 Request processed in 30us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201062.973424:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788201062.973447:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201062.973460:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570021376:0@lo:400:kworker.0 00000100:00100000:3.0:1788201062.973487:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201062.973509:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201062.973515:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570021248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201062.973536:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201062.973713:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570021376 00000100:00100000:3.0:1788201062.973727:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570021376 00000100:00100000:3.0:1788201062.973763:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201062.973769:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570021376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201062.973804:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570021376:12345-0@lo:400:kworker.0 Request processed in 35us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201062.973810:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788201062.973828:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201062.973835:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570021248 00000100:00100000:3.0:1788201062.973839:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570021248 00000100:00100000:3.0:1788201062.973863:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788201062.973876:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570021248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201062.973906:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570021248:12345-0@lo:400:kworker.0 Request processed in 31us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201062.973911:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788201062.973926:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201062.973960:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570021504:0@lo:400:kworker.0 00000100:00100000:3.0:1788201062.973971:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570021120:0@lo:400:kworker.0 00000100:00100000:3.0:1788201062.973996:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570021248:0@lo:400:kworker.0 00010000:00080000:3.0:1788201062.974007:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba199180 x1875064570021376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201062.974017:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570021376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201063.097199:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201063.098610:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559507712 00000100:00100000:2.0:1788201063.098622:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559507712 00000100:00100000:2.0:1788201063.098683:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 173 00000100:00100000:2.0:1788201063.098694:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:5583:x1875064559507712:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201063.098711:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201063.098732:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624829c5800/0xa81c4c9a2f3cab0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd99856 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201063.098761:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624829c5800/0xa81c4c9a2f3cab0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99856 expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201063.098772:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624829c5800/0xa81c4c9a2f3cab0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99856 expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201063.098793:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5800, rc 0) 00000100:00100000:2.0:1788201063.098854:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5583:x1875064559507712:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 162us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201063.098861:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 173 00000100:00100000:1.0:1788201063.108448:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201063.109361:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559507840 00000100:00100000:3.0:1788201063.109373:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559507840 00000100:00100000:3.0:1788201063.109436:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 174 00000100:00100000:3.0:1788201063.109446:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5583:x1875064559507840:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201063.109868:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5583:x1875064559507840:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 Request processed in 421us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201063.109877:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 174 00000100:00100000:1.0:1788201063.120124:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201063.120283:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559507968 00000100:00100000:3.0:1788201063.120293:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559507968 00000100:00100000:3.0:1788201063.120361:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 175 00000100:00100000:3.0:1788201063.120372:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5583:x1875064559507968:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201063.120616:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5583:x1875064559507968:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 Request processed in 245us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201063.120633:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 175 00000100:00100000:1.0:1788201063.135273:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201063.136278:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559508096 00000100:00100000:2.0:1788201063.136291:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559508096 00000100:00100000:2.0:1788201063.136337:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 176 00000100:00100000:2.0:1788201063.136364:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:6120:x1875064559508096:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201063.136637:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:6120:x1875064559508096:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 274us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201063.136644:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 176 00000100:00100000:1.0:1788201063.144909:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201063.144992:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559508224 00000100:00100000:2.0:1788201063.145002:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559508224 00000100:00100000:2.0:1788201063.145064:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 177 00000100:00100000:2.0:1788201063.145074:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:6120:x1875064559508224:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201063.145320:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:6120:x1875064559508224:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 248us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201063.145329:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 177 00010000:00010000:3.0:1788201063.169185:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788201063.286857:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201063.286865:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9624bfded000 from 4 10000000:01000000:1.0:1788201063.286871:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201063.286921:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201063.286957:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201063.286968:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201063.286995:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570021632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201063.287068:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201063.287141:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9f62480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201063.288852:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570021632 00000100:00100000:3.0:1788201063.288867:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570021632 00000100:00100000:3.0:1788201063.288944:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788201063.288956:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570021632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201063.288978:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201063.288996:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962493611e00/0xa81c4c9a2f3cab1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cab13 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201063.289023:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962493611e00/0xa81c4c9a2f3cab1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab13 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201063.289034:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962493611e00/0xa81c4c9a2f3cab1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab13 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201063.289042:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962493611e00, rc 0) 00000100:00100000:3.0:1788201063.289126:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570021632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201063.289132:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788201063.290425:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570021632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201063.290451:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201063.290463:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cab1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201063.290536:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570021760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201063.290579:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201063.290620:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9f62480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201063.290846:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570021760 00000100:00100000:2.0:1788201063.290852:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570021760 00000100:00100000:2.0:1788201063.290891:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788201063.290898:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570021760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201063.291164:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570021760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201063.291181:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788201063.291379:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570021760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201063.291508:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570021888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201063.291609:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201063.291637:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9f62480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201063.291685:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570021888 00000100:00100000:1.0:1788201063.291689:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570021888 00000100:00100000:1.0:1788201063.291776:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788201063.291784:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570021888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201063.291999:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570021888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201063.292005:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788201063.295230:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570021888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201063.296028:0:8555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8555:1875064570022016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201063.296112:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201063.296162:0:8555:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9f626c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201063.296223:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570022016 00000100:00100000:3.0:1788201063.296231:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570022016 00000100:00100000:3.0:1788201063.296289:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788201063.296300:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:8555:x1875064570022016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201063.297087:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:8555:x1875064570022016:12345-0@lo:502:llog_process_th.0 Request processed in 784us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201063.297105:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788201063.297220:0:8555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8555:1875064570022016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201063.297264:0:8555:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201063.297273:0:8555:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201063.297275:0:8555:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788201063.297280:0:8555:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624bfded000 00000020:00000080:1.0:1788201063.297283:0:8555:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788201063.297394:0:8555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8555:1875064570022144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201063.297445:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201063.297475:0:8555:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9f626c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201063.297652:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570022144 00000100:00100000:0.0:1788201063.297657:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570022144 00000100:00100000:0.0:1788201063.297696:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788201063.297705:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:8555:x1875064570022144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201063.297869:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:8555:x1875064570022144:12345-0@lo:502:llog_process_th.0 Request processed in 164us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201063.297875:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788201063.299584:0:8555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8555:1875064570022144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201063.299635:0:8555:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201063.299644:0:8555:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201063.299646:0:8555:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788201063.299651:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788201063.306891:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788201063.306944:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201063.306957:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201063.306970:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201063.306983:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201063.306985:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9624902d7800 from 4 10000000:01000000:0.0:1788201063.306989:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201063.307032:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201063.307041:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201063.307053:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201063.307094:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570022272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201063.307173:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201063.307227:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b36180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201063.307336:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570022272 00000100:00100000:2.0:1788201063.307368:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570022272 00000100:00100000:2.0:1788201063.307410:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788201063.307431:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570022272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201063.307446:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201063.307459:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cab28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cab21 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201063.307485:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cab28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab21 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201063.307496:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cab28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab21 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201063.307505:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5e00, rc 0) 00000100:00100000:2.0:1788201063.307546:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570022272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201063.307552:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788201063.307980:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570022272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201063.307995:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab28 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201063.308004:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cab28 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201063.308058:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570022400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201063.308085:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201063.308119:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b36180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201063.308171:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570022400 00000100:00100000:2.0:1788201063.308176:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570022400 00000100:00100000:2.0:1788201063.308208:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788201063.308217:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570022400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201063.308511:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570022400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201063.308527:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788201063.308727:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570022400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201063.308759:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570022528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201063.308800:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201063.308830:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b36180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201063.308941:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570022528 00000100:00100000:2.0:1788201063.308946:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570022528 00000100:00100000:2.0:1788201063.308977:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788201063.308985:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570022528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201063.309122:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570022528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201063.309129:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788201063.309423:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570022528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201063.312726:0:8557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8557:1875064570022656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201063.312815:0:8557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201063.313222:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570022656 00000100:00100000:3.0:1788201063.313230:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570022656 00000100:00100000:3.0:1788201063.313298:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788201063.313309:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:8557:x1875064570022656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201063.313573:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:8557:x1875064570022656:12345-0@lo:502:llog_process_th.0 Request processed in 265us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201063.313580:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788201063.313805:0:8557:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b36240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201063.313831:0:8557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8557:1875064570022656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201063.313863:0:8557:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201063.313881:0:8557:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201063.313883:0:8557:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788201063.313890:0:8557:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624902d7800 00000020:00000080:0.0:1788201063.313894:0:8557:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788201063.313988:0:8557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8557:1875064570022784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201063.314026:0:8557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201063.314045:0:8557:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba849480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201063.314740:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570022784 00000100:00100000:1.0:1788201063.314747:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570022784 00000100:00100000:1.0:1788201063.314786:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788201063.314794:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:8557:x1875064570022784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201063.314989:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:8557:x1875064570022784:12345-0@lo:502:llog_process_th.0 Request processed in 195us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201063.315006:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788201063.315183:0:8557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8557:1875064570022784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201063.315210:0:8557:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201063.315216:0:8557:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201063.315217:0:8557:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788201063.315222:0:8557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788201063.315478:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788201063.315496:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201063.315507:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab28 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201063.315517:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab28 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201063.315527:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201063.315529:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9624902af800 from 4 10000000:01000000:3.0:1788201063.315533:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201063.315570:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201063.315579:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201063.315588:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201063.315606:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570022912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201063.315647:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201063.315674:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff96249027b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201063.315693:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570022912 00000100:00100000:3.0:1788201063.315697:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570022912 00000100:00100000:3.0:1788201063.315734:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788201063.315742:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570022912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201063.315752:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201063.315764:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3cab36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cab2f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201063.315788:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3cab36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab2f expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201063.315796:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3cab36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab2f expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201063.315804:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962493610e00, rc 0) 00000100:00100000:3.0:1788201063.315834:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570022912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201063.315841:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788201063.315876:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570022912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201063.315889:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201063.315896:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cab36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201063.315949:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570023040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201063.315992:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201063.316006:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff96249027b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201063.316018:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570023040 00000100:00100000:3.0:1788201063.316021:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570023040 00000100:00100000:3.0:1788201063.316039:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788201063.316044:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570023040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201063.316255:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570023040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201063.316261:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788201063.316288:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570023040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201063.316312:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570023168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201063.316377:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201063.316390:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff96249027b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201063.316401:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570023168 00000100:00100000:3.0:1788201063.316405:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570023168 00000100:00100000:3.0:1788201063.316421:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788201063.316428:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570023168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201063.316546:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570023168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201063.316552:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788201063.316586:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570023168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201063.317173:0:8558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8558:1875064570023296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201063.317210:0:8558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201063.317232:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570023296 00000100:00100000:3.0:1788201063.317242:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570023296 00000100:00100000:3.0:1788201063.317266:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788201063.317272:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:8558:x1875064570023296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201063.317438:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:8558:x1875064570023296:12345-0@lo:502:llog_process_th.0 Request processed in 165us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201063.317445:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788201063.317475:0:8558:0:(client.c:2702:ptlrpc_set_wait()) set ffff96249027ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201063.317489:0:8558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8558:1875064570023296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201063.317513:0:8558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201063.317522:0:8558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201063.317524:0:8558:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201063.317531:0:8558:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624902af800 00000020:00000080:3.0:1788201063.317534:0:8558:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788201063.317778:0:8558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8558:1875064570023424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201063.317810:0:8558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201063.317829:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570023424 00000100:00100000:3.0:1788201063.317832:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570023424 00000100:00100000:3.0:1788201063.317851:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788201063.317857:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:8558:x1875064570023424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201063.317980:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:8558:x1875064570023424:12345-0@lo:502:llog_process_th.0 Request processed in 122us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201063.317987:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788201063.318014:0:8558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624900cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201063.318025:0:8558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:8558:1875064570023424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201063.318041:0:8558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201063.318045:0:8558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201063.318051:0:8558:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788201063.318055:0:8558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788201063.318101:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788201063.318117:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201063.318125:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201063.318134:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201064.182949:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201065.206505:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201066.039054:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570023552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201066.039144:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201066.039224:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570023552 00000100:00100000:1.0:1788201066.039232:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570023552 00000100:00100000:1.0:1788201066.039280:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201066.039289:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570023552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201066.039322:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788201066.040068:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201066.041173:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570023552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1879us (2022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201066.041184:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788201066.052020:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c21500 x1875064570023552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201066.052049:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570023552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201066.234654:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201067.254527:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201067.319590:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201067.319636:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201067.319680:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201067.319708:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201067.319751:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559508736 00000100:00100000:2.0:1788201067.319761:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559508736 00000100:00100000:2.0:1788201067.319816:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559508608 00000100:00100000:2.0:1788201067.319819:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559508608 00000100:00100000:2.0:1788201067.319845:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:2.0:1788201067.319856:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2343:x1875064559508736:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201067.319947:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2343:x1875064559508736:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 93us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201067.319955:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:2.0:1788201067.319972:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:2.0:1788201067.319978:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2343:x1875064559508608:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201067.320015:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2343:x1875064559508608:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 36us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201067.320036:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00080000:2.0:1788201067.320058:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201067.320062:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201067.321938:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559508480 00000100:00100000:3.0:1788201067.321950:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559508480 00000100:00100000:3.0:1788201067.322064:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:3.0:1788201067.322075:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96249058aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2343:x1875064559508480:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201067.322148:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96249058aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2343:x1875064559508480:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 75us (2571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201067.322155:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:3.0:1788201067.322194:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559508352 00000100:00100000:3.0:1788201067.322198:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559508352 00000100:00100000:3.0:1788201067.322224:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 193 00000100:00100000:3.0:1788201067.322231:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2343:x1875064559508352:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201067.322257:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2343:x1875064559508352:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 27us (2576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201067.322274:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 193 00000100:00080000:2.0:1788201067.322630:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201068.086643:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570023680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201068.086751:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201068.087552:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570023680 00000100:00100000:1.0:1788201068.087567:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570023680 00000100:00100000:1.0:1788201068.088156:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201068.088174:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570023680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201068.088228:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201068.088321:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570023680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201068.089191:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570024064:0@lo:400:kworker.0 00000100:00100000:3.0:1788201068.089257:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201068.089297:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201068.089303:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570023936:0@lo:400:kworker.0 00000100:00100000:3.0:1788201068.089326:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201068.089552:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201068.089611:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570024192:0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.089662:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788201068.089912:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0d880 x1875064570023680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201068.090261:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570024064 00000100:00100000:3.0:1788201068.090269:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570024064 00000100:00100000:1.0:1788201068.090427:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570023680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201068.090454:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201068.090460:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570023808:0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.090501:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201068.090532:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570024320:0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.090555:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201068.090584:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570024192 00000100:00100000:1.0:1788201068.090587:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570024192 00000100:00100000:1.0:1788201068.090623:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788201068.090799:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201068.090806:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201068.090808:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201068.090832:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570023808 00000100:00100000:0.0:1788201068.090836:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570023808 00000100:00100000:0.0:1788201068.090880:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788201068.090889:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570023808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201068.090969:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570023808:12345-0@lo:400:kworker.0 Request processed in 81us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201068.090977:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788201068.091030:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570023808:0@lo:400:kworker.0 00000100:00100000:3.0:1788201068.092493:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570023936 00000100:00100000:3.0:1788201068.092511:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570023936 00000100:00100000:3.0:1788201068.092558:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570024320 00000100:00100000:3.0:1788201068.092562:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570024320 00000100:00100000:3.0:1788201068.092601:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788201068.092613:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570024064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.093035:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570024192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.093117:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570024192:12345-0@lo:400:kworker.0 Request processed in 189us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201068.093126:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201068.093172:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201068.093181:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570023936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.093229:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570023936:12345-0@lo:400:kworker.0 Request processed in 49us (3901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201068.093235:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201068.093254:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201068.093260:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570024320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.093290:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570024320:12345-0@lo:400:kworker.0 Request processed in 30us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201068.093296:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201068.093544:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570024064:12345-0@lo:400:kworker.0 Request processed in 931us (4284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201068.093552:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201068.094519:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570023936:0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.094541:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570024064:0@lo:400:kworker.0 00000100:00080000:0.0:1788201068.096451:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201068.096533:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570024320:0@lo:400:kworker.0 00010000:00080000:0.0:1788201068.096556:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c23480 x1875064570024192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201068.096603:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570024192:0@lo:400:kworker.0 00010000:00010000:2.0:1788201068.278659:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201069.290403:0:8785:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788201069.305869:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201070.328955:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201071.158587:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570024448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201071.158682:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201071.158838:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570024448 00000100:00100000:2.0:1788201071.158847:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570024448 00000100:00100000:2.0:1788201071.158915:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201071.158927:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570024448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201071.158963:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788201071.159074:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201071.160048:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570024448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1118us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201071.160228:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788201071.160373:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c22680 x1875064570024448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201071.160394:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570024448:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201071.354082:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201072.376780:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201072.443641:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201072.443687:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201072.443722:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201072.443850:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559508992 00000100:00100000:2.0:1788201072.443860:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559508992 00000100:00100000:2.0:1788201072.443934:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:2.0:1788201072.443946:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2344:x1875064559508992:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201072.444033:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2344:x1875064559508992:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 89us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201072.444042:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00080000:2.0:1788201072.444067:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201072.444337:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201072.444780:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559508864 00000100:00100000:3.0:1788201072.444795:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559508864 00000100:00100000:1.0:1788201072.444868:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559509120 00000100:00100000:1.0:1788201072.444876:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559509120 00000100:00100000:1.0:1788201072.444929:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559509248 00000100:00100000:1.0:1788201072.444934:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559509248 00000100:00100000:1.0:1788201072.444995:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:1.0:1788201072.445009:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2340:x1875064559509120:12345-192.168.201.56@tcp:9:kworker.0 00000100:00100000:3.0:1788201072.445022:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 195 00000020:00000080:1.0:1788201072.445045:0:6670:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3caa72 00000100:00100000:3.0:1788201072.445052:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559508864:12345-192.168.201.56@tcp:400:kworker.0 00000100:00080000:1.0:1788201072.445062:0:6670:0:(import.c:65:import_set_state_nolock()) ffff962492c06800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201072.445103:0:6670:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:2.0:1788201072.445883:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201072.445889:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201072.445978:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559508864:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 941us (2344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201072.445992:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 195 00000100:00100000:1.0:1788201072.447971:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+2:2340:x1875064559509120:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 2953us (4233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201072.447987:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:1.0:1788201072.448019:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:1.0:1788201072.448032:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+5:2340:x1875064559509248:12345-192.168.201.56@tcp:9:kworker.0 00000020:00000080:1.0:1788201072.448063:0:6670:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3caa79 00000100:00080000:1.0:1788201072.448073:0:6670:0:(import.c:65:import_set_state_nolock()) ffff962492c05800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201072.448110:0:6670:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788201072.450116:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+2:2340:x1875064559509248:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 2076us (5767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201072.450138:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 11 00010000:00010000:1.0:1788201072.450191:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201072.450197:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201073.206682:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201073.206705:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570024576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201073.206784:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201073.206884:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570024576 00000100:00100000:3.0:1788201073.206892:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570024576 00000100:00100000:3.0:1788201073.206960:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201073.206972:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570024576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201073.207010:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201073.207060:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570024576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201073.207068:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788201073.207113:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0fb80 x1875064570024576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201073.207132:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570024576:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201073.207330:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201073.207721:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570024832:0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.207769:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201073.207797:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201073.207803:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570024704:0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.207827:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201073.207848:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570025216:0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.207865:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201073.207890:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570024704 00000100:00100000:3.0:1788201073.207894:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570024704 00000100:00100000:3.0:1788201073.207921:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788201073.207927:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570024704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.207959:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570024704:12345-0@lo:400:kworker.0 Request processed in 32us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201073.207965:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788201073.207998:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570024832 00000100:00100000:3.0:1788201073.208001:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570024832 00000100:00100000:3.0:1788201073.208021:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570025216 00000100:00100000:3.0:1788201073.208024:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570025216 00000100:00100000:3.0:1788201073.208047:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201073.208052:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570024832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.208079:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570024832:12345-0@lo:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201073.208085:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201073.208095:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201073.208100:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570025216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.208120:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570025216:12345-0@lo:400:kworker.0 Request processed in 20us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201073.208125:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201073.208147:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570025088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.208169:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201073.208186:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201073.208190:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570024960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.208207:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201073.208224:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570025088 00000100:00100000:3.0:1788201073.208227:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570025088 00000100:00100000:3.0:1788201073.208250:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201073.208255:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570025088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.208282:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570025088:12345-0@lo:400:kworker.0 Request processed in 27us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201073.208288:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788201073.208302:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201073.208311:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788201073.208329:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0c380 x1875064570025088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201073.208361:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570025088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.208377:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570024960 00000100:00100000:3.0:1788201073.208379:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570024960 00000100:00100000:3.0:1788201073.208400:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201073.208405:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570024960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.208433:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570024960:12345-0@lo:400:kworker.0 Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201073.208438:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788201073.208450:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201073.208463:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570024960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.208482:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570024704:0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.208490:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570025216:0@lo:400:kworker.0 00000100:00100000:3.0:1788201073.208498:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570024832:0@lo:400:kworker.0 00010000:00010000:0.0:1788201073.399645:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201074.423774:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201074.556329:0:9029:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing yml_node 00010000:00010000:2.0:1788201075.449518:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201075.836380:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 00000020:00000080:2.0:1788201075.836391:0:6695:0:(genops.c:906:class_export_put()) final put ffff962492c00000/01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 00000020:00000080:1.0:1788201075.837409:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff962492c00000/01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 for lustre-OST0000 00000020:00000080:1.0:1788201075.837461:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff962492c06800 for lustre-OST0000 00000100:00100000:3.0:1788201076.297201:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570025344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201076.297254:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201076.297310:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570025344 00000100:00100000:3.0:1788201076.297316:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570025344 00000100:00100000:3.0:1788201076.297373:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201076.297379:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570025344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201076.297414:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201076.297448:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570025344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201076.297462:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788201076.297487:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201076.297514:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c23b80 x1875064570025344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201076.297531:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570025344:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788201076.418138:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 00000020:00000080:1.0:1788201076.418148:0:7629:0:(genops.c:906:class_export_put()) final put ffff962492c03000/01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 00000020:00000080:1.0:1788201076.418178:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff962492c03000/01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 for lustre-OST0001 00000020:00000080:1.0:1788201076.418221:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff962492c05800 for lustre-OST0001 00010000:00010000:1.0:1788201076.470518:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201077.494598:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201077.554485:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201077.554537:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201077.554721:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559509504 00000100:00100000:0.0:1788201077.554732:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559509504 00000100:00100000:0.0:1788201077.554805:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:0.0:1788201077.554816:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96249058a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2342:x1875064559509504:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201077.554891:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96249058a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2342:x1875064559509504:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 76us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201077.554898:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:3.0:1788201077.555201:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559509376 00000100:00100000:3.0:1788201077.555206:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559509376 00000100:00100000:3.0:1788201077.555244:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 197 00000100:00100000:3.0:1788201077.555252:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2342:x1875064559509376:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201077.555278:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2342:x1875064559509376:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 28us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201077.555284:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 197 00000100:00080000:2.0:1788201077.555693:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201078.326709:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570025472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201078.326788:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201078.327113:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570025728:0@lo:400:kworker.0 00000100:00100000:1.0:1788201078.327120:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570025600:0@lo:400:kworker.0 00000100:00100000:0.0:1788201078.327209:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570025472 00000100:00100000:0.0:1788201078.327217:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570025472 00000100:00100000:0.0:1788201078.327294:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201078.327304:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570025472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201078.327369:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201078.327479:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96249058b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570025984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201078.329160:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201078.329226:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201078.329233:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570025856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201078.329742:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201078.329796:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570025728 00000100:00100000:2.0:1788201078.329804:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570025728 00000100:00100000:2.0:1788201078.329860:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570025856 00000100:00100000:2.0:1788201078.329864:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570025856 00000100:00100000:2.0:1788201078.329891:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201078.330142:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96249058bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570025728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201078.330206:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96249058bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570025728:12345-0@lo:400:kworker.0 Request processed in 307us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201078.330215:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201078.330234:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201078.330241:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570025856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201078.330286:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570025856:12345-0@lo:400:kworker.0 Request processed in 46us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201078.330293:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788201078.330315:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201078.330320:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201078.330369:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570025856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201078.330399:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570025728:0@lo:400:kworker.0 00000100:00100000:1.0:1788201078.332238:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201078.332311:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570026112:0@lo:400:kworker.0 00000100:00100000:1.0:1788201078.332381:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201078.332429:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570026112 00000100:00100000:1.0:1788201078.332437:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570026112 00000100:00100000:1.0:1788201078.332499:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201078.332507:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570026112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201078.334022:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570025472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6711us (7225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201078.334057:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788201078.334124:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201078.334411:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788201078.334512:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0d880 x1875064570025472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201078.334539:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570025472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201078.334603:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570025984 00000100:00100000:0.0:1788201078.334610:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570025984 00000100:00100000:0.0:1788201078.334715:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201078.334726:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570025984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201078.334756:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570026112:12345-0@lo:400:kworker.0 Request processed in 2247us (2372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201078.334766:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788201078.334785:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570025984:12345-0@lo:400:kworker.0 Request processed in 62us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201078.334792:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201078.334846:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570026112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201078.334936:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570025600 00000100:00100000:2.0:1788201078.334941:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570025600 00000100:00100000:2.0:1788201078.334978:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788201078.334986:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570025600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201078.335026:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570025600:12345-0@lo:400:kworker.0 Request processed in 42us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201078.335032:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00080000:2.0:1788201078.335076:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96249058b480 x1875064570025984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201078.335087:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96249058b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570025984:0@lo:400:kworker.0 00000100:00080000:3.0:1788201078.336740:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201078.336771:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570025600:0@lo:400:kworker.0 00010000:00010000:1.0:1788201078.519402:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201079.547337:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201080.571181:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201080.608101:0:9223:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.56.54 00000100:00100000:3.0:1788201081.403772:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201081.403796:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570026240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201081.403871:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201081.403949:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570026240 00000100:00100000:3.0:1788201081.403957:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570026240 00000100:00100000:3.0:1788201081.404012:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201081.404024:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570026240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201081.404063:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201081.404107:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570026240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201081.404114:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788201081.404137:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201081.404165:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c23480 x1875064570026240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201081.404184:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570026240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788201081.593140:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201082.617008:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201082.675038:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201082.675097:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201082.675202:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559509632 00000100:00100000:0.0:1788201082.675211:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559509632 00000100:00100000:0.0:1788201082.675266:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 199 00000100:00100000:0.0:1788201082.675275:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2342:x1875064559509632:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201082.675393:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2342:x1875064559509632:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 118us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201082.675401:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 199 00000100:00100000:3.0:1788201082.676465:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559509760 00000100:00100000:3.0:1788201082.676473:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559509760 00000100:00100000:3.0:1788201082.676551:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00100000:3.0:1788201082.677027:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96249058b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2342:x1875064559509760:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201082.677110:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96249058b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2342:x1875064559509760:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 552us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201082.677117:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00080000:0.0:1788201082.677333:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201083.447751:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570026752:0@lo:400:kworker.0 00000100:00100000:2.0:1788201083.447829:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201083.447905:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201083.447912:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570026368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201083.448047:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201083.448077:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570026880:0@lo:400:kworker.0 00000100:00100000:2.0:1788201083.448102:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201083.448129:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570026496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201083.448167:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201083.448184:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570027008:0@lo:400:kworker.0 00000100:00100000:2.0:1788201083.448213:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201083.448234:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201083.448240:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570026624:0@lo:400:kworker.0 00000100:00100000:2.0:1788201083.448261:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201083.448290:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570026368 00000100:00100000:2.0:1788201083.448297:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570026368 00000100:00100000:2.0:1788201083.448339:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788201083.448369:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570026368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201083.448419:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570026368:12345-0@lo:400:kworker.0 Request processed in 52us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201083.448427:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788201083.448458:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570026752 00000100:00100000:2.0:1788201083.448462:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570026752 00000100:00100000:2.0:1788201083.448490:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570027008 00000100:00100000:2.0:1788201083.448493:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570027008 00000100:00100000:2.0:1788201083.448511:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201083.448517:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570026752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201083.448548:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570026752:12345-0@lo:400:kworker.0 Request processed in 31us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201083.448554:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201083.448684:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201083.448692:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96249058b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570027008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201083.448783:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96249058b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570027008:12345-0@lo:400:kworker.0 Request processed in 92us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201083.448790:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201083.448808:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570026880 00000100:00100000:2.0:1788201083.448812:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570026880 00000100:00100000:2.0:1788201083.448844:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570026496 00000100:00100000:2.0:1788201083.448846:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570026496 00000100:00100000:2.0:1788201083.448856:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570026624 00000100:00100000:2.0:1788201083.448859:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570026624 00000100:00100000:2.0:1788201083.448870:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201083.448876:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570026880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201083.448909:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570026880:12345-0@lo:400:kworker.0 Request processed in 33us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201083.448915:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201083.449092:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570027136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201083.449124:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201083.459880:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788201083.459910:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96249058a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570026496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201083.464153:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96249058a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570026496:12345-0@lo:400:kworker.0 Request processed in 4255us (15981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201083.464166:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788201083.464206:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201083.464219:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570026624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201083.464253:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570026624:12345-0@lo:400:kworker.0 Request processed in 40us (15991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201083.464259:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788201083.464285:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201083.464291:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201083.464294:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201083.464318:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570027136 00000100:00100000:0.0:1788201083.464328:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570027136 00000100:00100000:0.0:1788201083.464387:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201083.464394:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570027136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201083.464424:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201083.464463:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570027136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (15339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201083.464469:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788201083.464513:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0ea00 x1875064570027136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201083.464533:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570027136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201083.464721:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570026624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201083.464735:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570026496:0@lo:400:kworker.0 00010000:00080000:0.0:1788201083.464745:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c27b80 x1875064570027008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201083.464764:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570027008:0@lo:400:kworker.0 00000100:00100000:0.0:1788201083.464796:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570026368:0@lo:400:kworker.0 00000100:00100000:0.0:1788201083.464809:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570026880:0@lo:400:kworker.0 00010000:00080000:0.0:1788201083.464820:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c21500 x1875064570026752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201083.464829:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570026752:0@lo:400:kworker.0 00010000:00010000:1.0:1788201083.640585:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201084.548207:0:9320:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.56.54 00010000:00010000:0.0:1788201084.667020:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201085.706754:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201086.518621:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570027264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201086.518705:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201086.519904:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570027264 00000100:00100000:3.0:1788201086.519914:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570027264 00000100:00100000:3.0:1788201086.519984:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201086.519996:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570027264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201086.520031:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201086.520086:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570027264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201086.520107:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788201086.520213:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201086.520245:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c25880 x1875064570027264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201086.520263:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570027264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201086.710683:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201087.740098:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201087.796502:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201087.796566:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201087.796649:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559509888 00000100:00100000:3.0:1788201087.796659:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559509888 00000100:00100000:3.0:1788201087.796725:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 201 00000100:00100000:3.0:1788201087.796735:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559509888:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201087.796808:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559509888:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 75us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201087.796816:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 201 00000100:00100000:0.0:1788201087.799550:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559510016 00000100:00100000:0.0:1788201087.799569:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559510016 00000100:00080000:2.0:1788201087.799641:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201087.799652:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 50 00000100:00100000:0.0:1788201087.799663:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2344:x1875064559510016:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201087.799750:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2344:x1875064559510016:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 89us (3188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201087.799758:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 50 00000001:02000400:3.0:1788201087.888223:0:9418:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.56.54 00000100:00100000:1.0:1788201088.566801:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570027648:0@lo:400:kworker.0 00000100:00100000:1.0:1788201088.566914:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201088.566996:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201088.567005:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570027520:0@lo:400:kworker.0 00000100:00100000:1.0:1788201088.567033:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201088.567050:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570028032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201088.567072:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201088.567294:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570027392:0@lo:400:kworker.0 00000100:00100000:3.0:1788201088.567331:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201088.567386:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570027904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201088.567423:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201088.567441:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201088.567447:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570027776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201088.567469:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201088.567509:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570027648 00000100:00100000:3.0:1788201088.567517:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570027648 00000100:00100000:3.0:1788201088.567570:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570027520 00000100:00100000:3.0:1788201088.567575:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570027520 00000100:00100000:3.0:1788201088.567590:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570027904 00000100:00100000:3.0:1788201088.567592:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570027904 00000100:00100000:3.0:1788201088.567607:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201088.567616:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570027648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201088.567821:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570027648:12345-0@lo:400:kworker.0 Request processed in 204us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201088.567839:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201088.567860:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788201088.567867:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570027520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201088.567899:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570027520:12345-0@lo:400:kworker.0 Request processed in 33us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201088.567905:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788201088.567917:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788201088.567924:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570027904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201088.567957:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570027904:12345-0@lo:400:kworker.0 Request processed in 33us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201088.567963:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788201088.567983:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570028032 00000100:00100000:3.0:1788201088.567986:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570028032 00000100:00100000:3.0:1788201088.568008:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570027776 00000100:00100000:3.0:1788201088.568011:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570027776 00000100:00100000:3.0:1788201088.568029:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201088.568035:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570028032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201088.568066:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570028032:12345-0@lo:400:kworker.0 Request processed in 31us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201088.568078:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201088.568091:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201088.568097:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570027776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201088.568123:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570027776:12345-0@lo:400:kworker.0 Request processed in 27us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201088.568128:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788201088.568135:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201088.568140:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201088.568143:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788201088.568175:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba199880 x1875064570027776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201088.568195:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570027776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201088.568209:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570027904:0@lo:400:kworker.0 00000100:00100000:0.0:1788201088.569952:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201088.569991:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96249058b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570028160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201088.570065:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201088.570385:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570027392 00000100:00100000:1.0:1788201088.570394:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570027392 00000100:00100000:1.0:1788201088.570451:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788201088.570460:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570027392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201088.570536:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570027392:12345-0@lo:400:kworker.0 Request processed in 77us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201088.570542:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788201088.570743:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570027520:0@lo:400:kworker.0 00010000:00080000:1.0:1788201088.570759:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba85b800 x1875064570028032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201088.570769:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570028032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201088.570782:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570027648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201088.570982:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570027392:0@lo:400:kworker.0 00000100:00100000:3.0:1788201088.571193:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570028160 00000100:00100000:3.0:1788201088.571198:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570028160 00000100:00100000:3.0:1788201088.571239:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201088.571459:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570028160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201088.571500:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201088.571726:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570028160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 271us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201088.571734:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788201088.580428:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96249058b800 x1875064570028160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201088.580480:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96249058b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570028160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201088.760408:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201089.782586:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201090.218138:0:9466:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: replay-ost-single ============----- Mon Aug 31 14:31:28 EDT 2026 00010000:00010000:0.0:1788201090.806664:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201091.655057:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570028288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201091.655135:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201091.655248:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570028288 00000100:00100000:3.0:1788201091.655256:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570028288 00000100:00100000:3.0:1788201091.655319:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201091.655329:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570028288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201091.655395:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201091.655453:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570028288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201091.655460:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788201091.655506:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c24700 x1875064570028288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201091.655523:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570028288:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201091.655618:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201091.830599:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201092.858693:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201092.920388:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201092.920448:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201092.920539:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559510272 00000100:00100000:3.0:1788201092.920549:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559510272 00000100:00100000:3.0:1788201092.920630:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00100000:3.0:1788201092.920655:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96249058b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2343:x1875064559510272:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201092.920738:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96249058b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2343:x1875064559510272:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 98us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201092.920746:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00080000:2.0:1788201092.921282:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201092.921695:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559510144 00000100:00100000:1.0:1788201092.921702:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559510144 00000100:00100000:1.0:1788201092.921747:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 203 00000100:00100000:1.0:1788201092.921756:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559510144:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201092.921806:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559510144:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 51us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201092.921823:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 203 00000100:00100000:0.0:1788201093.686763:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570028544:0@lo:400:kworker.0 00000100:00100000:0.0:1788201093.686839:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201093.686895:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570029056:0@lo:400:kworker.0 00000100:00100000:0.0:1788201093.686923:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201093.686966:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201093.686973:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570028672:0@lo:400:kworker.0 00000100:00100000:0.0:1788201093.686998:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201093.687039:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570028544 00000100:00100000:0.0:1788201093.687047:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570028544 00000100:00100000:0.0:1788201093.687090:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570028672 00000100:00100000:0.0:1788201093.687093:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570028672 00000100:00100000:0.0:1788201093.687124:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201093.687132:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570028544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201093.687243:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570028416:0@lo:400:kworker.0 00000100:00100000:3.0:1788201093.687543:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570028800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201093.687877:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201093.687940:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570028928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201093.687977:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201093.688115:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570028544:12345-0@lo:400:kworker.0 Request processed in 981us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201093.688136:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201093.688156:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570028928 00000100:00100000:0.0:1788201093.688161:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570028928 00000100:00100000:0.0:1788201093.688195:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201093.688203:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570028672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201093.688240:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570028672:12345-0@lo:400:kworker.0 Request processed in 38us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201093.688246:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201093.688257:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201093.688264:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570028928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201093.688298:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570028928:12345-0@lo:400:kworker.0 Request processed in 35us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201093.688304:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201093.688322:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570029056 00000100:00100000:0.0:1788201093.688326:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570029056 00000100:00100000:0.0:1788201093.688373:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201093.688391:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570029056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201093.688436:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570029056:12345-0@lo:400:kworker.0 Request processed in 47us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201093.688442:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788201093.688464:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201093.688469:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201093.688517:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570028928:0@lo:400:kworker.0 00000100:00100000:0.0:1788201093.688547:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570028672:0@lo:400:kworker.0 00000100:00100000:0.0:1788201093.688557:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570028544:0@lo:400:kworker.0 00010000:00080000:0.0:1788201093.688580:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0fb80 x1875064570029056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201093.688591:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570029056:0@lo:400:kworker.0 00000100:00100000:3.0:1788201093.689050:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201093.689094:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570028800 00000100:00100000:3.0:1788201093.689099:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570028800 00000100:00100000:3.0:1788201093.689131:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201093.689137:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570028800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201093.689269:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570028800:12345-0@lo:400:kworker.0 Request processed in 131us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201093.689277:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788201093.689299:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788201093.689379:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0d880 x1875064570028800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201093.689391:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570028800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201093.689511:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570029184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201093.689541:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201093.689647:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570029184 00000100:00100000:3.0:1788201093.689651:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570029184 00000100:00100000:3.0:1788201093.689685:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201093.689787:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570029184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201093.689816:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201093.689861:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570029184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201093.689910:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570028416 00000100:00100000:2.0:1788201093.689915:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570028416 00010000:00080000:0.0:1788201093.690134:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba0dbb80 x1875064570029184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201093.690148:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570029184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201093.690269:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201093.690364:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788201093.690373:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570028416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201093.690430:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570028416:12345-0@lo:400:kworker.0 Request processed in 59us (2553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201093.690445:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788201093.690517:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570028416:0@lo:400:kworker.0 00010000:00010000:1.0:1788201093.881632:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201094.905281:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201095.929381:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201096.762925:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201096.762949:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570029312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201096.763016:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201096.763081:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570029312 00000100:00100000:2.0:1788201096.763100:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570029312 00000100:00100000:2.0:1788201096.763562:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201096.763573:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570029312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201096.763619:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201096.763675:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570029312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201096.763683:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788201096.763723:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962490589500 x1875064570029312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201096.763741:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570029312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788201096.763885:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201096.953078:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201097.982919:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201098.034506:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201098.034543:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201098.034689:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559510528 00000100:00100000:0.0:1788201098.034700:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559510528 00000100:00100000:0.0:1788201098.034769:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:0.0:1788201098.034782:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2341:x1875064559510528:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201098.034875:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2341:x1875064559510528:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 98us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201098.034881:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:3.0:1788201098.035147:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559510400 00000100:00100000:3.0:1788201098.035151:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559510400 00000100:00100000:3.0:1788201098.035184:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 205 00000100:00100000:3.0:1788201098.035189:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2341:x1875064559510400:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201098.035213:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2341:x1875064559510400:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 25us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201098.035217:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 205 00000100:00080000:3.0:1788201098.035251:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201098.806528:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570029568:0@lo:400:kworker.0 00000100:00100000:0.0:1788201098.806594:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201098.806641:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570030080:0@lo:400:kworker.0 00000100:00100000:0.0:1788201098.806666:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201098.806697:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201098.806710:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570029696:0@lo:400:kworker.0 00000100:00100000:0.0:1788201098.806727:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201098.806751:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570029568 00000100:00100000:0.0:1788201098.806756:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570029568 00000100:00100000:0.0:1788201098.806789:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570029696 00000100:00100000:0.0:1788201098.806791:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570029696 00000100:00100000:0.0:1788201098.806818:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201098.806827:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570029568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201098.806876:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570029568:12345-0@lo:400:kworker.0 Request processed in 49us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201098.806883:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201098.806901:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788201098.806908:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570029696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201098.806929:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570029696:12345-0@lo:400:kworker.0 Request processed in 23us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201098.806933:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788201098.806947:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570030080 00000100:00100000:0.0:1788201098.806949:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570030080 00000100:00100000:0.0:1788201098.806968:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201098.806972:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570030080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201098.806990:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570030080:12345-0@lo:400:kworker.0 Request processed in 19us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201098.806993:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201098.807029:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570029696:0@lo:400:kworker.0 00000100:00100000:0.0:1788201098.807035:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570029568:0@lo:400:kworker.0 00010000:00080000:0.0:1788201098.807043:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c21500 x1875064570030080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201098.807055:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570030080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201098.807165:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201098.807172:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570030208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201098.807199:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201098.807228:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570030208 00000100:00100000:1.0:1788201098.807232:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570030208 00000100:00100000:1.0:1788201098.807257:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201098.807265:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570030208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201098.807303:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201098.807376:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570030208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201098.807383:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788201098.807413:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba0daa00 x1875064570030208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201098.807428:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570030208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201098.811738:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570029824:0@lo:400:kworker.0 00000100:00100000:3.0:1788201098.811808:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201098.812470:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201098.812477:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570029440:0@lo:400:kworker.0 00000100:00100000:3.0:1788201098.812510:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201098.812532:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570029952:0@lo:400:kworker.0 00000100:00100000:3.0:1788201098.812548:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201098.812569:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201098.812574:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201098.812584:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570029440 00000100:00100000:3.0:1788201098.812589:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570029440 00000100:00100000:3.0:1788201098.812626:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788201098.812635:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570029440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201098.812683:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570029440:12345-0@lo:400:kworker.0 Request processed in 48us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201098.812688:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788201098.812742:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570029440:0@lo:400:kworker.0 00000100:00100000:3.0:1788201098.812760:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570029952 00000100:00100000:3.0:1788201098.812762:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570029952 00000100:00100000:3.0:1788201098.812787:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788201098.812792:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570029952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201098.812825:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570029952:12345-0@lo:400:kworker.0 Request processed in 33us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201098.812831:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788201098.812848:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201098.812864:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570029952:0@lo:400:kworker.0 00000100:00100000:0.0:1788201098.815636:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570029824 00000100:00100000:0.0:1788201098.815652:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570029824 00000100:00100000:0.0:1788201098.815719:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201098.815726:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570029824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201098.815791:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570029824:12345-0@lo:400:kworker.0 Request processed in 67us (3984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201098.815798:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788201098.817229:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201098.817296:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0ed80 x1875064570029824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201098.817323:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570029824:0@lo:400:kworker.0 00010000:00010000:3.0:1788201099.001231:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201100.024391:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201101.054094:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201101.879119:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570030336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201101.879221:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201101.879336:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570030336 00000100:00100000:3.0:1788201101.879363:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570030336 00000100:00100000:3.0:1788201101.879436:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201101.879450:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570030336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201101.879497:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201101.879549:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570030336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201101.879556:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788201101.879606:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201101.879644:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c24380 x1875064570030336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201101.879666:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570030336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201102.070852:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201103.098001:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201103.154392:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201103.154801:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559510656 00000100:00100000:0.0:1788201103.154817:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559510656 00000100:00100000:0.0:1788201103.154886:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 207 00000100:00100000:0.0:1788201103.154898:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559510656:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201103.154999:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559510656:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 103us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201103.155007:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 207 00000100:00100000:0.0:1788201103.158913:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201103.164987:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559510784 00000100:00100000:2.0:1788201103.165002:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559510784 00000100:00100000:2.0:1788201103.165974:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:2.0:1788201103.165989:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2343:x1875064559510784:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201103.168673:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2343:x1875064559510784:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 2676us (9758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201103.168690:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00080000:0.0:1788201103.169158:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201103.926668:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570030592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201103.926779:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201103.926851:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570031104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201103.926909:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201103.926951:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201103.926957:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570030720:0@lo:400:kworker.0 00000100:00100000:0.0:1788201103.926982:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201103.927030:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570031104 00000100:00100000:0.0:1788201103.927041:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570031104 00000100:00100000:0.0:1788201103.927120:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201103.927133:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570031104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.927676:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570030464:0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.927733:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201103.927763:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570030976:0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.927789:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201103.927811:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201103.927818:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570030848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.927840:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201103.927874:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570030592 00000100:00100000:3.0:1788201103.927879:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570030592 00000100:00100000:3.0:1788201103.927916:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570030720 00000100:00100000:3.0:1788201103.927919:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570030720 00000100:00100000:3.0:1788201103.927937:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570030976 00000100:00100000:3.0:1788201103.927939:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570030976 00000100:00100000:3.0:1788201103.927957:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788201103.927964:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570030592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201103.928058:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570031104:12345-0@lo:400:kworker.0 Request processed in 927us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201103.928067:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201103.928086:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570030848 00000100:00100000:0.0:1788201103.928090:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570030848 00000100:00100000:0.0:1788201103.928113:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201103.928119:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570030848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201103.928153:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570030848:12345-0@lo:400:kworker.0 Request processed in 33us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201103.928159:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788201103.928177:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201103.928184:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201103.928186:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201103.936732:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570030592:12345-0@lo:400:kworker.0 Request processed in 8751us (9937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201103.936754:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788201103.936821:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201103.936844:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570030720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.936954:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570030720:12345-0@lo:400:kworker.0 Request processed in 124us (9971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201103.936974:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201103.936988:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201103.936995:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570030976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.937029:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570030976:12345-0@lo:400:kworker.0 Request processed in 35us (9239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201103.937034:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201103.937072:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570030464 00000100:00100000:3.0:1788201103.937083:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570030464 00000100:00100000:3.0:1788201103.937137:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788201103.937144:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570030464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.937181:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570030464:12345-0@lo:400:kworker.0 Request processed in 37us (9448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201103.937187:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00010000:00080000:3.0:1788201103.940658:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0c000 x1875064570030848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201103.940688:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570030848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.940732:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570030464:0@lo:400:kworker.0 00000100:00100000:3.0:1788201103.940753:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570030976:0@lo:400:kworker.0 00000100:00100000:2.0:1788201103.942293:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570031232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201103.942546:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201103.942636:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570031232 00000100:00100000:2.0:1788201103.942645:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570031232 00000100:00100000:2.0:1788201103.942709:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201103.942721:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570031232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201103.942773:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201103.942823:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570031232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201103.942831:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788201103.942902:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba0daa00 x1875064570031232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201103.942932:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570031232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201103.950737:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570030592:0@lo:400:kworker.0 00010000:00080000:0.0:1788201103.950768:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c842680 x1875064570031104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201103.950782:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570031104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201103.950824:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570030720:0@lo:400:kworker.0 00010000:00010000:2.0:1788201104.118509:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201105.150286:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201106.166640:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201107.002223:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201107.002247:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570031360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201107.002322:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201107.002429:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570031360 00000100:00100000:2.0:1788201107.002438:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570031360 00000100:00100000:2.0:1788201107.002493:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201107.002501:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570031360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201107.002533:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201107.002577:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570031360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201107.002584:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788201107.002605:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201107.002634:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517fb80 x1875064570031360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201107.002665:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570031360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201107.194410:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201108.214706:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201108.276806:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201108.276869:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201108.276985:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559510912 00000100:00100000:0.0:1788201108.277006:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559510912 00000100:00100000:3.0:1788201108.277162:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559511040 00000100:00100000:3.0:1788201108.277168:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559511040 00000100:00100000:3.0:1788201108.277260:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 66 00000100:00100000:3.0:1788201108.277273:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2343:x1875064559511040:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201108.277424:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2343:x1875064559511040:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 154us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201108.277449:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 66 00000100:00080000:2.0:1788201108.277744:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201108.278660:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 209 00000100:00100000:3.0:1788201108.278673:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559510912:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201108.278730:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559510912:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 61us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201108.278737:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 209 00000100:00100000:2.0:1788201109.047984:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570031744:0@lo:400:kworker.0 00000100:00100000:2.0:1788201109.048055:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201109.048121:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788201109.048148:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570031616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201109.048173:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201109.048192:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570032128:0@lo:400:kworker.0 00000100:00100000:2.0:1788201109.048215:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201109.048250:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570031744 00000100:00100000:2.0:1788201109.048257:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570031744 00000100:00100000:3.0:1788201109.048317:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570031488:0@lo:400:kworker.0 00000100:00100000:0.0:1788201109.048381:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570031872:0@lo:400:kworker.0 00000100:00100000:3.0:1788201109.048385:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201109.048415:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570032000:0@lo:400:kworker.0 00000100:00100000:0.0:1788201109.048434:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201109.048450:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201109.048489:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570032128 00000100:00100000:0.0:1788201109.048494:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570032128 00000100:00100000:3.0:1788201109.048507:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570031616 00000100:00100000:3.0:1788201109.048513:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570031616 00000100:00100000:3.0:1788201109.048556:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570032000 00000100:00100000:3.0:1788201109.048560:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570032000 00000100:00100000:1.0:1788201109.048597:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201109.048608:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570031616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201109.048655:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570031616:12345-0@lo:400:kworker.0 Request processed in 50us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201109.048661:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201109.048683:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201109.048692:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570032256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201109.048717:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201109.048744:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570032256 00000100:00100000:1.0:1788201109.048748:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570032256 00000100:00100000:1.0:1788201109.048772:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201109.048778:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570032256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201109.048807:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201109.048841:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570032256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201109.048847:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788201109.048883:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba0d8700 x1875064570032256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201109.048906:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570032256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201109.048937:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570031616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201109.049028:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788201109.049035:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570031744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201109.049068:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570031744:12345-0@lo:400:kworker.0 Request processed in 35us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201109.049073:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788201109.053165:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570031488 00000100:00100000:2.0:1788201109.053185:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570031488 00000100:00100000:2.0:1788201109.053270:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788201109.053281:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570031488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201109.053402:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570031488:12345-0@lo:400:kworker.0 Request processed in 123us (5017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201109.053409:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788201109.053469:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570031488:0@lo:400:kworker.0 00000100:00100000:0.0:1788201109.059698:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570031872 00000100:00100000:0.0:1788201109.059714:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570031872 00000100:00100000:0.0:1788201109.059758:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201109.059770:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570032128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201109.059874:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570032128:12345-0@lo:400:kworker.0 Request processed in 106us (11657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201109.059881:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201109.059897:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201109.059903:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570031872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201109.059939:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570031872:12345-0@lo:400:kworker.0 Request processed in 37us (11506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201109.059945:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788201109.060001:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c6e300 x1875064570031872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201109.060019:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570031872:0@lo:400:kworker.0 00010000:00080000:0.0:1788201109.060083:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c6c380 x1875064570032128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201109.060094:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570032128:0@lo:400:kworker.0 00000100:00100000:0.0:1788201109.060110:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570031744:0@lo:400:kworker.0 00000100:00100000:3.0:1788201109.060112:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201109.060126:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570032000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201109.060188:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570032000:12345-0@lo:400:kworker.0 Request processed in 65us (11739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201109.060196:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201109.060220:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570032000:0@lo:400:kworker.0 00000100:00080000:1.0:1788201109.062154:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201109.062250:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201109.062260:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201109.238545:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201110.264012:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201110.478765:0:10194:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 00010000:00010000:0.0:1788201111.287207:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201112.129170:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570032384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201112.129252:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201112.129629:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570032384 00000100:00100000:3.0:1788201112.129639:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570032384 00000100:00100000:3.0:1788201112.129710:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788201112.129722:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570032384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201112.129781:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201112.129831:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570032384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201112.129840:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788201112.130324:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788201112.130832:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c24000 x1875064570032384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201112.130854:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570032384:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201112.310505:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201112.480687:0:10243:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === replay-ost-single: start setup 14:31:50 (1788201110) === 00010000:00010000:0.0:1788201113.335005:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201113.411122:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201113.411195:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201113.411445:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559511168 00000100:00100000:0.0:1788201113.411460:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559511168 00000100:00100000:0.0:1788201113.411535:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 211 00000100:00100000:0.0:1788201113.411547:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2341:x1875064559511168:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201113.411655:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2341:x1875064559511168:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 109us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201113.411664:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 211 00000100:00100000:3.0:1788201113.411874:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559511296 00000100:00100000:3.0:1788201113.411880:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559511296 00000100:00100000:3.0:1788201113.411949:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00100000:3.0:1788201113.411962:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2341:x1875064559511296:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201113.412037:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2341:x1875064559511296:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 80us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201113.412044:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00080000:0.0:1788201113.412465:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201114.166580:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201114.166604:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570032512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201114.166678:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201114.166831:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570032512 00000100:00100000:1.0:1788201114.166839:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570032512 00000100:00100000:1.0:1788201114.166903:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201114.166913:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570032512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201114.166946:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201114.166993:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570032512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201114.167000:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788201114.167041:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba0d8700 x1875064570032512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201114.167077:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570032512:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201114.167126:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201114.181272:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570032640:0@lo:400:kworker.0 00000100:00100000:0.0:1788201114.181413:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201114.181471:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570033152:0@lo:400:kworker.0 00000100:00100000:0.0:1788201114.181502:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201114.181530:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201114.181537:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570032768:0@lo:400:kworker.0 00000100:00100000:0.0:1788201114.181557:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201114.181592:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570032640 00000100:00100000:0.0:1788201114.181601:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570032640 00000100:00100000:1.0:1788201114.181639:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570033024:0@lo:400:kworker.0 00000100:00100000:0.0:1788201114.181662:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788201114.181678:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570032640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201114.181717:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201114.181770:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201114.181783:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570032896:0@lo:400:kworker.0 00000100:00100000:0.0:1788201114.181787:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570032640:12345-0@lo:400:kworker.0 Request processed in 109us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201114.181801:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788201114.181826:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201114.181843:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570033152 00000100:00100000:0.0:1788201114.181848:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570033152 00000100:00100000:0.0:1788201114.181880:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570032768 00000100:00100000:0.0:1788201114.181884:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570032768 00000100:00100000:0.0:1788201114.181900:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201114.181907:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570033152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201114.181970:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570033024 00000100:00100000:1.0:1788201114.181976:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570033024 00000100:00100000:1.0:1788201114.182030:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201114.182039:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570033024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201114.187847:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570033152:12345-0@lo:400:kworker.0 Request processed in 5928us (6331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201114.187863:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201114.187899:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570032896 00000100:00100000:0.0:1788201114.187908:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570032896 00000100:00100000:0.0:1788201114.187950:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788201114.187959:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570032768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201114.188014:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570032768:12345-0@lo:400:kworker.0 Request processed in 56us (6456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201114.188020:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788201114.188032:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788201114.188038:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570032896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201114.188108:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570032896:12345-0@lo:400:kworker.0 Request processed in 69us (6282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201114.188114:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788201114.188160:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201114.188165:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201114.188287:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570032768:0@lo:400:kworker.0 00000100:00100000:0.0:1788201114.188318:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570032640:0@lo:400:kworker.0 00000100:00100000:0.0:1788201114.188449:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570033152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201114.192152:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570032896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201114.192280:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570033024:12345-0@lo:400:kworker.0 Request processed in 10239us (10561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201114.192294:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788201114.192392:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba0d9f80 x1875064570033024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201114.192415:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570033024:0@lo:400:kworker.0 00010000:00010000:2.0:1788201114.367084:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201115.382608:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201116.407823:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201117.238556:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201117.238593:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570033280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201117.238664:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201117.238772:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570033280 00000100:00100000:3.0:1788201117.238789:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570033280 00000100:00100000:3.0:1788201117.238845:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201117.238857:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570033280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201117.238904:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201117.238947:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570033280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201117.238954:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788201117.239040:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c24000 x1875064570033280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201117.239059:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570033280:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201117.239291:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201117.430609:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201118.454901:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201118.515462:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201118.515536:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201118.515664:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559511552 00000100:00100000:3.0:1788201118.515677:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559511552 00000100:00100000:3.0:1788201118.515904:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 74 00000100:00100000:3.0:1788201118.515918:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2343:x1875064559511552:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201118.516040:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2343:x1875064559511552:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 125us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201118.516050:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 74 00000100:00100000:2.0:1788201118.516103:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559511424 00000100:00100000:2.0:1788201118.516121:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559511424 00000100:00100000:2.0:1788201118.516204:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 213 00000100:00100000:2.0:1788201118.516233:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2343:x1875064559511424:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201118.516336:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2343:x1875064559511424:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 106us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201118.516392:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 213 00000100:00080000:1.0:1788201118.516516:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201119.287065:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570033664:0@lo:400:kworker.0 00000100:00100000:0.0:1788201119.287165:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570033408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201119.287175:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201119.287209:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201119.287247:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570034176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201119.287269:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570033664 00000100:00100000:1.0:1788201119.287273:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201119.287279:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570033664 00000100:00100000:1.0:1788201119.287305:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201119.287311:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570033792:0@lo:400:kworker.0 00000100:00100000:2.0:1788201119.287335:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201119.287368:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570033664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201119.287369:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201119.287453:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570033664:12345-0@lo:400:kworker.0 Request processed in 79us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201119.287461:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201119.287481:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570033792 00000100:00100000:2.0:1788201119.287485:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570033792 00000100:00100000:2.0:1788201119.287515:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788201119.287521:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570033792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201119.287551:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570033792:12345-0@lo:400:kworker.0 Request processed in 30us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201119.287557:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788201119.288884:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201119.288952:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570033792:0@lo:400:kworker.0 00000100:00100000:1.0:1788201119.288983:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570033664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201119.289132:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570033408 00000100:00100000:2.0:1788201119.289140:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570033408 00000100:00100000:2.0:1788201119.289213:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201119.289223:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570033408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201119.289269:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201119.289360:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570033408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201119.289367:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201119.289419:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570033536:0@lo:400:kworker.0 00000100:00100000:2.0:1788201119.289475:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201119.289516:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570034048:0@lo:400:kworker.0 00000100:00100000:2.0:1788201119.289544:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201119.289577:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570034048 00000100:00100000:2.0:1788201119.289581:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570034048 00000100:00100000:2.0:1788201119.289606:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788201119.289612:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570034048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201119.289878:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570034048:12345-0@lo:400:kworker.0 Request processed in 263us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201119.289885:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788201119.289918:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570034048:0@lo:400:kworker.0 00000100:00080000:1.0:1788201119.291886:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201119.291898:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201119.292430:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570034176 00000100:00100000:1.0:1788201119.292455:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570034176 00000100:00100000:0.0:1788201119.292715:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570033536 00000100:00100000:0.0:1788201119.292721:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570033536 00000100:00100000:1.0:1788201119.292791:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201119.292804:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570034176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201119.292883:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788201119.292892:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570033536:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788201119.297543:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba0daa00 x1875064570034176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201119.297586:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570034176:0@lo:400:kworker.0 00000100:00100000:1.0:1788201119.304486:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570034176:12345-0@lo:400:kworker.0 Request processed in 11667us (17193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201119.304521:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788201119.305977:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c26680 x1875064570033408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201119.306010:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570033408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201119.306026:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570033920:0@lo:400:kworker.0 00000100:00100000:1.0:1788201119.306115:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201119.306311:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570033920 00000100:00100000:3.0:1788201119.306320:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570033920 00000100:00100000:3.0:1788201119.306412:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788201119.306424:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570033920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201119.306504:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570033920:12345-0@lo:400:kworker.0 Request processed in 83us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201119.306510:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788201119.306729:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788201119.306821:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba0d8700 x1875064570033920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201119.306832:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570033920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201119.307263:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570033536:12345-0@lo:400:kworker.0 Request processed in 14369us (17784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201119.307275:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788201119.307545:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570033536:0@lo:400:kworker.0 00000001:02000400:0.0:1788201119.389031:0:10436:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788201119.479667:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201120.503199:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201121.528124:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201122.360317:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201122.360426:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570034304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201122.360502:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201122.360592:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570034304 00000100:00100000:0.0:1788201122.360602:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570034304 00000100:00100000:0.0:1788201122.360673:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788201122.360683:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570034304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201122.360720:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788201122.360886:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201122.361376:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570034304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 694us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201122.361398:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788201122.361491:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c6ce00 x1875064570034304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201122.361567:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570034304:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201122.550500:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201123.574465:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201123.635192:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201123.635256:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559511680 00000100:00100000:3.0:1788201123.635265:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559511680 00000100:00100000:3.0:1788201123.635314:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 215 00000100:00100000:3.0:1788201123.635321:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2342:x1875064559511680:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201123.635407:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2342:x1875064559511680:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 87us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201123.635425:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 215 00000100:00100000:2.0:1788201123.638955:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201123.639029:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559511808 00000100:00100000:0.0:1788201123.639038:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559511808 00000100:00100000:0.0:1788201123.639106:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00100000:0.0:1788201123.639117:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2342:x1875064559511808:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201123.639197:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2342:x1875064559511808:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 82us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201123.639205:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00080000:1.0:1788201123.639315:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201124.407423:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570034432:0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.407502:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201124.407544:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570034944:0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.407567:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201124.407590:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201124.407595:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570034560:0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.407624:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201124.407638:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570035072:0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.409829:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201124.409905:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570034688:0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.409949:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201124.409977:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201124.409984:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570034816:0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.410006:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201124.410040:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570034944 00000100:00100000:1.0:1788201124.410048:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570034944 00000100:00100000:1.0:1788201124.410107:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570034560 00000100:00100000:1.0:1788201124.410110:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570034560 00000100:00100000:1.0:1788201124.410124:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570034688 00000100:00100000:1.0:1788201124.410126:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570034688 00000100:00100000:1.0:1788201124.410142:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201124.410151:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570034944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.410205:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570034944:12345-0@lo:400:kworker.0 Request processed in 55us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201124.410211:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201124.410226:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788201124.410232:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570034560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.410255:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570034560:12345-0@lo:400:kworker.0 Request processed in 25us (2631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201124.410260:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788201124.410269:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201124.410274:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c85b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570034688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.410312:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c85b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570034688:12345-0@lo:400:kworker.0 Request processed in 38us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201124.410317:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201124.410336:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570035072 00000100:00100000:1.0:1788201124.410489:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570035072 00000100:00100000:1.0:1788201124.410521:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570034816 00000100:00100000:1.0:1788201124.410524:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570034816 00000100:00100000:1.0:1788201124.410542:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201124.410549:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570035072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.410580:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570035072:12345-0@lo:400:kworker.0 Request processed in 32us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201124.410585:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201124.410596:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201124.410602:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570034816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.410627:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570034816:12345-0@lo:400:kworker.0 Request processed in 26us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201124.410633:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788201124.410661:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201124.410665:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201124.410667:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788201124.410708:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c85b800 x1875064570034816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201124.410724:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570034816:0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.410737:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570034688:0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.410770:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570034560:0@lo:400:kworker.0 00010000:00080000:1.0:1788201124.410791:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c858e00 x1875064570035072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201124.410799:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570035072:0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.410809:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570034944:0@lo:400:kworker.0 00000100:00100000:3.0:1788201124.412386:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201124.412404:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570035200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201124.412458:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201124.413833:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570034432 00000100:00100000:3.0:1788201124.413844:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570034432 00000100:00100000:3.0:1788201124.413907:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788201124.413917:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570034432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201124.413992:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570034432:12345-0@lo:400:kworker.0 Request processed in 74us (6487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201124.413999:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788201124.414807:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570034432:0@lo:400:kworker.0 00000100:00100000:1.0:1788201124.417535:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570035200 00000100:00100000:1.0:1788201124.417551:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570035200 00000100:00100000:1.0:1788201124.417617:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201124.417627:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570035200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201124.417680:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201124.417762:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570035200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (5303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201124.417769:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788201124.417816:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c26d80 x1875064570035200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201124.417835:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570035200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201124.598532:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201125.622899:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201126.646948:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201127.479886:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570035328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201127.479957:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201127.480023:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570035328 00000100:00100000:1.0:1788201127.480030:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570035328 00000100:00100000:1.0:1788201127.480099:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788201127.480109:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570035328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201127.480140:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201127.480198:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570035328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201127.480205:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788201127.480245:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c6dc00 x1875064570035328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201127.480249:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201127.480263:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570035328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201127.672301:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201128.700202:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201128.754286:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201128.754405:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201128.754477:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559512064 00000100:00100000:0.0:1788201128.754487:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559512064 00000100:00100000:0.0:1788201128.754550:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 82 00000100:00100000:0.0:1788201128.754560:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2343:x1875064559512064:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201128.754631:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2343:x1875064559512064:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201128.754638:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 82 00000100:00100000:3.0:1788201128.754928:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559511936 00000100:00100000:3.0:1788201128.754933:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559511936 00000100:00100000:3.0:1788201128.754974:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 217 00000100:00100000:3.0:1788201128.754981:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559511936:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201128.755013:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559511936:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 34us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201128.755020:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 217 00000100:00080000:1.0:1788201128.755207:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201129.526699:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570035456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201129.526770:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201129.526985:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570035712:0@lo:400:kworker.0 00000100:00100000:0.0:1788201129.527064:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201129.527087:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201129.527093:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570035840:0@lo:400:kworker.0 00000100:00100000:0.0:1788201129.527115:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201129.527143:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570035712 00000100:00100000:0.0:1788201129.527150:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570035712 00000100:00100000:0.0:1788201129.527191:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570035840 00000100:00100000:0.0:1788201129.527195:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570035840 00000100:00100000:0.0:1788201129.527223:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788201129.527247:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570035712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201129.527393:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788201129.527402:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570035840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201129.527440:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570035840:12345-0@lo:400:kworker.0 Request processed in 40us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201129.527447:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788201129.527487:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201129.527522:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570035840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201129.527546:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570035968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201129.527585:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201129.527605:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201129.527610:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570035584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201129.527637:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201129.527659:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570036096:0@lo:400:kworker.0 00000100:00100000:1.0:1788201129.527678:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201129.527710:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570035968 00000100:00100000:1.0:1788201129.527714:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570035968 00000100:00100000:1.0:1788201129.527747:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201129.527753:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570035968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201129.527800:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570035968:12345-0@lo:400:kworker.0 Request processed in 46us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201129.527806:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201129.527826:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570035584 00000100:00100000:1.0:1788201129.527830:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570035584 00000100:00100000:1.0:1788201129.527855:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788201129.527861:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570035584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201129.527892:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570035584:12345-0@lo:400:kworker.0 Request processed in 31us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201129.527898:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:1.0:1788201129.527926:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201129.527933:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570036096 00000100:00100000:1.0:1788201129.527937:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570036096 00000100:00100000:1.0:1788201129.527961:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788201129.527968:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570036096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201129.527995:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570036096:12345-0@lo:400:kworker.0 Request processed in 28us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201129.528001:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788201129.528016:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201129.528030:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570035584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201129.528041:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570036096:0@lo:400:kworker.0 00010000:00080000:1.0:1788201129.528053:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624904e9c00 x1875064570035968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201129.528077:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570035968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201129.528453:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570035712:12345-0@lo:400:kworker.0 Request processed in 1206us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201129.528460:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201129.528861:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570035456 00000100:00100000:3.0:1788201129.528868:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570035456 00000100:00100000:3.0:1788201129.528914:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201129.528924:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570035456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201129.528969:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201129.529016:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570035456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201129.529023:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788201129.529091:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201129.529118:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c27100 x1875064570035456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201129.529134:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570035456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201129.529501:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570035712:0@lo:400:kworker.0 00010000:00010000:3.0:1788201129.718451:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201130.742518:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201131.767978:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201132.603744:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201132.603772:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570036224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201132.603844:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201132.603912:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570036224 00000100:00100000:2.0:1788201132.603921:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570036224 00000100:00100000:2.0:1788201132.603975:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201132.603984:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570036224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201132.604020:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201132.604075:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570036224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201132.604083:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788201132.604105:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201132.604134:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c6f100 x1875064570036224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201132.604153:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570036224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201132.791449:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201133.814479:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201133.879966:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201133.880013:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201133.880089:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559512192 00000100:00100000:0.0:1788201133.880099:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559512192 00000100:00100000:0.0:1788201133.880158:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 219 00000100:00100000:0.0:1788201133.880168:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2342:x1875064559512192:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201133.880240:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2342:x1875064559512192:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 74us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201133.880248:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 219 00000100:00100000:3.0:1788201133.880460:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559512320 00000100:00100000:3.0:1788201133.880465:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559512320 00000100:00100000:3.0:1788201133.880651:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 86 00000100:00100000:3.0:1788201133.880661:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2341:x1875064559512320:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201133.880713:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2341:x1875064559512320:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 43us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201133.880720:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 86 00000100:00080000:0.0:1788201133.880834:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201134.648752:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570036736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.648835:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201134.648895:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201134.648902:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570036352:0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.648932:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201134.648955:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570036864:0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.649585:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201134.649624:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570036608:0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.649664:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201134.649683:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788201134.649700:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570036480:0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.649721:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201134.649738:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570036992:0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.649777:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201134.649809:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570036736 00000100:00100000:2.0:1788201134.649816:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570036736 00000100:00100000:2.0:1788201134.649866:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570036992 00000100:00100000:2.0:1788201134.649869:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570036992 00000100:00100000:2.0:1788201134.649892:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201134.649907:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570036736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.649956:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570036736:12345-0@lo:400:kworker.0 Request processed in 50us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201134.649963:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201134.650100:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788201134.650108:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570036992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.650144:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570036992:12345-0@lo:400:kworker.0 Request processed in 38us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201134.650150:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788201134.650168:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570036352 00000100:00100000:2.0:1788201134.650173:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570036352 00000100:00100000:2.0:1788201134.650197:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788201134.650203:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570036352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.650232:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570036352:12345-0@lo:400:kworker.0 Request processed in 30us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201134.650239:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788201134.650266:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570036864 00000100:00100000:2.0:1788201134.650269:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570036864 00000100:00100000:2.0:1788201134.650294:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570036608 00000100:00100000:2.0:1788201134.650297:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570036608 00000100:00100000:2.0:1788201134.650311:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570036480 00000100:00100000:2.0:1788201134.650313:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570036480 00000100:00100000:2.0:1788201134.650326:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788201134.650332:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570036864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.650380:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570036864:12345-0@lo:400:kworker.0 Request processed in 49us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201134.650386:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788201134.650405:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788201134.650411:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570036608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.650440:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570036608:12345-0@lo:400:kworker.0 Request processed in 29us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201134.650445:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788201134.650455:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201134.650460:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570036480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.651083:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570036480:12345-0@lo:400:kworker.0 Request processed in 619us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201134.651091:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788201134.651123:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201134.651127:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201134.651129:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201134.651175:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570036480:0@lo:400:kworker.0 00010000:00080000:2.0:1788201134.651190:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c6d500 x1875064570036992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201134.651201:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570036992:0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.651211:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570036608:0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.651244:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570036352:0@lo:400:kworker.0 00000100:00100000:2.0:1788201134.651254:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570036864:0@lo:400:kworker.0 00010000:00080000:2.0:1788201134.651264:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c6dc00 x1875064570036736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201134.651272:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570036736:0@lo:400:kworker.0 00000100:00100000:3.0:1788201134.653753:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570037120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201134.653823:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201134.654125:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570037120 00000100:00100000:2.0:1788201134.654133:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570037120 00000100:00100000:2.0:1788201134.654189:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201134.654198:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570037120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201134.654233:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201134.654292:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570037120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201134.654299:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788201134.654390:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba172680 x1875064570037120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201134.654410:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570037120:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201134.838633:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201135.863107:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201136.890157:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201137.728558:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570037248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201137.728651:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.728724:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570037248 00000100:00100000:2.0:1788201137.728732:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570037248 00000100:00100000:2.0:1788201137.728787:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201137.728797:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570037248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201137.728833:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201137.728875:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570037248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.728881:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788201137.728902:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201137.728955:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c26d80 x1875064570037248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201137.728975:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570037248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201137.910668:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201138.661577:0:11135:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788201138.934910:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201139.002981:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201139.003034:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201139.003192:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559512576 00000100:00100000:3.0:1788201139.003201:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559512576 00000100:00100000:3.0:1788201139.003286:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 90 00000100:00100000:3.0:1788201139.003297:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2344:x1875064559512576:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201139.003406:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2344:x1875064559512576:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 111us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201139.003414:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 90 00000100:00100000:2.0:1788201139.003552:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559512448 00000100:00100000:2.0:1788201139.003557:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559512448 00000100:00100000:2.0:1788201139.003605:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 221 00000100:00100000:2.0:1788201139.003622:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559512448:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201139.003653:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559512448:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 43us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201139.003660:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 221 00000100:00080000:0.0:1788201139.003850:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201139.766662:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201139.766865:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570037376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201139.766930:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201139.768376:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570037504:0@lo:400:kworker.0 00000100:00100000:0.0:1788201139.768440:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201139.768468:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570038016:0@lo:400:kworker.0 00000100:00100000:0.0:1788201139.768489:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201139.768506:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201139.768510:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570037632:0@lo:400:kworker.0 00000100:00100000:0.0:1788201139.768526:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201139.768546:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570037888:0@lo:400:kworker.0 00000100:00100000:0.0:1788201139.768583:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201139.768597:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201139.768617:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570037760:0@lo:400:kworker.0 00000100:00100000:0.0:1788201139.768640:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201139.772546:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570037504 00000100:00100000:2.0:1788201139.772560:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570037504 00000100:00100000:2.0:1788201139.772632:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788201139.772644:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570037504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201139.772769:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570037504:12345-0@lo:400:kworker.0 Request processed in 128us (4329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201139.772777:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788201139.772815:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570038016 00000100:00100000:2.0:1788201139.772821:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570038016 00000100:00100000:2.0:1788201139.772856:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570037632 00000100:00100000:2.0:1788201139.772860:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570037632 00000100:00100000:2.0:1788201139.772872:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570037760 00000100:00100000:2.0:1788201139.772875:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570037760 00000100:00100000:2.0:1788201139.772888:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788201139.772895:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570038016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201139.772930:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570038016:12345-0@lo:400:kworker.0 Request processed in 36us (4439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201139.772936:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788201139.772948:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201139.772965:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570037632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201139.772998:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570037632:12345-0@lo:400:kworker.0 Request processed in 35us (4471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201139.773004:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201139.773017:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788201139.773022:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570037760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201139.773055:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570037760:12345-0@lo:400:kworker.0 Request processed in 33us (4414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201139.773060:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788201139.773094:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570037888 00000100:00100000:2.0:1788201139.773099:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570037888 00000100:00100000:2.0:1788201139.773127:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788201139.773134:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570037888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201139.773163:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570037888:12345-0@lo:400:kworker.0 Request processed in 30us (4579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201139.773168:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788201139.773215:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570037632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201139.773227:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570037504:0@lo:400:kworker.0 00000100:00100000:2.0:1788201139.773237:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570038016:0@lo:400:kworker.0 00000100:00080000:2.0:1788201139.773267:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201139.773271:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201139.773290:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570037760:0@lo:400:kworker.0 00010000:00080000:2.0:1788201139.773304:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624904e9180 x1875064570037888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201139.773327:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570037888:0@lo:400:kworker.0 00000100:00100000:3.0:1788201139.773880:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570037376 00000100:00100000:3.0:1788201139.773887:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570037376 00000100:00100000:3.0:1788201139.773937:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201139.773946:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570037376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201139.773978:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201139.774039:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570037376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (7109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201139.774046:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788201139.774504:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba171c00 x1875064570037376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201139.774522:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570037376:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201139.774665:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201139.960152:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201140.983497:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201142.011484:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201142.785244:0:11282:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0c3ac2c0 20000000:00000080:1.0:1788201142.785262:0:11282:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96248cd60000 uarg=0000000000000000 20000000:01000000:1.0:1788201142.785298:0:11282:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788201142.785304:0:11282:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788201142.785309:0:11282:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788201142.789869:0:11283:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788201142.790111:0:11282:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788201142.797236:0:11282:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788201142.797364:0:11282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201142.797385:0:11282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624829c5800/0xa81c4c9a2f3cab0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99856 expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201142.797394:0:11282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962493611e00/0xa81c4c9a2f3cab1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab13 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201142.797401:0:11282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cab28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab21 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201142.797408:0:11282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3cab36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab2f expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201142.797415:0:11282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201142.797463:0:11282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3cab36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3cab2f expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201142.797479:0:11282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3cab36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab2f expref: 18 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201142.797494:0:11282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11282:1875064570038144:0@lo:104: 00000100:00100000:0.0:1788201142.797590:0:11282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201142.797658:0:11282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cab28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3cab21 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201142.797681:0:11282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cab28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab21 expref: 18 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201142.797690:0:11282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11282:1875064570038272:0@lo:104: 00000100:00100000:0.0:1788201142.797712:0:11282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201142.797739:0:11282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962493611e00/0xa81c4c9a2f3cab1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3cab13 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201142.797747:0:11282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962493611e00/0xa81c4c9a2f3cab1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab13 expref: 18 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201142.797755:0:11282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904e9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11282:1875064570038400:0@lo:104: 00000100:00100000:0.0:1788201142.797778:0:11282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201142.797812:0:11282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624829c5800/0xa81c4c9a2f3cab0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99856 expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201142.797822:0:11282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9624829c5800/0xa81c4c9a2f3cab0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99856 expref: 9 pid: 5820 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201142.797833:0:11282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11282:1875064570038528:192.168.201.56@tcp:104: 00000100:00100000:0.0:1788201142.797880:0:11282:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487f4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201142.798025:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570038144 00000100:00100000:3.0:1788201142.798043:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570038144 00000100:00100000:3.0:1788201142.798084:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570038272 00000100:00100000:3.0:1788201142.798087:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570038272 00000100:00100000:3.0:1788201142.798096:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570038400 00000100:00100000:3.0:1788201142.798099:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570038400 00000100:00100000:3.0:1788201142.798110:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201142.798253:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+5:11282:x1875064570038144:12345-0@lo:104: 00010000:00010000:3.0:1788201142.798267:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cab36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798333:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201142.798368:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+5:11282:x1875064570038144:12345-0@lo:104: Request processed in 91us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201142.798385:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201142.798405:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201142.798410:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+4:11282:x1875064570038272:12345-0@lo:104: 00010000:00010000:3.0:1788201142.798418:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cab28 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798456:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201142.798461:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+4:11282:x1875064570038272:12345-0@lo:104: Request processed in 52us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201142.798467:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201142.798478:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201142.798484:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c842680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:11282:x1875064570038400:12345-0@lo:104: 00010000:00010000:3.0:1788201142.798490:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cab1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798515:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788201142.798520:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c842680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:11282:x1875064570038400:12345-0@lo:104: Request processed in 37us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201142.798525:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788201142.798680:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201142.798686:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cab36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798695:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962493611a00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:3.0:1788201142.798699:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3cab36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798718:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3cab36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201142.798725:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3cab36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201142.798731:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201142.798759:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cab36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798765:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201142.798788:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cab36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798795:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962493611a00/0xa81c4c9a2f3cab2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cab36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798810:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201142.798813:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cab28 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798818:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962480030000 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:3.0:1788201142.798821:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3cab28 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798827:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3cab28 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201142.798834:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3cab28 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201142.798845:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201142.798859:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cab28 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798864:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201142.798879:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cab28 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798885:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962480030000/0xa81c4c9a2f3cab21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cab28 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798898:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201142.798900:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cab1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798906:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624c21f0c00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:3.0:1788201142.798909:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3cab1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798916:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3cab1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201142.798921:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3cab1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201142.798926:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201142.798938:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cab1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798943:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201142.798955:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cab1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798960:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624c21f0c00/0xa81c4c9a2f3cab13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cab1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.798974:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201142.798975:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201142.798977:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201142.798984:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201142.799008:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570038656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201142.799537:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201142.799672:0:11282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11282:1875064570038144:0@lo:104: 00000100:00100000:0.0:1788201142.799684:0:11282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11282:1875064570038272:0@lo:104: 00000100:00100000:0.0:1788201142.799692:0:11282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904e9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11282:1875064570038400:0@lo:104: 00000100:00100000:3.0:1788201142.799763:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570038784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201142.799789:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201142.800167:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570038912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201142.807622:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570038656 00000100:00100000:1.0:1788201142.807640:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570038656 00000100:00100000:2.0:1788201142.807967:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570038784 00000100:00100000:2.0:1788201142.807973:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570038784 00010000:00010000:2.0:1788201142.808017:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cab28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab21 expref: 20 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201142.808076:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201142.808086:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+20:3284:x1875064570038784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201142.808102:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201142.808108:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cab28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab21 expref: 20 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201142.808285:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cab28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab21 expref: 20 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201142.808305:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cab28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab21 expref: 20 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201142.808321:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201142.808438:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3cab36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab2f expref: 19 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201142.808459:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788201142.808468:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788201142.808481:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788201142.808505:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201142.808512:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485696c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570038656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201142.808521:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201142.808525:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3cab36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab2f expref: 19 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.808535:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3cab36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab2f expref: 19 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.808545:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962493610e00/0xa81c4c9a2f3cab36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab2f expref: 19 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.808573:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201142.808646:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485696c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3283:x1875064570038656:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (9110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201142.808653:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201142.808821:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570038656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201142.809216:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3284:x1875064570038784:12345-0@lo:103:ldlm_bl.0 Request processed in 1129us (9423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201142.809224:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201142.809251:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201142.809319:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570038912 00000100:00100000:1.0:1788201142.809325:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570038912 00010000:00010000:1.0:1788201142.809370:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962493611e00/0xa81c4c9a2f3cab1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab13 expref: 17 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201142.809393:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201142.809400:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba170a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3285:x1875064570038912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201142.809410:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201142.809415:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962493611e00/0xa81c4c9a2f3cab1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab13 expref: 17 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.809425:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962493611e00/0xa81c4c9a2f3cab1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab13 expref: 17 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.809447:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962493611e00/0xa81c4c9a2f3cab1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3cab13 expref: 17 pid: 5819 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.809459:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201142.809487:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba170a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570038912:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201142.809494:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201142.809927:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570038784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201142.810064:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201142.810084:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559512704 00000100:00100000:1.0:1788201142.810088:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559512704 00010000:00010000:1.0:1788201142.810106:0:11284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624829c5800/0xa81c4c9a2f3cab0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99856 expref: 10 pid: 5820 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201142.810274:0:11282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11282:1875064570038528:192.168.201.56@tcp:104: 00010000:00010000:3.0:1788201142.810302:0:11282:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201142.810383:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:1.0:1788201142.810392:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c859880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2341:x1875064559512704:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201142.810403:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201142.810408:0:11284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624829c5800/0xa81c4c9a2f3cab0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99856 expref: 10 pid: 5820 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.810419:0:11284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624829c5800/0xa81c4c9a2f3cab0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99856 expref: 10 pid: 5820 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.810433:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624829c5800/0xa81c4c9a2f3cab0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99856 expref: 10 pid: 5820 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.810446:0:11284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.810468:0:11284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.810484:0:11284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.810491:0:11284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.810499:0:11284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.810506:0:11284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.810514:0:11284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962480031800 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:1.0:1788201142.810519:0:11284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.810527:0:11284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.810539:0:11284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201142.810559:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201142.810609:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c859880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:2341:x1875064559512704:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 219us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201142.810616:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 28 00010000:00010000:3.0:1788201142.810817:0:11282:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.810824:0:11282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201142.810831:0:11282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab3d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201142.816232:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570038912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201142.843048:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201142.843085:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570039040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201142.843170:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201142.843224:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570039040 00000100:00100000:3.0:1788201142.843232:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570039040 00000100:00100000:3.0:1788201142.843289:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201142.843300:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570039040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201142.843370:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201142.843411:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570039040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201142.843419:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788201142.843462:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c24000 x1875064570039040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201142.843480:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570039040:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201142.847467:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201143.038093:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201144.054548:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201144.124135:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201144.124196:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201144.124235:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559512960 00000100:00100000:2.0:1788201144.124246:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559512960 00000100:00100000:2.0:1788201144.124337:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 94 00000100:00100000:2.0:1788201144.124376:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2344:x1875064559512960:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201144.124467:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2344:x1875064559512960:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 95us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201144.124474:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 94 00000100:00080000:2.0:1788201144.124496:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201144.124823:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559512832 00000100:00100000:0.0:1788201144.124841:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559512832 00000100:00100000:0.0:1788201144.124880:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 223 00000100:00100000:0.0:1788201144.124887:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:2344:x1875064559512832:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201144.124923:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:2344:x1875064559512832:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 37us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201144.124930:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 223 00000100:00100000:2.0:1788201144.242227:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201144.243209:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559513088 00000100:00100000:3.0:1788201144.243225:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559513088 00000100:00100000:3.0:1788201144.243380:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 224 00000100:00100000:3.0:1788201144.243392:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:5583:x1875064559513088:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201144.243411:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201144.243433:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd9985d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.243464:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9985d expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.243476:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9985d expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.243499:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962493611a00, rc 0) 00000100:00100000:3.0:1788201144.243596:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5583:x1875064559513088:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 206us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201144.243603:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 224 00000100:00100000:3.0:1788201144.248744:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201144.248826:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559513216 00000100:00100000:2.0:1788201144.248835:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559513216 00000100:00100000:2.0:1788201144.248894:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 225 00000100:00100000:2.0:1788201144.248906:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5583:x1875064559513216:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201144.249224:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5583:x1875064559513216:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 Request processed in 319us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201144.249232:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 225 00000100:00100000:2.0:1788201144.252785:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201144.252968:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559513344 00000100:00100000:3.0:1788201144.252980:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559513344 00000100:00100000:3.0:1788201144.253042:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 226 00000100:00100000:3.0:1788201144.253053:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5583:x1875064559513344:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201144.258091:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:5583:x1875064559513344:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 Request processed in 5027us (5303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201144.258107:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 226 10000000:01000000:2.0:1788201144.640161:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201144.640175:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9624bfded000 from 7 10000000:01000000:2.0:1788201144.640183:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201144.640269:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c4400/0xa81c4c9a2f3cab4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.640284:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c4400/0xa81c4c9a2f3cab4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.643540:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c4400/0xa81c4c9a2f3cab4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201144.643856:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201144.643966:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201144.644038:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c80540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201144.644079:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570039168 00000100:00100000:3.0:1788201144.644089:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570039168 00000100:00100000:3.0:1788201144.644159:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788201144.644171:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:5822:x1875064570039168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201144.644194:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201144.644488:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962493611000/0xa81c4c9a2f3cab52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cab4b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.644536:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962493611000/0xa81c4c9a2f3cab52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab4b expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.644569:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962493611000/0xa81c4c9a2f3cab52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab4b expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.644582:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962493611000, rc 0) 00000100:00100000:3.0:1788201144.644898:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570039168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 727us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201144.644905:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788201144.657240:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201144.657286:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c4400/0xa81c4c9a2f3cab4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.657311:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c4400/0xa81c4c9a2f3cab4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cab52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201144.659553:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201144.660210:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201144.661151:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624900cbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201144.663290:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570039296 00000100:00100000:0.0:1788201144.663319:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570039296 00000100:00100000:0.0:1788201144.663417:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788201144.663429:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570039296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201144.664192:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570039296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 760us (3979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201144.664206:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788201144.672250:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201144.672381:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201144.672494:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201144.672576:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570039424 00000100:00100000:3.0:1788201144.672584:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570039424 00000100:00100000:3.0:1788201144.674754:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788201144.674784:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570039424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201144.675089:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570039424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 318us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201144.675098:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788201144.680544:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c80900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201144.680636:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201144.684712:0:11322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788201144.689629:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788201144.689684:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201144.689702:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c4400/0xa81c4c9a2f3cab4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.689718:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c4400/0xa81c4c9a2f3cab4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201144.689866:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201144.689871:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9624902d7800 from 7 10000000:01000000:0.0:1788201144.689875:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201144.689934:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.689943:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.689955:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201144.689989:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201144.690106:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201144.690197:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487f4d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201144.690476:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570039552 00000100:00100000:2.0:1788201144.690488:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570039552 00000100:00100000:2.0:1788201144.690604:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788201144.690616:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:5822:x1875064570039552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201144.690643:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201144.690660:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624829c5600/0xa81c4c9a2f3cab60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cab59 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.690691:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624829c5600/0xa81c4c9a2f3cab60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab59 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.690703:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624829c5600/0xa81c4c9a2f3cab60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab59 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.690713:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5600, rc 0) 00000100:00100000:2.0:1788201144.690775:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570039552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201144.690783:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788201144.696375:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201144.696418:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.696434:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201144.696557:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201144.696879:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201144.696943:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487f4d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201144.697022:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570039680 00000100:00100000:3.0:1788201144.697030:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570039680 00000100:00100000:3.0:1788201144.697093:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788201144.697105:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570039680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201144.697543:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570039680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 439us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201144.697553:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788201144.697633:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201144.697681:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201144.697735:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201144.697762:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570039808 00000100:00100000:3.0:1788201144.697767:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570039808 00000100:00100000:3.0:1788201144.697786:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788201144.697792:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570039808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201144.697953:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570039808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201144.697960:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788201144.697990:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c80900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201144.698002:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201144.699873:0:11324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788201144.700147:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788201144.700176:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201144.700189:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.700204:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201144.700216:0:5822:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201144.700273:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9624902af800 from 7 10000000:01000000:3.0:1788201144.700278:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201144.700696:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493610400/0xa81c4c9a2f3cab67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.700708:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962493610400/0xa81c4c9a2f3cab67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.700747:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962493610400/0xa81c4c9a2f3cab67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201144.700779:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201144.700871:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201144.700974:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c80900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201144.703465:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570039936 00000100:00100000:0.0:1788201144.703484:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570039936 00000100:00100000:0.0:1788201144.703621:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788201144.703634:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570039936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201144.703660:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201144.703686:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cab67 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.703725:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab67 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.703739:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962480031800/0xa81c4c9a2f3cab6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab67 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.703751:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962480031800, rc 0) 00000100:00100000:0.0:1788201144.703863:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570039936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (2991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201144.703887:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788201144.705813:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570039936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201144.705858:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962493610400/0xa81c4c9a2f3cab67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.705871:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962493610400/0xa81c4c9a2f3cab67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cab6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201144.705993:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c85aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570040064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201144.706169:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.708381:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba849d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201144.708613:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570040064 00000100:00100000:3.0:1788201144.708626:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570040064 00000100:00100000:3.0:1788201144.708696:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788201144.708707:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570040064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201144.709557:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570040064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 848us (3386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201144.709569:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788201144.712184:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c85aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570040064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201144.712288:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c85aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570040192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201144.712560:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.712627:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba849d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201144.712792:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570040192 00000100:00100000:2.0:1788201144.712802:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570040192 00000100:00100000:2.0:1788201144.712878:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788201144.712887:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570040192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201144.713164:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570040192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 277us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201144.713172:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788201144.714150:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c85aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570040192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201144.715927:0:11326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788201144.723711:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788201144.723777:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201144.723797:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493610400/0xa81c4c9a2f3cab67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.723815:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493610400/0xa81c4c9a2f3cab67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201144.886930:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201144.886983:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570040320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201144.887082:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.887555:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570040576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201144.887591:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.887614:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201144.887619:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570040448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201144.887639:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.887665:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570040704:0@lo:400:kworker.0 00000100:00100000:1.0:1788201144.887697:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201144.887730:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570040320 00000100:00100000:1.0:1788201144.887744:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201144.887745:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570040320 00000100:00100000:1.0:1788201144.887756:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570040832:0@lo:400:kworker.0 00000100:00100000:1.0:1788201144.887785:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.887830:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570040576 00000100:00100000:1.0:1788201144.887840:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570040576 00000100:00100000:3.0:1788201144.887846:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788201144.887862:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570040320:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201144.887900:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570040448 00000100:00100000:1.0:1788201144.887906:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570040448 00002000:00000024:3.0:1788201144.887919:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201144.887926:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570040832 00000100:00100000:1.0:1788201144.887932:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570040832 00000100:00100000:3.0:1788201144.888029:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570040320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201144.888038:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788201144.888070:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201144.888077:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788201144.888118:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c25880 x1875064570040320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201144.888143:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570040320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201144.889158:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788201144.889189:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570040576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201144.889323:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570040576:12345-0@lo:400:kworker.0 Request processed in 147us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201144.889335:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788201144.889403:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788201144.889409:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570040576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201144.889419:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570040448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201144.889463:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570040448:12345-0@lo:400:kworker.0 Request processed in 48us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201144.889522:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570040448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201144.889873:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788201144.889896:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201144.889904:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570040832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201144.890033:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570040832:12345-0@lo:400:kworker.0 Request processed in 130us (2246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201144.890040:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201144.890080:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570040704 00000100:00100000:1.0:1788201144.890087:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570040704 00000100:00100000:1.0:1788201144.890146:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788201144.890152:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570040704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201144.890202:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570040704:12345-0@lo:400:kworker.0 Request processed in 50us (2505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201144.890210:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788201144.891117:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201144.891176:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570040832:0@lo:400:kworker.0 00010000:00080000:3.0:1788201144.891196:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248cd56680 x1875064570040704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201144.891206:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570040704:0@lo:400:kworker.0 00010000:00010000:3.0:1788201145.084418:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201146.103479:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201147.128162:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201147.958558:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570040960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201147.958648:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201147.958763:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570040960 00000100:00100000:3.0:1788201147.958771:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570040960 00000100:00100000:3.0:1788201147.958836:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201147.958847:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570040960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201147.958885:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201147.958933:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570040960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201147.958942:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788201147.958993:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c25880 x1875064570040960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201147.959013:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570040960:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201147.959076:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788201148.032940:0:11481:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788201148.151253:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201149.174547:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201149.237945:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201149.238150:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559513472 00000100:00100000:0.0:1788201149.238161:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559513472 00000100:00100000:3.0:1788201149.238306:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 236 00000100:00100000:3.0:1788201149.238320:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2341:x1875064559513472:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201149.238467:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2341:x1875064559513472:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 143us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201149.238476:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 236 00000100:00100000:3.0:1788201149.260628:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201149.260823:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559513600 00000100:00100000:1.0:1788201149.260832:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559513600 00000100:00100000:1.0:1788201149.260912:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 98 00000100:00100000:1.0:1788201149.260933:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2341:x1875064559513600:12345-192.168.201.56@tcp:400:kworker.0 00000100:00080000:3.0:1788201149.261198:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201149.261236:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:2341:x1875064559513600:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 306us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201149.261246:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 98 00000100:00100000:2.0:1788201150.006701:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570041088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201150.006785:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201150.006880:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570041216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201150.006922:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201150.006978:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570041600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201150.007006:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201150.007045:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201150.007051:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570041472:0@lo:400:kworker.0 00000100:00100000:2.0:1788201150.007076:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201150.007109:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570041600 00000100:00100000:2.0:1788201150.007117:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570041600 00000100:00100000:0.0:1788201150.007217:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570041088 00000100:00100000:0.0:1788201150.007222:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570041088 00000100:00100000:0.0:1788201150.007279:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201150.007289:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570041088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201150.007322:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201150.007390:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570041088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201150.007398:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788201150.007451:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c26680 x1875064570041088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201150.007470:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570041088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201150.007505:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570041216 00000100:00100000:0.0:1788201150.007508:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570041216 00000100:00100000:0.0:1788201150.007532:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788201150.007538:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570041216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201150.007578:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570041216:12345-0@lo:400:kworker.0 Request processed in 40us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201150.007585:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:0.0:1788201150.007624:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201150.007629:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201150.007641:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570041344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201150.007666:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201150.007687:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201150.007694:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570041728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201150.007712:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201150.007737:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570041472 00000100:00100000:0.0:1788201150.007741:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570041472 00000100:00100000:3.0:1788201150.010649:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570041344 00000100:00100000:3.0:1788201150.010667:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570041344 00000100:00100000:1.0:1788201150.016549:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570041216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201150.016636:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570041728 00000100:00100000:1.0:1788201150.016644:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570041728 00000100:00100000:2.0:1788201150.016921:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201150.016936:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570041600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201150.016979:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788201150.016987:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570041472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201150.017036:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570041472:12345-0@lo:400:kworker.0 Request processed in 51us (9959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201150.017037:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570041600:12345-0@lo:400:kworker.0 Request processed in 107us (10029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201150.017044:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788201150.017044:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788201150.017107:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201150.017158:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570041472:0@lo:400:kworker.0 00010000:00080000:2.0:1788201150.017175:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248cd57b80 x1875064570041600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201150.017186:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570041600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201150.019441:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788201150.019466:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570041344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201150.019579:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570041344:12345-0@lo:400:kworker.0 Request processed in 126us (11910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201150.019586:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788201150.019671:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570041344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201150.026845:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788201150.026877:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570041728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201150.027029:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570041728:12345-0@lo:400:kworker.0 Request processed in 169us (19313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201150.027038:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788201150.028983:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570041728:0@lo:400:kworker.0 00010000:00010000:2.0:1788201150.198878:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201151.223451:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201152.246857:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201152.929288:0:11581:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === replay-ost-single: finish setup 14:32:31 (1788201151) === 00000100:00100000:3.0:1788201152.990858:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201152.990948:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559513728 00000100:00100000:0.0:1788201152.990960:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559513728 00000100:00100000:0.0:1788201152.991036:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:0.0:1788201152.991048:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:7618:x1875064559513728:12345-192.168.201.56@tcp:37:bash.0 00000100:00080000:3.0:1788201152.992012:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201153.020318:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:7618:x1875064559513728:12345-192.168.201.56@tcp:37:bash.0 Request processed in 29261us (29460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.020331:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:1.0:1788201153.057271:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201153.057337:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559513856 00000100:00100000:2.0:1788201153.057473:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559513856 00000100:00100000:2.0:1788201153.057526:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:2.0:1788201153.057536:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:9844:x1875064559513856:12345-192.168.201.56@tcp:101:rm.0 00010000:00010000:2.0:1788201153.057559:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201153.057619:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4800/0xa81c4c9a2f3cab75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99864 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.057705:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3cab7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.057721:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3cab7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.057735:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3cab7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.057765:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.057772:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.057779:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.058747:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3cab7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.058760:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3cab7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.058766:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3cab7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.058772:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5800 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201153.058777:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3cab7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.058798:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3cab7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.058813:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624a8e9fd00) 00010000:00010000:2.0:1788201153.058816:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201153.058821:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3cab7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.058828:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3cab7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.058840:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.058846:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.058851:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.058857:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201153.058859:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.058865:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.058996:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xceb91eaa (ffff9624a84c1f00) 00010000:00010000:2.0:1788201153.058999:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201153.059002:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.059018:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.059072:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4800/0xa81c4c9a2f3cab75 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99864 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.059083:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624a8e9fd00) 00010000:00010000:2.0:1788201153.059085:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201153.059088:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4800/0xa81c4c9a2f3cab75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99864 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.059098:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c4800, rc 0) 00000100:00100000:2.0:1788201153.059208:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:9844:x1875064559513856:12345-192.168.201.56@tcp:101:rm.0 Request processed in 1672us (1946us total) trans 0 rc 301/301 00000100:00100000:2.0:1788201153.059217:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:2.0:1788201153.082877:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201153.082907:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570041856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201153.082987:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201153.083072:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570041856 00000100:00100000:2.0:1788201153.083081:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570041856 00000100:00100000:2.0:1788201153.083137:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788201153.083146:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570041856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201153.083184:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201153.083226:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570041856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201153.083233:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788201153.083459:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201153.083497:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba172300 x1875064570041856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201153.083517:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570041856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201153.090971:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201153.091042:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559513984 00000100:00100000:1.0:1788201153.091079:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559513984 00000100:00100000:1.0:1788201153.091170:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:1.0:1788201153.091183:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:9845:x1875064559513984:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1788201153.091213:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201153.091248:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1000/0xa81c4c9a2f3cab8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd9986b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.091395:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0c00/0xa81c4c9a2f3cab91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.091420:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0c00/0xa81c4c9a2f3cab91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.091438:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0c00/0xa81c4c9a2f3cab91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.099850:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cab98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.099898:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cab98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.099916:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cab98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100300:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0c00/0xa81c4c9a2f3cab91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100311:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0c00/0xa81c4c9a2f3cab91 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100327:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0c00/0xa81c4c9a2f3cab91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100334:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624c21f0c00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201153.100365:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0c00/0xa81c4c9a2f3cab91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100384:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0c00/0xa81c4c9a2f3cab91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100401:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624a8e9fd00) 00010000:00010000:0.0:1788201153.100413:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201153.100420:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0c00/0xa81c4c9a2f3cab91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100428:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0c00/0xa81c4c9a2f3cab91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100446:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cab98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100460:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cab98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100467:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cab98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100473:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962480030800 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201153.100477:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cab98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100484:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cab98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100494:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff9624a8e9f600) 00010000:00010000:0.0:1788201153.100497:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201153.100500:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cab98 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100507:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cab98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100884:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1000/0xa81c4c9a2f3cab8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9986b expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100899:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624a8e9fd00) 00010000:00010000:0.0:1788201153.100902:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201153.100906:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1000/0xa81c4c9a2f3cab8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9986b expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.100919:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f1000, rc 0) 00000100:00100000:0.0:1788201153.101026:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:9845:x1875064559513984:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 9843us (10062us total) trans 0 rc 301/301 00000100:00100000:0.0:1788201153.101038:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:3.0:1788201153.110140:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201153.110408:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559514112 00000100:00100000:1.0:1788201153.110419:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559514112 00000100:00100000:1.0:1788201153.110479:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:1.0:1788201153.110490:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:9845:x1875064559514112:12345-192.168.201.56@tcp:700:lfs.0 00000100:00100000:1.0:1788201153.110597:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:9845:x1875064559514112:12345-192.168.201.56@tcp:700:lfs.0 Request processed in 109us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201153.110605:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:3.0:1788201153.112896:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201153.115592:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559514368 00000100:00100000:2.0:1788201153.115609:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559514368 00000100:00100000:2.0:1788201153.115683:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:2.0:1788201153.115693:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:9845:x1875064559514368:12345-192.168.201.56@tcp:36:lfs.0 00010000:00010000:2.0:1788201153.115756:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201153.115786:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3caa87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99841 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.115809:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624a8e9fd00) 00010000:00010000:2.0:1788201153.115821:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201153.116139:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab9f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.116154:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.116164:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.116177:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3caba6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.116184:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3caba6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.116202:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3caba6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201153.117841:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788201153.117855:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.117862:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab9f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.117869:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.117876:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201153.117880:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.117888:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab9f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.117903:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624a84c1f00) 00010000:00010000:2.0:1788201153.117906:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201153.117910:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab9f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.117917:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cab9f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201153.117936:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000033f4bfa reply state 00000000f3066ae7 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3caba6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201153.117951:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201153.118073:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+7:9845:x1875064559514368:12345-192.168.201.56@tcp:36:lfs.0 Request processed in 2376us (5184us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788201153.118082:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00010000:00010000:3.0:1788201153.124746:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3caba6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.124765:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3caba6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.124773:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3caba6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.124780:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5800 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201153.124799:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3caba6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.124807:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3caba6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.124828:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff9624a84c1800) 00010000:00010000:3.0:1788201153.124832:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201153.124837:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3caba6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.124843:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3caba6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201153.145078:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201153.145123:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559514496 00000100:00100000:2.0:1788201153.145133:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559514496 00000100:00100000:2.0:1788201153.145198:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:2.0:1788201153.145209:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:9846:x1875064559514496:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1788201153.145233:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201153.145267:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cabad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99872 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.145406:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.145422:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.145434:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201153.145511:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788201153.145516:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201153.145543:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.145573:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cabad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99872 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.145604:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99872 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.145613:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624a84c1f00) 00010000:00010000:2.0:1788201153.145616:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201153.145620:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5400, rc 0) 00000100:00100000:2.0:1788201153.145685:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+7:9846:x1875064559514496:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 477us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201153.145693:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:2.0:1788201153.148689:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201153.148778:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559514752 00000100:00100000:3.0:1788201153.148790:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559514752 00000100:00100000:3.0:1788201153.148862:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:3.0:1788201153.148875:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+7:9846:x1875064559514752:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1788201153.148904:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201153.148907:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788201153.148941:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99872 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.148966:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624a84c1f00) 00010000:00010000:3.0:1788201153.148980:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201153.148999:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962493610c00/0xa81c4c9a2f3cabbb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99879 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149202:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962493610a00/0xa81c4c9a2f3cabc2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149233:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962493610a00/0xa81c4c9a2f3cabc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149243:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962493610a00/0xa81c4c9a2f3cabc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149270:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962493611e00/0xa81c4c9a2f3cabc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149277:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962493611e00/0xa81c4c9a2f3cabc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149284:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962493611e00/0xa81c4c9a2f3cabc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149406:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962493610e00/0xa81c4c9a2f3cabd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149415:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962493610e00/0xa81c4c9a2f3cabd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149423:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962493610e00/0xa81c4c9a2f3cabd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201153.149432:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788201153.149444:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962493610e00/0xa81c4c9a2f3cabd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149451:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962493610e00/0xa81c4c9a2f3cabd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149458:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962493610e00/0xa81c4c9a2f3cabd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149470:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962493610e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201153.149480:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962493610e00/0xa81c4c9a2f3cabd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149488:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962493610e00/0xa81c4c9a2f3cabd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149498:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624942a6c00) 00010000:00010000:3.0:1788201153.149500:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201153.149504:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962493610e00/0xa81c4c9a2f3cabd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149509:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962493610e00/0xa81c4c9a2f3cabd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149525:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962493610a00/0xa81c4c9a2f3cabc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149531:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962493610a00/0xa81c4c9a2f3cabc2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149537:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962493610a00/0xa81c4c9a2f3cabc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149542:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962493610a00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201153.149545:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962493610a00/0xa81c4c9a2f3cabc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149551:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962493610a00/0xa81c4c9a2f3cabc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149570:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6d00) 00010000:00010000:3.0:1788201153.149572:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201153.149575:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962493610a00/0xa81c4c9a2f3cabc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149581:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962493610a00/0xa81c4c9a2f3cabc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149590:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962493611e00/0xa81c4c9a2f3cabc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149596:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962493611e00/0xa81c4c9a2f3cabc9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149602:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962493611e00/0xa81c4c9a2f3cabc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149608:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962493611e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201153.149612:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962493611e00/0xa81c4c9a2f3cabc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149623:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962493611e00/0xa81c4c9a2f3cabc9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149631:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff9624942a6100) 00010000:00010000:3.0:1788201153.149632:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201153.149635:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962493611e00/0xa81c4c9a2f3cabc9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149641:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962493611e00/0xa81c4c9a2f3cabc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149682:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962493610c00/0xa81c4c9a2f3cabbb lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99879 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149692:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6d00) 00010000:00010000:3.0:1788201153.149694:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201153.149697:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962493610c00/0xa81c4c9a2f3cabbb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99879 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.149709:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962493610c00, rc 0) 00000100:00100000:3.0:1788201153.149786:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:9846:x1875064559514752:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 914us (1107us total) trans 0 rc 301/301 00000100:00100000:3.0:1788201153.149794:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:3.0:1788201153.153542:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201153.153582:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559514880 00000100:00100000:3.0:1788201153.153591:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559514880 00000100:00100000:3.0:1788201153.153653:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:3.0:1788201153.153663:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+6:9846:x1875064559514880:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1788201153.153685:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201153.153736:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cabd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99880 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.153812:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cabde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.153826:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cabde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.153848:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cabde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201153.153922:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788201153.153927:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201153.153956:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cabde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.153980:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cabd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99880 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.153997:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cabde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99880 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.154006:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6000) 00010000:00010000:3.0:1788201153.154010:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201153.154014:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7da00, rc 0) 00000100:00100000:3.0:1788201153.154074:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+7:9846:x1875064559514880:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 412us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201153.154082:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:2.0:1788201153.183976:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201153.184021:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559515136 00000100:00100000:2.0:1788201153.184032:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559515136 00000100:00100000:2.0:1788201153.184105:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:2.0:1788201153.184117:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+7:9846:x1875064559515136:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1788201153.184142:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201153.184166:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cabe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99887 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.184265:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cabec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.184288:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cabec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.184298:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cabec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.184331:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabf3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.184337:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.184359:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201153.185165:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788201153.185766:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cabec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.185778:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cabec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.185786:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cabec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.185793:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c4e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201153.185798:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cabec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.185806:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cabec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.185823:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6000) 00010000:00010000:2.0:1788201153.185826:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201153.185831:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cabec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.185849:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cabec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.186642:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.186655:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabf3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.186661:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabf3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.186666:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201153.186670:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabf3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.186676:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabf3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.186687:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff9624a84c1600) 00010000:00010000:2.0:1788201153.186691:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201153.186694:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabf3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.186700:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cabf3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.186758:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cabe5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99887 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.186780:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6000) 00010000:00010000:2.0:1788201153.186783:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201153.186787:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cabe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99887 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201153.186795:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5e00, rc 0) 00000100:00100000:2.0:1788201153.186861:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+8:9846:x1875064559515136:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 2745us (2900us total) trans 4294967298 rc 301/301 00000100:00100000:2.0:1788201153.186882:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:2.0:1788201153.195285:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201153.196261:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559515392 00000100:00100000:1.0:1788201153.196272:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559515392 00000100:00100000:1.0:1788201153.196372:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:1.0:1788201153.196384:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+8:9846:x1875064559515392:12345-192.168.201.56@tcp:36:lfs.0 00010000:00010000:1.0:1788201153.196472:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0e00/0xa81c4c9a2f3cac01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.196497:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0e00/0xa81c4c9a2f3cac01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.196509:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0e00/0xa81c4c9a2f3cac01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201153.196725:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078bd51c8 reply state 00000000ad0ca216 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0e00/0xa81c4c9a2f3cac01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201153.196735:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788201153.196749:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000100:00100000:1.0:1788201153.196841:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+10:9846:x1875064559515392:12345-192.168.201.56@tcp:36:lfs.0 Request processed in 458us (1562us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788201153.196848:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 17 00010000:00010000:0.0:1788201153.211138:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0e00/0xa81c4c9a2f3cac01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.211167:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0e00/0xa81c4c9a2f3cac01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.211177:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0e00/0xa81c4c9a2f3cac01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.211184:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624c21f0e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201153.211189:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0e00/0xa81c4c9a2f3cac01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.211196:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0e00/0xa81c4c9a2f3cac01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.211215:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff962487f56d00) 00010000:00010000:0.0:1788201153.211218:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201153.211222:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0e00/0xa81c4c9a2f3cac01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.211229:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0e00/0xa81c4c9a2f3cac01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201153.212442:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201153.212478:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559515648 00000100:00100000:2.0:1788201153.212490:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559515648 00000100:00100000:2.0:1788201153.212539:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:2.0:1788201153.212549:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+9:9846:x1875064559515648:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:2.0:1788201153.213058:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+10:9846:x1875064559515648:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 508us (622us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788201153.213067:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:2.0:1788201153.248702:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201153.249087:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559515904 00000100:00100000:0.0:1788201153.249100:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559515904 00000100:00100000:0.0:1788201153.249179:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:0.0:1788201153.249190:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+10:9847:x1875064559515904:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1788201153.249246:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201153.249274:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962480030000/0xa81c4c9a2f3cac08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd9988e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249401:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962480031c00/0xa81c4c9a2f3cac0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249416:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962480031c00/0xa81c4c9a2f3cac0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249427:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962480031c00/0xa81c4c9a2f3cac0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249442:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cac16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249449:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cac16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249456:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cac16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201153.249607:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788201153.249716:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962480031c00/0xa81c4c9a2f3cac0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249724:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962480031c00/0xa81c4c9a2f3cac0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249731:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962480031c00/0xa81c4c9a2f3cac0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249749:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962480031c00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201153.249754:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962480031c00/0xa81c4c9a2f3cac0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249761:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962480031c00/0xa81c4c9a2f3cac0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249773:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6000) 00010000:00010000:0.0:1788201153.249776:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201153.249780:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962480031c00/0xa81c4c9a2f3cac0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249786:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962480031c00/0xa81c4c9a2f3cac0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249801:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cac16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249805:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cac16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249810:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cac16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249815:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962480030a00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201153.249817:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cac16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249822:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cac16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249839:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff9624a8e9f600) 00010000:00010000:0.0:1788201153.249842:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201153.249845:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cac16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.249851:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cac16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.250179:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962480030000/0xa81c4c9a2f3cac08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9988e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.250191:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6000) 00010000:00010000:0.0:1788201153.250194:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201153.250198:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962480030000/0xa81c4c9a2f3cac08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9988e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201153.250208:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962480030000, rc 0) 00000100:00100000:0.0:1788201153.250500:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+11:9847:x1875064559515904:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1310us (1807us total) trans 4294967301 rc 301/301 00000100:00100000:0.0:1788201153.250509:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:2.0:1788201153.266532:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201153.266761:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559516160 00000100:00100000:1.0:1788201153.266775:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559516160 00000100:00100000:1.0:1788201153.267008:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:1.0:1788201153.267021:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+11:9847:x1875064559516160:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1788201153.267062:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201153.267091:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0e00/0xa81c4c9a2f3cac24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99895 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267182:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1200/0xa81c4c9a2f3cac2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267197:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1200/0xa81c4c9a2f3cac2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267207:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1200/0xa81c4c9a2f3cac2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267251:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1e00/0xa81c4c9a2f3cac32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267260:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1e00/0xa81c4c9a2f3cac32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267267:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1e00/0xa81c4c9a2f3cac32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267469:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1000/0xa81c4c9a2f3cac39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267478:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1000/0xa81c4c9a2f3cac39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267485:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1000/0xa81c4c9a2f3cac39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201153.267496:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788201153.267606:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1200/0xa81c4c9a2f3cac2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267614:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1200/0xa81c4c9a2f3cac2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267621:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1200/0xa81c4c9a2f3cac2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267627:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624c21f1200 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201153.267631:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1200/0xa81c4c9a2f3cac2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267649:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1200/0xa81c4c9a2f3cac2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267663:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6000) 00010000:00010000:1.0:1788201153.267666:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201153.267670:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1200/0xa81c4c9a2f3cac2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267675:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1200/0xa81c4c9a2f3cac2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.267689:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1e00/0xa81c4c9a2f3cac32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.268028:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1e00/0xa81c4c9a2f3cac32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.268037:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1e00/0xa81c4c9a2f3cac32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.268042:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624c21f1e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201153.268054:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1e00/0xa81c4c9a2f3cac32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.268060:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1e00/0xa81c4c9a2f3cac32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.268068:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff962487f56500) 00010000:00010000:1.0:1788201153.268070:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201153.268073:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1e00/0xa81c4c9a2f3cac32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.268089:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1e00/0xa81c4c9a2f3cac32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.269286:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f0e00/0xa81c4c9a2f3cac24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99895 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.269311:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1000/0xa81c4c9a2f3cac39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99895 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201153.269320:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff962487f56f00) 00010000:00010000:1.0:1788201153.269323:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201153.269326:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f1000, rc 0) 00000100:00100000:1.0:1788201153.269442:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+13:9847:x1875064559516160:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 2423us (2923us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788201153.269451:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:2.0:1788201153.273850:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201153.274016:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559516416 00000100:00100000:3.0:1788201153.274028:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559516416 00000100:00100000:3.0:1788201153.274111:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:3.0:1788201153.274121:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+13:9847:x1875064559516416:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:3.0:1788201153.274446:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+14:9847:x1875064559516416:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 326us (608us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788201153.274454:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 3 00010000:00010000:3.0:1788201153.274527:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201153.281530:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201153.282265:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559516544 00000100:00100000:2.0:1788201153.282277:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559516544 00000100:00100000:2.0:1788201153.282514:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:2.0:1788201153.282531:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624afebc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+14:9847:x1875064559516544:12345-192.168.201.56@tcp:33:lfs.0 00000004:00200000:2.0:1788201153.282685:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788201153.282690:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1788201153.282787:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624afebc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+14:9847:x1875064559516544:12345-192.168.201.56@tcp:33:lfs.0 Request processed in 261us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201153.288714:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:2.0:1788201153.292494:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201153.292704:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559516672 00000100:00100000:3.0:1788201153.292714:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559516672 00000100:00100000:3.0:1788201153.292778:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:3.0:1788201153.292790:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+14:9847:x1875064559516672:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1788201153.292815:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201153.292837:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cac47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd9989c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.292931:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cac4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.292946:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cac4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.292961:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cac4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.292978:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c800/0xa81c4c9a2f3cac55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.292984:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c800/0xa81c4c9a2f3cac55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.292991:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c800/0xa81c4c9a2f3cac55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293100:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cac5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293110:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cac5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293138:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cac5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201153.293194:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788201153.293199:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201153.293223:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cac5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293235:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cac4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293242:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cac4e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293248:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cac4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293254:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7ce00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201153.293258:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cac4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293266:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cac4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293280:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6000) 00010000:00010000:3.0:1788201153.293283:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201153.293287:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cac4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293293:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cac4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293319:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c800/0xa81c4c9a2f3cac55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293325:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c800/0xa81c4c9a2f3cac55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293330:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c800/0xa81c4c9a2f3cac55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293336:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7c800 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201153.293553:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c800/0xa81c4c9a2f3cac55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293562:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c800/0xa81c4c9a2f3cac55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293572:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff9624942a6d00) 00010000:00010000:3.0:1788201153.293574:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201153.293577:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c800/0xa81c4c9a2f3cac55 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293582:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c800/0xa81c4c9a2f3cac55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293615:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cac47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9989c expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293630:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cac5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9989c expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201153.293646:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff962487f56f00) 00010000:00010000:3.0:1788201153.293649:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201153.293651:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7c600, rc 0) 00000100:00100000:3.0:1788201153.293730:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+15:9847:x1875064559516672:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 943us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201153.293737:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:3.0:1788201153.301317:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201153.301581:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559516928 00000100:00100000:0.0:1788201153.301592:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559516928 00000100:00100000:0.0:1788201153.301660:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:0.0:1788201153.301670:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+15:9847:x1875064559516928:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:0.0:1788201153.301970:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+16:9847:x1875064559516928:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 301us (665us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788201153.301978:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 5 00000001:00080000:3.0:1788201153.654911:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00010000:00010000:2.0:1788201154.295943:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201154.356986:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201154.357046:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201154.357060:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559517056 00000100:00100000:0.0:1788201154.357073:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559517056 00000100:00100000:0.0:1788201154.357136:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 238 00000100:00100000:0.0:1788201154.357145:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559517056:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201154.357248:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559517056:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 102us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201154.357257:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 238 00000100:00100000:2.0:1788201154.357298:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559517184 00000100:00100000:2.0:1788201154.357305:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559517184 00000100:00100000:2.0:1788201154.357435:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 102 00000100:00080000:0.0:1788201154.357448:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201154.357450:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+8:2344:x1875064559517184:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201154.357520:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0+8:2344:x1875064559517184:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 77us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.357527:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 102 00000100:00100000:1.0:1788201155.126843:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570041984:0@lo:400:kworker.0 00000100:00100000:1.0:1788201155.126949:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201155.127015:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201155.127024:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570042112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201155.127077:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201155.127119:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570041984 00000100:00100000:1.0:1788201155.127127:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570041984 00000100:00100000:1.0:1788201155.127179:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788201155.127188:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570041984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201155.127253:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570041984:12345-0@lo:400:kworker.0 Request processed in 65us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201155.127260:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788201155.127291:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570042112 00000100:00100000:1.0:1788201155.127295:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570042112 00000100:00100000:1.0:1788201155.127328:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201155.127368:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570042112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201155.127403:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201155.127431:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570042112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201155.127437:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788201155.127456:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201155.127618:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0c700 x1875064570042112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201155.127641:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570042112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201155.127653:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570041984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201155.127898:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570042240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201155.127982:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201155.127996:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570042368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201155.128059:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201155.128113:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570042496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201155.128139:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201155.128156:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201155.128162:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570042624:0@lo:400:kworker.0 00000100:00100000:1.0:1788201155.128182:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201155.128207:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570042496 00000100:00100000:1.0:1788201155.128212:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570042496 00000100:00100000:1.0:1788201155.128256:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201155.128264:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570042496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201155.128301:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570042496:12345-0@lo:400:kworker.0 Request processed in 39us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201155.128307:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201155.128325:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570042240 00000100:00100000:1.0:1788201155.128329:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570042240 00000100:00100000:1.0:1788201155.128390:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570042368 00000100:00100000:1.0:1788201155.128393:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570042368 00000100:00100000:1.0:1788201155.128406:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570042624 00000100:00100000:1.0:1788201155.128408:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570042624 00000100:00100000:1.0:1788201155.128420:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788201155.128425:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570042240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201155.128464:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570042240:12345-0@lo:400:kworker.0 Request processed in 38us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201155.128473:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201155.128582:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788201155.128611:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788201155.128611:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570042368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201155.128637:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570042624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201155.128712:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570042624:12345-0@lo:400:kworker.0 Request processed in 83us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201155.128721:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570042368:12345-0@lo:400:kworker.0 Request processed in 124us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201155.128729:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788201155.128743:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788201155.128818:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201155.128823:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201155.128850:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570042368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201155.128881:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570042240:0@lo:400:kworker.0 00000100:00100000:1.0:1788201155.128976:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570042624:0@lo:400:kworker.0 00010000:00080000:1.0:1788201155.128988:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c87f480 x1875064570042496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201155.128999:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570042496:0@lo:400:kworker.0 00000001:02000400:0.0:1788201155.241127:0:11630:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 0a: target handle mismatch (bug 5317) ========================================================== 14:32:33 (1788201153) 00010000:00010000:0.0:1788201155.318976:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201156.342736:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201157.366882:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201158.198977:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201158.199004:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570042752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201158.199093:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201158.199145:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570042752 00000100:00100000:1.0:1788201158.199172:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570042752 00000100:00100000:1.0:1788201158.199289:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201158.199303:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570042752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201158.199375:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201158.199509:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570042752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 209us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201158.199517:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788201158.199602:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201158.199661:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba172680 x1875064570042752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201158.199686:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570042752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788201158.390582:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201159.415749:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201159.474971:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201159.475071:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559517312 00000100:00100000:0.0:1788201159.475081:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559517312 00000100:00100000:0.0:1788201159.475150:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 240 00000100:00100000:0.0:1788201159.475161:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2343:x1875064559517312:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201159.475233:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2343:x1875064559517312:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201159.475240:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 240 00000100:00100000:1.0:1788201160.246653:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201160.246690:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570043136:0@lo:400:kworker.0 00000100:00100000:3.0:1788201160.246761:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201160.246825:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570043648:0@lo:400:kworker.0 00000100:00100000:2.0:1788201160.246836:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570043392:0@lo:400:kworker.0 00000100:00100000:3.0:1788201160.246858:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201160.246882:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201160.246890:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788201160.246898:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570043008:0@lo:400:kworker.0 00000100:00100000:2.0:1788201160.246945:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570043648 00000100:00100000:3.0:1788201160.246948:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201160.246966:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570043648 00000100:00100000:3.0:1788201160.246976:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570043520:0@lo:400:kworker.0 00000100:00100000:3.0:1788201160.247014:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201160.247041:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570043392 00000100:00100000:2.0:1788201160.247046:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570043392 00000100:00100000:3.0:1788201160.247063:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570043136 00000100:00100000:3.0:1788201160.247069:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570043136 00000100:00100000:2.0:1788201160.247078:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201160.247091:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570043648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201160.247108:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570043520 00000100:00100000:3.0:1788201160.247112:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570043520 00000100:00100000:3.0:1788201160.247140:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788201160.247149:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570043136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201160.247157:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570043648:12345-0@lo:400:kworker.0 Request processed in 68us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201160.247165:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201160.247185:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570043136:12345-0@lo:400:kworker.0 Request processed in 37us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201160.247186:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201160.247194:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201160.247200:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570043392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201160.247211:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201160.247217:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570043520:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788201160.247332:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201160.247338:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201160.247366:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201160.247391:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570043520:0@lo:400:kworker.0 00000100:00100000:0.0:1788201160.247400:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570043136:0@lo:400:kworker.0 00000100:00100000:1.0:1788201160.247404:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570043264:0@lo:400:kworker.0 00010000:00080000:0.0:1788201160.247410:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0c700 x1875064570043648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201160.247418:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570043648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201160.247455:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570043008 00000100:00100000:0.0:1788201160.247457:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570043008 00000100:00100000:0.0:1788201160.247478:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788201160.247482:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570043008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201160.251702:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570043520:12345-0@lo:400:kworker.0 Request processed in 4471us (4674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.251719:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788201160.251779:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570043392:12345-0@lo:400:kworker.0 Request processed in 2668us (2984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201160.251792:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788201160.251849:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0ed80 x1875064570043392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201160.251861:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570043392:0@lo:400:kworker.0 00000100:00100000:1.0:1788201160.255707:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201160.255759:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570042880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201160.255802:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201160.255859:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570042880 00000100:00100000:1.0:1788201160.255867:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570042880 00000100:00100000:1.0:1788201160.255913:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201160.255921:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570042880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201160.255962:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201160.256005:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570042880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201160.256011:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788201160.256177:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9c42680 x1875064570042880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201160.256196:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570042880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201160.256305:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570043264 00000100:00100000:2.0:1788201160.256309:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570043264 00000100:00100000:2.0:1788201160.256382:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788201160.256390:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570043264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201160.256433:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570043264:12345-0@lo:400:kworker.0 Request processed in 45us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201160.256439:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788201160.256468:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570043264:0@lo:400:kworker.0 00000100:00080000:1.0:1788201160.256551:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201160.259843:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570043008:12345-0@lo:400:kworker.0 Request processed in 12348us (12884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201160.259858:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788201160.260506:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570043008:0@lo:400:kworker.0 00010000:00010000:2.0:1788201160.438516:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201161.463370:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201162.486619:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201163.319328:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201163.319689:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570043776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201163.319761:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201163.320785:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570043776 00000100:00100000:1.0:1788201163.320795:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570043776 00000100:00100000:1.0:1788201163.320868:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201163.320878:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570043776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201163.320915:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788201163.321065:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201163.321332:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570043776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 454us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201163.321359:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788201163.321442:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba19aa00 x1875064570043776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201163.321462:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570043776:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201163.510860:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201164.536791:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201164.595664:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201164.601637:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559517440 00000100:00100000:1.0:1788201164.601667:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559517440 00000100:00100000:1.0:1788201164.601746:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 242 00000100:00100000:1.0:1788201164.601758:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559517440:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201164.601858:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559517440:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 102us (6223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201164.601865:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 242 00000100:00100000:2.0:1788201165.366679:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201165.366706:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570043904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201165.366801:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201165.366932:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570043904 00000100:00100000:1.0:1788201165.366941:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570043904 00000100:00100000:1.0:1788201165.367014:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201165.367028:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570043904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201165.367071:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201165.367129:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570043904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201165.367136:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788201165.367214:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9c42680 x1875064570043904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201165.367235:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570043904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201165.367390:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570044288:0@lo:400:kworker.0 00000100:00100000:0.0:1788201165.367399:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570044032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201165.367419:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.367430:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201165.367445:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201165.367451:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570044416:0@lo:400:kworker.0 00000100:00100000:0.0:1788201165.367458:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570044544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201165.367476:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.367477:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.367493:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201165.367498:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570044160:0@lo:400:kworker.0 00000100:00100000:1.0:1788201165.367512:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570044416 00000100:00100000:1.0:1788201165.367516:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570044416 00000100:00100000:0.0:1788201165.367518:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201165.367540:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570044032 00000100:00100000:0.0:1788201165.367543:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570044032 00000100:00100000:1.0:1788201165.367545:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201165.367551:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570044416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201165.367567:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788201165.367573:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570044032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201165.367587:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570044416:12345-0@lo:400:kworker.0 Request processed in 37us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201165.367593:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788201165.367601:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570044032:12345-0@lo:400:kworker.0 Request processed in 29us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.367607:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00010000:00080000:1.0:1788201165.367623:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9c41880 x1875064570044416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201165.367633:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570044032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201165.367633:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570044416:0@lo:400:kworker.0 00000100:00100000:3.0:1788201165.367760:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570044288 00000100:00100000:3.0:1788201165.367765:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570044288 00000100:00100000:3.0:1788201165.367804:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570044544 00000100:00100000:3.0:1788201165.367807:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570044544 00000100:00100000:3.0:1788201165.367823:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570044160 00000100:00100000:3.0:1788201165.367832:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570044160 00000100:00100000:3.0:1788201165.367848:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201165.367854:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570044288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201165.367890:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201165.367898:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570044544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201165.367901:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570044288:12345-0@lo:400:kworker.0 Request processed in 48us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201165.367907:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201165.367922:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788201165.367928:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570044160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201165.367930:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570044544:12345-0@lo:400:kworker.0 Request processed in 35us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201165.367935:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788201165.367953:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570044160:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201165.367958:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788201165.367973:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570044160:0@lo:400:kworker.0 00000100:00100000:0.0:1788201165.367982:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570044544:0@lo:400:kworker.0 00000100:00080000:2.0:1788201165.368612:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201165.368619:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201165.368621:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201165.368927:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570044288:0@lo:400:kworker.0 00010000:00010000:0.0:1788201165.559625:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201166.583256:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201167.606586:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201168.438908:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570044672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201168.438979:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201168.439131:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570044672 00000100:00100000:2.0:1788201168.439139:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570044672 00000100:00100000:2.0:1788201168.439207:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788201168.439218:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570044672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201168.439265:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201168.439311:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570044672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201168.439318:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788201168.439834:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788201168.439868:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba19aa00 x1875064570044672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201168.439890:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570044672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788201168.630755:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201168.709081:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201168.709196:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201168.713781:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201168.720069:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559517568 00000100:00100000:1.0:1788201168.720087:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559517568 00000100:00100000:1.0:1788201168.720233:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559517696 00000100:00100000:1.0:1788201168.720237:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559517696 00000100:00100000:2.0:1788201168.720336:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:2.0:1788201168.720363:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+11:2344:x1875064559517568:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201168.720380:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201168.720400:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962481512000/0xa81c4c9a2f3caa95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99848 expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201168.720418:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201168.720480:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+10:2344:x1875064559517568:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 122us (11412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201168.720489:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:2.0:1788201168.720509:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:2.0:1788201168.720515:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+9:2344:x1875064559517696:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201168.720523:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201168.720543:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f1600/0xa81c4c9a2f3caa5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99810 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201168.720554:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201168.720574:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+8:2344:x1875064559517696:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 59us (11378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201168.720580:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:0.0:1788201168.735064:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559517824 00000100:00100000:0.0:1788201168.735080:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559517824 00000100:00100000:0.0:1788201168.735230:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:0.0:1788201168.735244:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+8:2342:x1875064559517824:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201168.735282:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201168.735307:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962493611a00/0xa81c4c9a2f3cab44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9985d expref: 8 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201168.735362:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201168.735433:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+7:2342:x1875064559517824:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 193us (21662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201168.735441:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:3.0:1788201168.771067:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201168.771189:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559518080 00000100:00100000:2.0:1788201168.771200:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559518080 00000100:00100000:2.0:1788201168.771259:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 244 00000100:00100000:2.0:1788201168.771270:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+7:2340:x1875064559518080:12345-192.168.201.56@tcp:251:umount.0 00000020:00000080:2.0:1788201168.771316:0:5819:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3caa48 00000020:00010000:2.0:1788201168.771337:0:5819:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9624b9a36000: total 0 00000100:00080000:2.0:1788201168.771380:0:5819:0:(import.c:65:import_set_state_nolock()) ffff9624b9a30000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201168.771449:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:274e2ee8-531e-4f2c-b7b0-1bae27cf6659+3:2340:x1875064559518080:12345-192.168.201.56@tcp:251:umount.0 Request processed in 181us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201168.771457:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 244 00000020:00010000:0.0:1788201168.771690:0:5814:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9624b9a36000: total 0 00010000:00010000:0.0:1788201168.771738:0:5814:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9624b9a36000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788201168.771773:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3caa9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9984f expref: 2 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201168.771788:0:5814:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9624b9a36000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788201168.771797:0:5814:0:(genops.c:906:class_export_put()) final put ffff9624b9a36000/274e2ee8-531e-4f2c-b7b0-1bae27cf6659 00010000:00010000:0.0:1788201168.771823:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201168.771826:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201168.771827:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201168.772305:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9624b9a36000/274e2ee8-531e-4f2c-b7b0-1bae27cf6659 for MGS 00000020:00000080:2.0:1788201168.772401:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9624b9a30000 for MGS 00010000:00010000:1.0:1788201169.658189:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201170.316315:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201170.316401:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559518208 00000100:00100000:0.0:1788201170.316412:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559518208 00000100:00100000:0.0:1788201170.316457:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 245 00000100:00100000:0.0:1788201170.316466:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2340:x1875064559518208:12345-192.168.201.56@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788201170.316501:0:5820:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 961d4966-9b2e-4bca-bd35-8d9493e230e8@192.168.201.56@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:0.0:1788201170.316529:0:5820:0:(genops.c:1406:class_connect()) connect: client 961d4966-9b2e-4bca-bd35-8d9493e230e8, cookie 0xa81c4c9a2f3cac63 00000100:00080000:0.0:1788201170.316579:0:5820:0:(import.c:65:import_set_state_nolock()) ffff96249852b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201170.316669:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+5:2340:x1875064559518208:12345-192.168.201.56@tcp:250:mount.lustre.0 Request processed in 202us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201170.316695:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 245 00000100:00100000:3.0:1788201170.323615:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201170.323753:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559518336 00000100:00100000:1.0:1788201170.323774:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559518336 00000100:00100000:1.0:1788201170.323836:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 246 00000100:00100000:1.0:1788201170.323847:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+5:10041:x1875064559518336:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201170.323866:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201170.323887:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3cac6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd998b1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.323916:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3cac6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd998b1 expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.323928:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624c21f0c00/0xa81c4c9a2f3cac6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd998b1 expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.323937:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f0c00, rc 0) 00000100:00100000:1.0:1788201170.323991:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+6:10041:x1875064559518336:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 145us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.323997:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 246 00000100:00100000:3.0:1788201170.333480:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201170.334568:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559518464 00000100:00100000:3.0:1788201170.334585:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559518464 00000100:00100000:3.0:1788201170.334655:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 247 00000100:00100000:3.0:1788201170.334667:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+6:10041:x1875064559518464:12345-192.168.201.56@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788201170.334974:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+6:10041:x1875064559518464:12345-192.168.201.56@tcp:501:mount.lustre.0 Request processed in 308us (1503us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201170.334982:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 247 00000100:00100000:2.0:1788201170.342309:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201170.342387:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559518592 00000100:00100000:3.0:1788201170.342414:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559518592 00000100:00100000:3.0:1788201170.342518:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 248 00000100:00100000:3.0:1788201170.342534:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+6:10041:x1875064559518592:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788201170.342566:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201170.342587:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624b9a7c800/0xa81c4c9a2f3cac71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd998b8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201170.342620:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624b9a7c800/0xa81c4c9a2f3cac71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd998b8 expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201170.342632:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624b9a7c800/0xa81c4c9a2f3cac71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd998b8 expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201170.342642:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7c800, rc 0) 00000100:00100000:3.0:1788201170.342699:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+7:10041:x1875064559518592:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 170us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201170.342707:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 248 00000100:00100000:3.0:1788201170.348197:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201170.349306:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559518720 00000100:00100000:1.0:1788201170.349318:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559518720 00000100:00100000:1.0:1788201170.350088:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 249 00000100:00100000:1.0:1788201170.350107:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+7:10041:x1875064559518720:12345-192.168.201.56@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788201170.351046:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+8:10041:x1875064559518720:12345-192.168.201.56@tcp:501:mount.lustre.0 Request processed in 941us (2855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.351058:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 249 00000100:00100000:3.0:1788201170.353214:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201170.353632:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559518848 00000100:00100000:1.0:1788201170.353642:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559518848 00000100:00100000:1.0:1788201170.353697:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 250 00000100:00100000:1.0:1788201170.353708:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+8:10041:x1875064559518848:12345-192.168.201.56@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788201170.353935:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+8:10041:x1875064559518848:12345-192.168.201.56@tcp:503:mount.lustre.0 Request processed in 228us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.353944:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 250 00000100:00100000:3.0:1788201170.366889:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201170.367217:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559518976 00000100:00100000:1.0:1788201170.367230:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559518976 00000100:00100000:1.0:1788201170.367286:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 251 00000100:00100000:1.0:1788201170.367297:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+8:10060:x1875064559518976:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201170.367628:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+8:10060:x1875064559518976:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 331us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.367636:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 251 00000100:00100000:1.0:1788201170.404702:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201170.404809:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559519104 00000100:00100000:3.0:1788201170.404821:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559519104 00000100:00100000:3.0:1788201170.404878:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 252 00000100:00100000:3.0:1788201170.404889:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+8:10060:x1875064559519104:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201170.405202:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+8:10060:x1875064559519104:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 313us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201170.405210:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 252 00000100:00100000:3.0:1788201170.423451:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201170.424173:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559519232 00000100:00100000:1.0:1788201170.424186:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559519232 00000100:00100000:1.0:1788201170.424381:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 253 00000100:00100000:1.0:1788201170.424394:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+8:10041:x1875064559519232:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201170.424414:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201170.424432:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624c21f1e00/0xa81c4c9a2f3cac78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd998e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.424465:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f1e00/0xa81c4c9a2f3cac78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd998e2 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.424476:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624c21f1e00/0xa81c4c9a2f3cac78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd998e2 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.424487:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f1e00, rc 0) 00000100:00100000:1.0:1788201170.424600:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:10041:x1875064559519232:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 208us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.424608:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 253 00000100:00100000:0.0:1788201170.431733:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201170.431827:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559519360 00000100:00100000:2.0:1788201170.431836:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559519360 00000100:00100000:2.0:1788201170.431887:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 254 00000100:00100000:2.0:1788201170.431895:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:10041:x1875064559519360:12345-192.168.201.56@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788201170.431918:0:5819:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788201170.431993:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201170.431997:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788201170.431999:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788201170.432004:0:5819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788201170.436814:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:10041:x1875064559519360:12345-192.168.201.56@tcp:256:mount.lustre.0 Request processed in 4903us (5079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201170.436827:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 254 00000100:00100000:0.0:1788201170.448078:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201170.448205:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559519488 00000100:00100000:1.0:1788201170.448215:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559519488 00000100:00100000:1.0:1788201170.448324:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 255 00000100:00100000:1.0:1788201170.448334:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:10041:x1875064559519488:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201170.448378:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201170.448398:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3cac7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd998e9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.448427:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3cac7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd998e9 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.448439:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624c21f0e00/0xa81c4c9a2f3cac7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd998e9 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.448449:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f0e00, rc 0) 00000100:00100000:1.0:1788201170.448514:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10041:x1875064559519488:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 181us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.448521:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 255 00000100:00100000:0.0:1788201170.451717:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201170.451976:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559519616 00000100:00100000:3.0:1788201170.451987:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559519616 00000100:00100000:3.0:1788201170.452044:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 256 00000100:00100000:3.0:1788201170.452055:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10041:x1875064559519616:12345-192.168.201.56@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788201170.452558:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10041:x1875064559519616:12345-192.168.201.56@tcp:501:mount.lustre.0 Request processed in 503us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201170.452567:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 256 00000100:00100000:2.0:1788201170.455105:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201170.455225:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559519744 00000100:00100000:1.0:1788201170.455235:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559519744 00000100:00100000:1.0:1788201170.455324:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 257 00000100:00100000:1.0:1788201170.455336:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10041:x1875064559519744:12345-192.168.201.56@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788201170.455643:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10041:x1875064559519744:12345-192.168.201.56@tcp:503:mount.lustre.0 Request processed in 308us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.455661:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 257 00000100:00100000:0.0:1788201170.466954:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201170.467034:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559519872 00000100:00100000:3.0:1788201170.467045:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559519872 00000100:00100000:3.0:1788201170.467112:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 258 00000100:00100000:3.0:1788201170.467120:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10065:x1875064559519872:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201170.467402:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10065:x1875064559519872:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 281us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201170.467408:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 258 00000100:00100000:0.0:1788201170.469599:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201170.469685:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559520000 00000100:00100000:1.0:1788201170.469694:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559520000 00000100:00100000:1.0:1788201170.469741:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 259 00000100:00100000:1.0:1788201170.469750:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10065:x1875064559520000:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201170.469985:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10065:x1875064559520000:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 235us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.469993:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 259 00000100:00100000:2.0:1788201170.479748:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201170.479863:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559520128 00000100:00100000:0.0:1788201170.479875:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559520128 00000100:00100000:0.0:1788201170.479933:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:0.0:1788201170.479941:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2340:x1875064559520128:12345-192.168.201.56@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788201170.479971:0:5825:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:0.0:1788201170.480012:0:5825:0:(genops.c:1406:class_connect()) connect: client 986744c8-ee81-4a47-8d91-97f81ede1f3e, cookie 0xa81c4c9a2f3cac86 00000004:00100000:0.0:1788201170.480042:0:5825:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1788201170.480334:0:5825:0:(import.c:65:import_set_state_nolock()) ffff96249852f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201170.480455:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559520128:12345-192.168.201.56@tcp:38:mount.lustre.0 Request processed in 512us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201170.480463:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:1.0:1788201170.487656:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570045184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201170.487744:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201170.487820:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201170.487826:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570045056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201170.487865:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201170.487907:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570045056 00000100:00100000:1.0:1788201170.487915:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570045056 00000100:00100000:2.0:1788201170.488199:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570044800:0@lo:400:kworker.0 00000100:00100000:2.0:1788201170.488246:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201170.488275:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570045312:0@lo:400:kworker.0 00000100:00100000:2.0:1788201170.488297:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201170.488317:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201170.488323:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570044928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201170.488368:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201170.488386:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570045440:0@lo:400:kworker.0 00000100:00100000:2.0:1788201170.488408:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201170.488438:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570045184 00000100:00100000:2.0:1788201170.488442:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570045184 00000100:00100000:2.0:1788201170.488492:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570045440 00000100:00100000:2.0:1788201170.488496:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570045440 00000100:00100000:2.0:1788201170.488520:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201170.488530:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570045184:12345-0@lo:400:kworker.0 00010000:02000000:2.0:1788201170.488553:0:8088:0:(ldlm_lib.c:3345:target_send_reply_msg()) *** cfs_fail_loc=211, val=2147483648*** 00000100:00100000:1.0:1788201170.489109:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570045312 00000100:00100000:1.0:1788201170.489115:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570045312 00000100:00100000:1.0:1788201170.489133:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570044928 00000100:00100000:1.0:1788201170.489135:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570044928 00000100:00100000:1.0:1788201170.489150:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201170.489157:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570045056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201170.489215:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570045056:12345-0@lo:400:kworker.0 Request processed in 58us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.489222:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201170.489240:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201170.489246:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570045312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201170.489298:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570045312:12345-0@lo:400:kworker.0 Request processed in 53us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.489304:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201170.489317:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201170.489324:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570044928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201170.489369:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570044928:12345-0@lo:400:kworker.0 Request processed in 45us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.489375:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201170.489420:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570044928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201170.489434:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570045312:0@lo:400:kworker.0 00000100:00100000:1.0:1788201170.489467:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570045056:0@lo:400:kworker.0 00000100:00100000:0.0:1788201170.490144:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201170.490179:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201170.490197:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559520384 00000100:00100000:0.0:1788201170.490202:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559520384 00000100:00100000:0.0:1788201170.490234:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559520256 00000100:00100000:0.0:1788201170.490237:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559520256 00000100:00100000:0.0:1788201170.490251:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:0.0:1788201170.490258:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:10041:x1875064559520384:12345-192.168.201.56@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788201170.490297:0:6693:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788201170.490398:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:10041:x1875064559520384:12345-192.168.201.56@tcp:41:mount.lustre.0 Request processed in 139us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201170.490404:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:0.0:1788201170.490419:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:0.0:1788201170.490425:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:0:x1875064559520256:12345-192.168.201.56@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788201170.490452:0:6693:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788201170.490477:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:0:x1875064559520256:12345-192.168.201.56@tcp:41:mount.lustre.0 Request processed in 52us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201170.490483:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:3.0:1788201170.492592:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201170.492614:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570045568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201170.492703:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201170.493736:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570045568 00000100:00100000:1.0:1788201170.493747:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570045568 00010000:00020000:2.0:1788201170.495713:0:8088:0:(ldlm_lib.c:3346:target_send_reply_msg()) @@@ dropping reply req@ffff9624c1d5dc50 x1875064570045184/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:291/0 lens 224/224 e 0 to 0 dl 1788201181 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201170.496129:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201170.496151:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875064570045568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201170.496200:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201170.496294:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875064570045568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (3591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.496302:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1788201170.496388:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201170.496395:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201170.496397:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201170.496413:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201170.496422:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570045440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201170.496465:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570045440:12345-0@lo:400:kworker.0 Request processed in 46us (8056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.496486:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788201170.496535:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9c42a00 x1875064570045440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201170.496548:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570045440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201170.496581:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570044800 00000100:00100000:1.0:1788201170.496588:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570044800 00000100:00100000:1.0:1788201170.496623:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788201170.496629:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570044800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201170.496670:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570044800:12345-0@lo:400:kworker.0 Request processed in 40us (8423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.496676:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788201170.496712:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570044800:0@lo:400:kworker.0 00010000:00080000:3.0:1788201170.499464:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9c41500 x1875064570045568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201170.499490:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570045568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201170.543424:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201170.543521:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559520512 00000100:00100000:0.0:1788201170.543532:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559520512 00000100:00100000:0.0:1788201170.543610:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:0.0:1788201170.543622:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:10041:x1875064559520512:12345-192.168.201.56@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788201170.543717:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:10041:x1875064559520512:12345-192.168.201.56@tcp:40:mount.lustre.0 Request processed in 97us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201170.543724:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:3.0:1788201170.547398:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201170.547450:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201170.547484:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201170.547582:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559520640 00000100:00100000:1.0:1788201170.547593:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559520640 00000100:00100000:1.0:1788201170.547640:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559520768 00000100:00100000:1.0:1788201170.547644:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559520768 00000100:00100000:1.0:1788201170.547660:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:1.0:1788201170.547670:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559520640:12345-192.168.201.56@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788201170.547701:0:6668:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:1.0:1788201170.547738:0:6668:0:(genops.c:1406:class_connect()) connect: client 986744c8-ee81-4a47-8d91-97f81ede1f3e, cookie 0xa81c4c9a2f3cac8d 00002000:00100000:1.0:1788201170.547752:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff9624857c3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201170.547781:0:6668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788201170.548484:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201170.548524:0:6668:0:(import.c:65:import_set_state_nolock()) ffff9624857c7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201170.548600:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559520640:12345-192.168.201.56@tcp:8:mount.lustre.0 Request processed in 930us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.548610:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:1.0:1788201170.548633:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:1.0:1788201170.548639:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559520768:12345-192.168.201.56@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788201170.548658:0:6668:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:1.0:1788201170.548678:0:6668:0:(genops.c:1406:class_connect()) connect: client 986744c8-ee81-4a47-8d91-97f81ede1f3e, cookie 0xa81c4c9a2f3cac94 00002000:00100000:1.0:1788201170.548687:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff9624857c1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201170.548694:0:6668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788201170.548833:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788201170.548867:0:6668:0:(import.c:65:import_set_state_nolock()) ffff9624857c6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201170.548897:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559520768:12345-192.168.201.56@tcp:8:mount.lustre.0 Request processed in 257us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.548904:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:0.0:1788201170.553130:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559520896 00000100:00100000:0.0:1788201170.553146:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559520896 00000100:00100000:0.0:1788201170.553205:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:0.0:1788201170.553218:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:10041:x1875064559520896:12345-192.168.201.56@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788201170.553484:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788201170.553647:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:10041:x1875064559520896:12345-192.168.201.56@tcp:33:mount.lustre.0 Request processed in 430us (6259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201170.553656:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:2.0:1788201170.567458:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570045184:12345-0@lo:400:kworker.0 Request processed in 78876us (79662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201170.567476:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1788201170.678662:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201170.738219:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201170.738454:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559521024 00000100:00100000:1.0:1788201170.738465:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559521024 00000100:00100000:1.0:1788201170.738531:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:1.0:1788201170.738542:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:10081:x1875064559521024:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1788201170.738566:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201170.738588:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1200/0xa81c4c9a2f3cac9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99913 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.738655:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1600/0xa81c4c9a2f3caca2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.738688:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1600/0xa81c4c9a2f3caca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.738701:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1600/0xa81c4c9a2f3caca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201170.738928:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788201170.738933:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201170.739015:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1600/0xa81c4c9a2f3caca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.739040:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1200/0xa81c4c9a2f3cac9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99913 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.739056:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1600/0xa81c4c9a2f3caca2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99913 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201170.739074:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6000) 00010000:00010000:1.0:1788201170.739077:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201170.739080:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624c21f1600, rc 0) 00000100:00100000:1.0:1788201170.739147:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:10081:x1875064559521024:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 606us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.739155:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:0.0:1788201170.755622:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201170.755726:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559521152 00000100:00100000:1.0:1788201170.755736:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559521152 00000100:00100000:1.0:1788201170.755816:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:1.0:1788201170.755828:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:10081:x1875064559521152:12345-192.168.201.56@tcp:13:lfs.0 00000100:00080000:2.0:1788201170.755947:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788201170.756101:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201170.756317:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:10081:x1875064559521152:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 489us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.756325:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:3.0:1788201170.770604:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201170.770768:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559521280 00000100:00100000:1.0:1788201170.770778:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559521280 00000100:00100000:1.0:1788201170.770860:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:1.0:1788201170.770872:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:10081:x1875064559521280:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:1.0:1788201170.770900:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788201170.771167:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201170.771292:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:10081:x1875064559521280:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 421us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201170.771300:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 60 00010000:00010000:1.0:1788201171.702921:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201172.726669:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201173.111229:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000100:00100000:2.0:1788201173.560820:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570045696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201173.560942:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201173.561074:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570045696 00000100:00100000:2.0:1788201173.561085:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570045696 00000100:00100000:2.0:1788201173.561160:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201173.561173:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570045696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201173.561223:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201173.561288:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570045696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201173.561297:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788201173.561328:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201173.561401:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c6f800 x1875064570045696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201173.561428:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570045696:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788201173.668647:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00010000:00010000:1.0:1788201173.751154:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201174.168189:0:5847:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00010000:00010000:3.0:1788201174.777882:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201175.607152:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570045824:0@lo:400:kworker.0 00000100:00100000:1.0:1788201175.607280:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201175.607374:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570046336:0@lo:400:kworker.0 00000100:00100000:1.0:1788201175.607407:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201175.607441:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201175.607447:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570045952:0@lo:400:kworker.0 00000100:00100000:1.0:1788201175.607479:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201175.607498:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570046464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201175.607525:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201175.607564:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570046336 00000100:00100000:1.0:1788201175.607574:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570046336 00000100:00100000:1.0:1788201175.607643:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570045952 00000100:00100000:1.0:1788201175.607646:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570045952 00000100:00100000:1.0:1788201175.607693:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201175.607704:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570046336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201175.607895:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570046336:12345-0@lo:400:kworker.0 Request processed in 191us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201175.607904:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201175.607925:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788201175.607932:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570045952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201175.607962:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570045952:12345-0@lo:400:kworker.0 Request processed in 31us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201175.608041:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788201175.608075:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570046464 00000100:00100000:1.0:1788201175.608080:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570046464 00000100:00100000:1.0:1788201175.608109:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201175.608117:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570046464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201175.608151:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570046464:12345-0@lo:400:kworker.0 Request processed in 35us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201175.608157:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201175.608206:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570045952:0@lo:400:kworker.0 00010000:00080000:1.0:1788201175.608222:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9d62a00 x1875064570046464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201175.608233:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570046464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201175.608243:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570046336:0@lo:400:kworker.0 00000100:00100000:2.0:1788201175.608292:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570046080:0@lo:400:kworker.0 00000100:00100000:2.0:1788201175.608330:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201175.608370:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201175.608378:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570046208:0@lo:400:kworker.0 00000100:00100000:1.0:1788201175.608404:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570046080 00000100:00100000:2.0:1788201175.608405:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201175.608408:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570046080 00000100:00100000:1.0:1788201175.608432:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1788201175.608442:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201175.608448:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201175.608449:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570046080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201175.608466:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570046208 00000100:00100000:2.0:1788201175.608470:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570046208 00000100:00100000:2.0:1788201175.608505:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201175.608512:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570046208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201175.608587:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570045824 00000100:00100000:3.0:1788201175.608592:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570045824 00000100:00100000:3.0:1788201175.608624:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788201175.608632:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570045824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201175.618651:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570045824:12345-0@lo:400:kworker.0 Request processed in 10002us (11352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201175.618673:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788201175.618958:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570046080:12345-0@lo:400:kworker.0 Request processed in 10505us (10622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201175.619046:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788201175.619319:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570045824:0@lo:400:kworker.0 00000100:00100000:3.0:1788201175.619605:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570046080:0@lo:400:kworker.0 00000100:00100000:3.0:1788201175.619627:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570046592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201175.619682:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201175.619894:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570046592 00000100:00100000:1.0:1788201175.619902:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570046592 00000100:00100000:1.0:1788201175.620071:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201175.620082:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570046592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201175.620144:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201175.620330:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570046592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 249us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201175.620337:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1788201175.620433:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9c43100 x1875064570046592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201175.620452:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570046592:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201175.621439:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201175.631989:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570046208:12345-0@lo:400:kworker.0 Request processed in 23453us (23559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201175.632025:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788201175.634057:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9d63b80 x1875064570046208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201175.634082:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570046208:0@lo:400:kworker.0 00010000:00010000:1.0:1788201175.798722:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201175.858925:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201175.859012:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201175.859043:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559521408 00000100:00100000:1.0:1788201175.859057:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559521408 00000100:00100000:3.0:1788201175.859059:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201175.859103:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201175.859133:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 262 00000100:00100000:3.0:1788201175.859144:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559521664 00000100:00100000:3.0:1788201175.859148:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559521664 00000100:00100000:3.0:1788201175.859192:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559521792 00000100:00100000:3.0:1788201175.859196:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559521792 00000100:00100000:2.0:1788201175.859202:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559521536 00000100:00100000:2.0:1788201175.859206:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559521536 00000100:00100000:3.0:1788201175.859219:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:3.0:1788201175.859225:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559521664:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201175.859240:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 118 00000100:00100000:2.0:1788201175.859246:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559521536:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201175.859337:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 52 00000100:00100000:0.0:1788201175.859382:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559521792:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201175.859427:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559521408:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201175.859464:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559521664:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 237us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201175.859472:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00080000:3.0:1788201175.859507:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201175.859512:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201175.859515:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201175.863220:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559521536:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 3953us (4139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201175.863239:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 118 00000100:00100000:0.0:1788201175.864931:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559521792:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 5538us (5811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201175.864947:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 52 00000100:00100000:1.0:1788201175.867360:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559521408:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 8183us (8417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201175.867380:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 262 00010000:00010000:3.0:1788201176.826108:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201177.238675:0:11899:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 0b: empty replay =============== 14:32:55 (1788201175) 00010000:00010000:1.0:1788201177.860689:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201178.681899:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570046720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201178.682013:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201178.682127:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570046720 00000100:00100000:0.0:1788201178.682137:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570046720 00000100:00100000:0.0:1788201178.682214:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201178.682227:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570046720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201178.682273:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201178.682329:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570046720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201178.682337:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788201178.682427:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201178.682521:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c87ca80 x1875064570046720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201178.682547:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570046720:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201178.874837:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201179.386559:0:11996:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788201179.386638:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.386657:0:11996:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.386666:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.386674:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201179.386719:0:11996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788201179.386726:0:11996:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788201179.386757:0:11996:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201179.386763:0:11996:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788201179.386770:0:11996:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201179.386806:0:11996:0:(import.c:65:import_set_state_nolock()) ffff96248e16e000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788201179.387538:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570046848:0@lo:39:umount.0 00000100:00100000:0.0:1788201179.387646:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201179.387822:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570046848 00000100:00100000:3.0:1788201179.387832:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570046848 00010000:00010000:1.0:1788201179.387956:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201179.387966:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.387998:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962481512e00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201179.388003:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.388014:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201179.388022:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201179.388029:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201179.388031:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788201179.388034:0:5813:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788201179.388071:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.388077:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201179.388103:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.388110:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962481512e00/0xa81c4c9a2f3caabf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3caac6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.388123:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201179.388125:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201179.388127:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201179.388138:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570046976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201179.388179:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201179.388250:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201179.388265:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570046976 00000100:00100000:0.0:1788201179.388276:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570046976 00000100:00100000:0.0:1788201179.388315:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788201179.388326:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485697450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570046976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201179.388365:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201179.388387:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f1800/0xa81c4c9a2f3caac6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3caabf expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201179.388404:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201179.388448:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485697450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3282:x1875064570046976:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201179.388456:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201179.389646:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201179.389670:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570046976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201179.389675:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875064570046848:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788201179.389716:0:6693:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3ca8ff 00000100:00080000:3.0:1788201179.389741:0:6693:0:(import.c:65:import_set_state_nolock()) ffff962381a3d000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788201179.389838:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+1:3281:x1875064570046848:12345-0@lo:39:umount.0 Request processed in 173us (2191us total) trans 0 rc 0/0 00010000:00010000:0.0:1788201179.389875:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201179.389895:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788201179.389902:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96248e16e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:3.0:1788201179.389925:0:6693:0:(genops.c:906:class_export_put()) final put ffff962381a3c000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00100000:0.0:1788201179.389930:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570046848:0@lo:39:umount.0 00000020:00000080:3.0:1788201179.389988:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff962381a3c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1788201179.390047:0:11996:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201179.390052:0:11996:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201179.390058:0:11996:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788201179.391991:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.392013:0:11996:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.392021:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.392028:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.392053:0:11996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201179.392060:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.392067:0:11996:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.392092:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.392098:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201179.392113:0:11996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788201179.392118:0:11996:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1788201179.392133:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201179.392147:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788201179.392152:0:11996:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00010000:00010000:1.0:1788201179.392155:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962481513c00 already unused, calling callback (ffffffffc1b5cc20) 00000020:01000000:2.0:1788201179.392158:0:11996:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 10000000:00010000:1.0:1788201179.392159:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788201179.392163:0:11996:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1788201179.392169:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:2.0:1788201179.392169:0:11996:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 10000000:00010000:1.0:1788201179.392176:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201179.392182:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201179.392184:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788201179.392187:0:5813:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788201179.392235:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.392243:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201179.392276:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.392284:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962481513c00/0xa81c4c9a2f3caacd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3caad4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.392305:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201179.392309:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.392315:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962480030e00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201179.392325:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.392332:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201179.392338:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201179.392360:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788201179.392363:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788201179.392364:0:5813:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788201179.392383:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.392389:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201179.392406:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.392413:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962480030e00/0xa81c4c9a2f3cab59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cab60 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.392425:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201179.392427:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201179.392428:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201179.393448:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201179.393464:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201179.393498:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570047104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201179.393672:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201179.393829:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570047232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201179.393863:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201179.394437:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570047104 00000100:00100000:1.0:1788201179.394450:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570047104 00000100:00100000:1.0:1788201179.394615:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570047232 00000100:00100000:1.0:1788201179.394620:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570047232 00000100:00100000:1.0:1788201179.394652:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201179.394663:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570047104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201179.394683:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201179.394709:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f1a00/0xa81c4c9a2f3caad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3caacd expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.394733:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201179.394789:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3282:x1875064570047104:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.394798:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201179.394823:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201179.394830:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3284:x1875064570047232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201179.394839:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201179.394849:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624829c5600/0xa81c4c9a2f3cab60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cab59 expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201179.394859:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201179.394885:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064570047232:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201179.394891:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201179.394942:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570047104:0@lo:103:ldlm_bl.0 00002000:00000080:2.0:1788201179.395179:0:11996:0:(ofd_obd.c:1269:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:3.0:1788201179.395374:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff962381a3d000 for lustre-MDT0000 00002000:00100000:2.0:1788201179.395706:0:11996:0:(ofd_obd.c:1283:ofd_iocontrol()) syncing ost lustre-OST0000 00000100:00100000:0.0:1788201179.396028:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570047232:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788201179.404111:0:11996:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788201179.404131:0:11996:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9624857c3800 986744c8-ee81-4a47-8d91-97f81ede1f3e 192.168.201.56@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201179.404138:0:11996:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff96248736f800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788201179.404142:0:11996:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff96248729b380) has exports, disconnecting them 00000020:00080000:2.0:1788201179.404147:0:11996:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.201.56@tcp (ffff9624857c3800), last request at 1788201175 00000020:00000080:2.0:1788201179.404155:0:11996:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cac8d 00000100:00080000:2.0:1788201179.404166:0:11996:0:(import.c:65:import_set_state_nolock()) ffff9624857c7000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788201179.404187:0:11996:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.56@tcp (ffff9624857c3800): rc 0 00010000:00010000:1.0:1788201179.404204:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201179.404287:0:11996:0:(genops.c:906:class_export_put()) final put ffff9624857c3800/986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00080000:2.0:1788201179.404327:0:11996:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff96248736f800), last request at 1788201178 00000020:00000080:2.0:1788201179.404330:0:11996:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3ca94c 00000100:00080000:2.0:1788201179.404335:0:11996:0:(import.c:65:import_set_state_nolock()) ffff962487369800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788201179.404398:0:11996:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96248736f800): rc 0 00000020:00000080:2.0:1788201179.404524:0:11996:0:(genops.c:906:class_export_put()) final put ffff96248736f800/lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788201179.404986:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201179.407716:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9624857c3800/986744c8-ee81-4a47-8d91-97f81ede1f3e for lustre-OST0000 00000020:00000080:3.0:1788201179.407809:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9624857c7000 for lustre-OST0000 00000020:00080000:2.0:1788201179.408706:0:11996:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff96248729b380) has no exports 00000020:00000080:1.0:1788201179.412064:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248736f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788201179.413089:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff962487369800 for lustre-OST0000 00000020:01000000:2.0:1788201179.413218:0:11996:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9624929155a0 - data ffff9624b0c40288/ffff9624b9d38400 00000020:01000000:2.0:1788201179.413754:0:11996:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff962498584ea0 - data ffff9624b3d5d870/ffff96238193bc00 00100000:10000000:3.0:1788201179.432733:0:11996:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788201179.468177:0:11996:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3ca8ce 00000020:00000080:1.0:1788201179.468199:0:11996:0:(genops.c:906:class_export_put()) final put ffff96248736d800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788201179.468222:0:11996:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9624902d7800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788201179.468226:0:11996:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624902d7800 2 00000020:01000004:1.0:1788201179.468229:0:11996:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9624902d7800 from lustre-OST0000 00000020:00000080:1.0:1788201179.468259:0:11996:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201179.468272:0:11996:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788201179.468275:0:11996:0:(genops.c:906:class_export_put()) final put ffff96248736a000/lustre-OST0000_UUID 00000020:00000080:1.0:1788201179.468279:0:11996:0:(genops.c:865:class_export_destroy()) destroying export ffff96248736a000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788201179.468285:0:11996:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788201179.468331:0:11996:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788201179.468335:0:11996:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788201179.468365:0:11996:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201179.468371:0:11996:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201179.468378:0:11996:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff962381a3b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201179.468384:0:11996:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff962487fc3380) has exports, disconnecting them 00000020:00080000:1.0:1788201179.468389:0:11996:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff962381a3b000), last request at 1788201011 00000020:00000080:1.0:1788201179.468392:0:11996:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3ca8f8 00000020:00080000:1.0:1788201179.468401:0:11996:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff962381a3b000): rc 0 00000020:00000080:1.0:1788201179.468407:0:11996:0:(genops.c:906:class_export_put()) final put ffff962381a3b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788201179.469128:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248736d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788201179.469142:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff962381a3b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788201179.470500:0:11996:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788201179.470508:0:11996:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201179.470513:0:11996:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788201179.470520:0:11996:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201179.470665:0:11996:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201179.470674:0:11996:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788201179.470708:0:11996:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624902d7800 1 00000020:00000080:0.0:1788201179.470715:0:11996:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3ca888 00000020:00000080:0.0:1788201179.470722:0:11996:0:(genops.c:906:class_export_put()) final put ffff96248e16d800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788201179.470727:0:11996:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788201179.470732:0:11996:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201179.470737:0:11996:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201179.470740:0:11996:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff962487eb0000) has no exports 00000020:00000080:2.0:1788201179.470809:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96248e16e000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788201179.470816:0:8:0:(genops.c:906:class_export_put()) final put ffff96248f026800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788201179.470819:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248f026800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788201179.470827:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788201179.470922:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248e16d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788201179.494228:0:11996:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201179.494247:0:11996:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788201179.494253:0:11996:0:(genops.c:906:class_export_put()) final put ffff9624902d4000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788201179.494257:0:11996:0:(genops.c:865:class_export_destroy()) destroying export ffff9624902d4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788201179.494271:0:11996:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788201179.494437:0:11996:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9624902d7000 00000020:02000400:2.0:1788201179.494495:0:11996:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788201179.894672:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201180.727079:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201180.730314:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201180.730377:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570047360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201180.730459:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201180.730544:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570047360 00000100:00100000:1.0:1788201180.730552:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570047360 00000100:00100000:1.0:1788201180.730604:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788201180.730614:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064570047360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201180.730673:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064570047360:12345-0@lo:400:kworker.0 Request processed in 60us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201180.730681:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788201180.730747:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570047360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201180.731239:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201180.731252:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570047616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201180.731289:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201180.731581:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570047616 00000100:00100000:1.0:1788201180.731587:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570047616 00000100:00100000:1.0:1788201180.731627:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788201180.731635:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570047616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201180.731693:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570047616:12345-0@lo:400:kworker.0 Request processed in 59us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201180.731701:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788201180.731735:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570047616:0@lo:400:kworker.0 00000100:00100000:0.0:1788201180.731963:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570047488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201180.732002:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201180.732077:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570047488 00000100:00100000:1.0:1788201180.732081:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570047488 00000100:00100000:1.0:1788201180.732167:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201180.732175:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570047488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201180.732205:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201180.732241:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570047488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201180.732247:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788201180.732536:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570047744:0@lo:400:kworker.0 00000100:00100000:2.0:1788201180.732567:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201180.732594:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201180.732600:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570047872:0@lo:400:kworker.0 00000100:00100000:2.0:1788201180.732622:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201180.732648:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570047872 00000100:00100000:2.0:1788201180.732653:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570047872 00000100:00100000:3.0:1788201180.733258:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570047744 00000100:00100000:3.0:1788201180.733264:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570047744 00000100:00100000:3.0:1788201180.733305:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201180.733311:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3284:x1875064570047744:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788201180.733319:0:6671:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788201180.733418:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3284:x1875064570047744:12345-0@lo:400:kworker.0 Request processed in 106us (850us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201180.733425:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788201180.733464:0:3284:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788201180.733469:0:3284:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201180.733474:0:3284:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788201180.738468:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201180.738480:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201180.738551:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624b9c42680 x1875064570047488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201180.738578:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570047488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201180.740640:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788201180.742138:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570047872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201180.742259:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570047872:12345-0@lo:400:kworker.0 Request processed in 1594us (9633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201180.742268:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000004:00080000:3.0:1788201180.743620:0:3284:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1788201180.743628:0:3284:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201180.743637:0:3284:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 146 00000100:00080000:3.0:1788201180.743648:0:3284:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1788201180.743782:0:3284:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624b9d61500 x1875064570048000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201180.743842:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570048000:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:3.0:1788201180.743925:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570047744:0@lo:400:kworker.0 00000100:00100000:3.0:1788201180.743984:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570047872:0@lo:400:kworker.0 00000100:00100000:0.0:1788201180.744081:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201180.744207:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570048000 00000100:00100000:2.0:1788201180.744214:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570048000 00000100:00100000:2.0:1788201180.744287:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201180.744295:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570048000:12345-0@lo:8:ptlrpcd_00_02.0 00010000:00020000:2.0:1788201180.744315:0:6670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201180.744400:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570048000:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 104us (318us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201180.744406:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788201180.744475:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201180.744481:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201180.744485:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570048000:0@lo:8:ptlrpcd_00_02.0 00010000:00010000:1.0:1788201180.921108:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201180.980030:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201180.980069:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201180.980103:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201180.980131:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201180.980160:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559521920 00000100:00100000:3.0:1788201180.980181:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559521920 00000100:00100000:3.0:1788201180.980234:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 264 00000100:00100000:3.0:1788201180.980244:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559521920:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201180.980321:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559521920:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201180.980329:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 264 00000100:00100000:3.0:1788201180.980419:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559522304 00000100:00100000:3.0:1788201180.980424:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559522304 00000100:00100000:3.0:1788201180.980460:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559522176 00000100:00100000:3.0:1788201180.980463:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559522176 00000100:00100000:3.0:1788201180.980477:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:3.0:1788201180.980483:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559522304:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201180.980512:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559522304:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201180.980519:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:3.0:1788201180.980530:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:3.0:1788201180.980534:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1875064559522176:12345-192.168.201.56@tcp:400:kworker.0 00000020:00080000:3.0:1788201180.980539:0:8088:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.56@tcp 00000100:00100000:3.0:1788201180.980558:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1875064559522176:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 23us (426us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201180.980563:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00080000:3.0:1788201180.980688:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201180.982141:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559522048 00000100:00100000:1.0:1788201180.982153:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559522048 00000100:00100000:1.0:1788201180.982236:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 121 00000100:00100000:1.0:1788201180.982246:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559522048:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201180.982320:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559522048:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 77us (2301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201180.982335:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 121 00000100:00080000:2.0:1788201180.983332:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201181.027890:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201181.027943:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559522432 00000100:00100000:0.0:1788201181.027953:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559522432 00000100:00100000:0.0:1788201181.028000:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:0.0:1788201181.028010:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559522432:12345-192.168.201.56@tcp:8:ptlrpcd_00_00.0 00010000:00020000:0.0:1788201181.028032:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201181.028112:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559522432:12345-192.168.201.56@tcp:8:ptlrpcd_00_00.0 Request processed in 101us (242us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201181.028129:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 17 00010000:00010000:2.0:1788201181.942915:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201182.966651:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201183.991954:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201185.014961:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201185.846736:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570048128:0@lo:400:kworker.0 00000100:00100000:2.0:1788201185.846795:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570048256:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201185.846950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201185.846955:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201185.846959:0:36:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201185.846965:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 312 00000100:00080000:1.0:1788201185.846970:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201185.846977:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201185.847000:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624b9c42680 x1875064570048512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201185.849539:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201185.849617:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201185.849630:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570048768:0@lo:400:kworker.0 00000100:00100000:2.0:1788201185.849664:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201185.849706:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570048256 00000100:00100000:2.0:1788201185.849713:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570048256 00000100:00100000:2.0:1788201185.849767:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788201185.849778:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570048256:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201185.851877:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570048640:0@lo:400:kworker.0 00000100:00100000:0.0:1788201185.851968:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201185.851979:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201185.852040:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570048384:0@lo:400:kworker.0 00002000:00000024:2.0:1788201185.852064:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201185.852068:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201185.852100:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570048768 00000100:00100000:3.0:1788201185.852108:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570048768 00000100:00100000:2.0:1788201185.852116:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875064570048256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2341us (2584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201185.852130:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201185.852151:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788201185.852156:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201185.852158:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570048768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201185.852171:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570048640 00000100:00100000:2.0:1788201185.852173:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570048640 00000100:00100000:3.0:1788201185.852200:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570048768:12345-0@lo:400:kworker.0 Request processed in 43us (2536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201185.852202:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570048384 00000100:00100000:2.0:1788201185.852205:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570048384 00000100:00100000:3.0:1788201185.852216:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201185.852223:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788201185.852229:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570048640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201185.852240:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570048128 00000100:00100000:3.0:1788201185.852244:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570048128 00000100:00100000:2.0:1788201185.852262:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570048640:12345-0@lo:400:kworker.0 Request processed in 33us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201185.852265:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788201185.852267:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788201185.852271:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570048128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201185.852277:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788201185.852282:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570048384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201185.852305:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570048384:12345-0@lo:400:kworker.0 Request processed in 24us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201185.852305:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570048128:12345-0@lo:400:kworker.0 Request processed in 34us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201185.852311:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788201185.852312:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788201185.852366:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570048384:0@lo:400:kworker.0 00000100:00100000:3.0:1788201185.852366:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570048128:0@lo:400:kworker.0 00000100:00080000:2.0:1788201185.852385:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788201185.852406:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624bfd2c380 x1875064570048768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201185.852412:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570048512:0@lo:8:kworker.0 00000100:00100000:3.0:1788201185.852417:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570048768:0@lo:400:kworker.0 00010000:00080000:3.0:1788201185.852427:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248c87df80 x1875064570048256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201185.852437:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201185.852441:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570048256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201185.852467:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570048512 00000100:00100000:3.0:1788201185.852470:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570048512 00000100:00100000:3.0:1788201185.852505:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201185.852510:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570048512:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788201185.852525:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201185.858954:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570048640:0@lo:400:kworker.0 00000100:00100000:0.0:1788201185.887589:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570048512:12345-0@lo:8:kworker.0 Request processed in 35070us (35143us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201185.887603:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788201185.888564:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201185.888572:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201185.888577:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570048512:0@lo:8:kworker.0 00010000:00010000:2.0:1788201186.050825:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201186.100105:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201186.100171:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201186.100211:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201186.100372:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559522560 00000100:00100000:3.0:1788201186.100393:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559522560 00000100:00100000:3.0:1788201186.100452:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 266 00000100:00100000:3.0:1788201186.100463:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559522560:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201186.100565:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559522560:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 104us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201186.100573:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 266 00000100:00100000:1.0:1788201186.101031:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559522944 00000100:00100000:1.0:1788201186.101038:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559522944 00000100:00100000:1.0:1788201186.101087:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:1.0:1788201186.101095:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559522944:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201186.101130:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559522944:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 37us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201186.101137:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:3.0:1788201186.107161:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201186.107598:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559522816 00000100:00100000:2.0:1788201186.107621:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559522816 00000100:00100000:2.0:1788201186.107669:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:2.0:1788201186.107679:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875064559522816:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:2.0:1788201186.107705:0:6671:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201186.107784:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875064559522816:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 104us (631us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201186.107791:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00080000:2.0:1788201186.107826:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201186.107838:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559522688 00000100:00100000:2.0:1788201186.107842:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559522688 00000100:00100000:2.0:1788201186.107883:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 124 00000100:00100000:2.0:1788201186.107890:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559522688:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201186.107930:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559522688:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 40us (7838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201186.107936:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 124 00000100:00080000:2.0:1788201186.107955:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00000400:0.0:1788201186.870820:0:3285:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201170/real 1788201170] req@ffff9624b9c40380 x1875064570045184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 1 dl 1788201186 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201186.929529:0:3285:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9624b9c40380 x1875064570045184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 1 dl 1788201186 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201186.929555:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570045184:0@lo:400:kworker.0 00010000:00010000:1.0:1788201187.063679:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201188.086591:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201189.112647:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201190.138418:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201190.967589:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201190.967596:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201190.967600:0:8:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201190.967608:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 317 00000100:00080000:1.0:1788201190.967614:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201190.967636:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201190.967664:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624bfd2f800 x1875064570049152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201190.967971:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570049408:0@lo:400:kworker.0 00000100:00100000:3.0:1788201190.968041:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201190.968109:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201190.968115:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570048896:0@lo:400:kworker.0 00000100:00100000:3.0:1788201190.968148:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201190.968191:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570048896 00000100:00100000:3.0:1788201190.968199:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570048896 00000100:00100000:3.0:1788201190.968247:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788201190.968255:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570048896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201190.968308:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570048896:12345-0@lo:400:kworker.0 Request processed in 54us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201190.968314:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788201190.968388:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570048896:0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.968473:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570049152:0@lo:8:kworker.0 00000100:00100000:2.0:1788201190.968518:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201190.968666:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570049024:0@lo:400:kworker.0 00000100:00100000:0.0:1788201190.968724:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201190.968759:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201190.968766:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570049280:0@lo:400:kworker.0 00000100:00100000:0.0:1788201190.968791:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201190.968975:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570049024 00000100:00100000:2.0:1788201190.968981:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570049024 00000100:00100000:2.0:1788201190.969021:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570049280 00000100:00100000:2.0:1788201190.969024:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570049280 00000100:00100000:2.0:1788201190.969054:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788201190.969060:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570049024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.969101:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570049024:12345-0@lo:400:kworker.0 Request processed in 40us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201190.969119:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788201190.969133:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788201190.969140:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570049280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201190.969170:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570049280:12345-0@lo:400:kworker.0 Request processed in 31us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201190.969175:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1788201190.969196:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201190.969307:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570049408 00000100:00100000:1.0:1788201190.969311:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570049408 00000100:00100000:1.0:1788201190.969362:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570049152 00000100:00100000:1.0:1788201190.969366:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570049152 00000100:00100000:1.0:1788201190.969383:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201190.969391:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570049408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201190.969426:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570049408:12345-0@lo:400:kworker.0 Request processed in 36us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201190.969432:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201190.969444:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201190.969448:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570049152:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788201190.969467:0:6670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788201190.970977:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624bfd2ce00 x1875064570049408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201190.970993:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570049408:0@lo:400:kworker.0 00000100:00100000:3.0:1788201190.971015:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201190.971023:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570049536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201190.971072:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201190.971184:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570049536 00000100:00100000:2.0:1788201190.971191:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570049536 00000100:00100000:2.0:1788201190.971245:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788201190.971254:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570049536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201190.971292:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201190.971336:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570049536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201190.971371:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788201190.971391:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788201190.971415:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624bfd2e680 x1875064570049536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201190.971430:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570049536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201190.971569:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570049280:0@lo:400:kworker.0 00000100:00100000:0.0:1788201190.971584:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570049024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201190.994145:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570049152:12345-0@lo:8:kworker.0 Request processed in 24682us (25613us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201190.994163:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788201190.994501:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201190.994523:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201190.994527:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570049152:0@lo:8:kworker.0 00010000:00010000:1.0:1788201191.160608:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201191.219726:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201191.219790:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201191.219941:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559523072 00000100:00100000:0.0:1788201191.219952:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559523072 00000100:00100000:0.0:1788201191.220012:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 268 00000100:00100000:0.0:1788201191.220023:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559523072:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201191.220135:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559523072:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 113us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201191.220142:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 268 00000100:00100000:2.0:1788201191.220536:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559523200 00000100:00100000:2.0:1788201191.220541:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559523200 00000100:00100000:2.0:1788201191.220605:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 127 00000100:00100000:2.0:1788201191.220614:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559523200:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201191.220657:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559523200:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 44us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201191.220674:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 127 00000100:00080000:0.0:1788201191.220749:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201191.221722:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201191.221860:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201191.230262:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559523328 00000100:00100000:1.0:1788201191.230279:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559523328 00000100:00100000:1.0:1788201191.230335:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559523456 00000100:00100000:1.0:1788201191.230339:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559523456 00000100:00100000:1.0:1788201191.230419:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:1.0:1788201191.230428:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559523328:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:1.0:1788201191.230451:0:6668:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201191.230599:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:3.0:1788201191.230611:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559523456:12345-192.168.201.56@tcp:9:kworker.0 00000020:00000080:3.0:1788201191.230638:0:8088:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cac94 00000100:00080000:3.0:1788201191.230649:0:8088:0:(import.c:65:import_set_state_nolock()) ffff9624857c6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201191.230724:0:8088:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788201191.231084:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+2:2340:x1875064559523456:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 475us (9223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201191.231092:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 22 00010000:00010000:3.0:1788201191.231134:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201191.231441:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201191.231846:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559523328:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 1415us (10126us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201191.231856:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 21 00010000:00010000:1.0:1788201192.187078:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201193.207383:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201194.102246:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:2.0:1788201194.102256:0:7629:0:(genops.c:906:class_export_put()) final put ffff9624857c1000/986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:0.0:1788201194.103867:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9624857c1000/986744c8-ee81-4a47-8d91-97f81ede1f3e for lustre-OST0001 00000020:00000080:0.0:1788201194.103936:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9624857c6000 for lustre-OST0001 00010000:00010000:0.0:1788201194.231284:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201195.256157:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201196.086773:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201196.086793:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570049664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201196.086862:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201196.086972:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570049664 00000100:00100000:2.0:1788201196.086980:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570049664 00000100:00100000:2.0:1788201196.087047:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788201196.087058:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570049664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201196.087097:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201196.087159:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570049664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201196.087166:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1788201196.087207:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624bfd2ed80 x1875064570049664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201196.087226:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570049664:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201196.087536:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201196.091009:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201196.091016:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201196.091019:0:36:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201196.091028:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 323 00000100:00080000:0.0:1788201196.091034:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788201196.091041:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788201196.091063:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624bfd0df80 x1875064570050048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201196.091126:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570050176:0@lo:400:kworker.0 00000100:00100000:0.0:1788201196.091201:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201196.091257:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201196.091263:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570049920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201196.091289:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201196.091320:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570050176 00000100:00100000:0.0:1788201196.091328:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570050176 00000100:00100000:0.0:1788201196.091547:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570049920 00000100:00100000:0.0:1788201196.091552:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570049920 00000100:00100000:0.0:1788201196.091579:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788201196.091599:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570050176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201196.091670:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570050176:12345-0@lo:400:kworker.0 Request processed in 72us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201196.091678:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788201196.091694:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788201196.091701:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570049920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201196.091726:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570049920:12345-0@lo:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201196.091732:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788201196.091775:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570049920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201196.091786:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570050176:0@lo:400:kworker.0 00000100:00080000:0.0:1788201196.091809:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201196.092223:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570049792:0@lo:400:kworker.0 00000100:00100000:2.0:1788201196.092261:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201196.093752:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570050048:0@lo:8:kworker.0 00000100:00100000:2.0:1788201196.093818:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201196.096082:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570050048 00000100:00100000:3.0:1788201196.096095:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570050048 00000100:00100000:2.0:1788201196.096499:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570049792 00000100:00100000:2.0:1788201196.096505:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570049792 00000100:00100000:2.0:1788201196.096547:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788201196.096556:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570049792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201196.097289:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570049792:12345-0@lo:400:kworker.0 Request processed in 732us (5024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201196.097307:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788201196.097395:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570049792:0@lo:400:kworker.0 00000100:00100000:3.0:1788201196.098244:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201196.098254:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570050048:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788201196.098274:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201196.134397:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570050048:12345-0@lo:8:kworker.0 Request processed in 36135us (40569us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201196.134801:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788201196.135003:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201196.135010:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201196.135014:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570050048:0@lo:8:kworker.0 00010000:00010000:2.0:1788201196.289660:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201196.349121:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201196.349162:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201196.349190:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559523712 00000100:00100000:3.0:1788201196.349212:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559523712 00000100:00100000:3.0:1788201196.349277:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00100000:3.0:1788201196.349287:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559523712:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201196.349392:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559523712:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 106us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201196.349517:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00100000:3.0:1788201196.349545:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559523584 00000100:00100000:3.0:1788201196.349549:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559523584 00000100:00100000:3.0:1788201196.349574:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 270 00000100:00100000:3.0:1788201196.349580:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559523584:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201196.349606:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559523584:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201196.349613:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 270 00000100:00080000:3.0:1788201196.349652:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201196.355699:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201196.364715:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559523840 00000100:00100000:1.0:1788201196.364729:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559523840 00000100:00100000:1.0:1788201196.364786:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:1.0:1788201196.364795:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559523840:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:1.0:1788201196.364817:0:6668:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201196.364897:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559523840:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 101us (9210us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201196.364905:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 24 00010000:00010000:1.0:1788201197.314810:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788201198.108409:0:12433:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788201198.108413:0:12433:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788201198.108598:0:12433:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff96248736f800 00000020:01000004:1.0:1788201198.108615:0:12433:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788201198.108629:0:12433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788201198.108645:0:12433:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff962487fc19c0) 00000020:00000080:1.0:1788201198.108662:0:12433:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788201198.242363:0:12433:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788201198.244692:0:12433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788201198.248819:0:12433:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788201198.251076:0:12433:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788201198.253171:0:12433:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788201198.255032:0:12433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 529: rc = 0 00100000:10000000:2.0:1788201198.255139:0:12433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:2.0:1788201198.255236:0:12433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 529: rc = 0 00100000:10000000:3.0:1788201198.266767:0:12433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 377: rc = 0 00100000:10000000:3.0:1788201198.271698:0:12433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 377: rc = 0 00100000:10000000:3.0:1788201198.273137:0:12433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 377: rc = 0 00100000:10000000:2.0:1788201198.277978:0:12433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 377: rc = 0 00100000:10000000:2.0:1788201198.281306:0:12433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 377: rc = 0 00100000:10000000:2.0:1788201198.283082:0:12433:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 377: rc = 0 00000020:00000080:2.0:1788201198.294108:0:12433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788201198.294121:0:12433:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788201198.294136:0:12433:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3cacb0 00000020:01000004:2.0:1788201198.294145:0:12433:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788201198.294169:0:12433:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.156@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788201198.294172:0:12433:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788201198.294178:0:12433:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788201198.294200:0:12433:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788201198.294204:0:12433:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:0.0:1788201198.339155:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788201198.348998:0:12433:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788201198.349047:0:12433:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.156@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788201198.349052:0:12433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788201198.349054:0:12433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201198.349055:0:12433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201198.349057:0:12433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201198.349062:0:12433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201198.349063:0:12433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201198.349065:0:12433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201198.349067:0:12433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201198.349068:0:12433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201198.349071:0:12433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788201198.349073:0:12433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201198.349074:0:12433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201198.349075:0:12433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201198.349076:0:12433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201198.349077:0:12433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201198.349078:0:12433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201198.349079:0:12433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201198.349080:0:12433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201198.349080:0:12433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201198.349108:0:12433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788201198.349129:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570050304:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201198.349203:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201198.349302:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9d783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201198.349510:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570050304 00000100:00100000:0.0:1788201198.349517:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570050304 00000100:00100000:0.0:1788201198.349613:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788201198.349623:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:12433:x1875064570050304:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201198.349655:0:5819:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788201198.349659:0:5819:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788201198.349663:0:5819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788201198.355735:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:12433:x1875064570050304:12345-0@lo:253:mount.lustre.0 Request processed in 6101us (6520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201198.355750:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788201198.355927:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570050304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201198.355943:0:12433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788201198.355946:0:12433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201198.355948:0:12433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201198.355949:0:12433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201198.355950:0:12433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201198.355951:0:12433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201198.355952:0:12433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201198.355954:0:12433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201198.355955:0:12433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201198.355957:0:12433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788201198.356245:0:12433:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96248736f800 from lustre-OST0000 10000000:01000000:2.0:1788201198.356275:0:12433:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788201198.356278:0:12433:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788201198.356287:0:12433:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962485b40000 local copy 00010000:00010000:2.0:1788201198.356298:0:12433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201198.362207:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570050432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201198.362282:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201198.362416:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9d78300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201198.363217:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570050432 00000100:00100000:3.0:1788201198.363226:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570050432 00000100:00100000:3.0:1788201198.363483:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788201198.363561:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:12433:x1875064570050432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201198.363912:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:12433:x1875064570050432:12345-0@lo:501:mount.lustre.0 Request processed in 418us (1629us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201198.363921:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788201198.364015:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570050432:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788201198.364036:0:12433:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788201198.364210:0:12433:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788201198.364220:0:12433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.364232:0:12433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201198.364256:0:12433:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96248736f800 10000000:01000000:3.0:1788201198.364261:0:12433:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788201198.364266:0:12433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788201198.364269:0:12433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201198.364273:0:12433:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788201198.364277:0:12433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201198.364306:0:12433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.364315:0:12433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.364325:0:12433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201198.364381:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570050560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201198.364420:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201198.364632:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624883f7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201198.364729:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570050560 00000100:00100000:0.0:1788201198.364735:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570050560 00000100:00100000:0.0:1788201198.364764:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788201198.364772:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:12433:x1875064570050560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201198.364783:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201198.364796:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962480030e00/0xa81c4c9a2f3cacbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cacb7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201198.364818:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962480030e00/0xa81c4c9a2f3cacbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cacb7 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201198.364828:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962480030e00/0xa81c4c9a2f3cacbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cacb7 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201198.364837:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962480030e00, rc 0) 00000100:00100000:0.0:1788201198.364892:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:12433:x1875064570050560:12345-0@lo:101:mount.lustre.0 Request processed in 119us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201198.364898:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788201198.365030:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570050560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201198.365050:0:12433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.365073:0:12433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201198.369983:0:12433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788201198.372102:0:12433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201198.372627:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788201198.372676:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788201198.372709:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788201198.372754:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788201198.372790:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788201198.372819:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788201198.372969:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788201198.372978:0:12433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788201198.373081:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570050688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201198.373150:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201198.373252:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9d78f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201198.373309:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570050688 00000100:00100000:0.0:1788201198.373317:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570050688 00000100:00100000:0.0:1788201198.373530:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788201198.373540:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:12433:x1875064570050688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201198.373828:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:12433:x1875064570050688:12345-0@lo:501:mount.lustre.0 Request processed in 289us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201198.373836:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788201198.373990:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570050688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201198.374029:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570050816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201198.374070:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201198.374106:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1b37cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201198.374168:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570050816 00000100:00100000:1.0:1788201198.374174:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570050816 00000100:00100000:1.0:1788201198.374252:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788201198.374260:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:12433:x1875064570050816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201198.374532:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:12433:x1875064570050816:12345-0@lo:503:mount.lustre.0 Request processed in 272us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201198.374539:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788201198.374769:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570050816:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201198.375589:0:12433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201198.375671:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570050944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201198.375734:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201198.376179:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623818af480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201198.376262:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570050944 00000100:00100000:1.0:1788201198.376269:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570050944 00000100:00100000:1.0:1788201198.376390:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788201198.376401:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:12433:x1875064570050944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201198.376652:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:12433:x1875064570050944:12345-0@lo:502:mount.lustre.0 Request processed in 252us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201198.376660:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788201198.376777:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570050944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201198.377040:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788201198.377092:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788201198.377128:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788201198.377176:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788201198.377218:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788201198.377250:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788201198.377295:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788201198.377332:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788201198.377398:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788201198.377465:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788201198.377505:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788201198.377553:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788201198.377610:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201198.377664:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201198.378123:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623818af480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201198.378172:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570051072 00000100:00100000:0.0:1788201198.378180:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570051072 00000100:00100000:0.0:1788201198.378217:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788201198.378225:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:12433:x1875064570051072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201198.378458:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:12433:x1875064570051072:12345-0@lo:502:mount.lustre.0 Request processed in 232us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201198.378467:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788201198.378730:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201198.378820:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788201198.378832:0:12433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788201198.380204:0:12436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201198.380215:0:12436:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788201198.380221:0:12436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201198.380224:0:12436:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788201198.380229:0:12436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201198.380247:0:12436:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9624909db380) 00000020:00000080:3.0:1788201198.380277:0:12436:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788201198.380283:0:12436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201198.380438:0:12436:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96248736f800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788201198.380448:0:12436:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201198.380458:0:12436:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3caccc 00010000:00010000:0.0:1788201198.385310:0:12436:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00080000:0.0:1788201198.386785:0:12436:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 4294967298 srv lr: 4294967298 lx: 1875064569998976 gen 0 00000001:00080000:0.0:1788201198.386933:0:12436:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: 986744c8-ee81-4a47-8d91-97f81ede1f3e idx: 1 lr: 0 srv lr: 4294967298 lx: 0 gen 0 00000001:00000004:0.0:1788201198.386953:0:12436:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967298 00080000:10000000:2.0:1788201198.393023:0:12436:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788201198.396889:0:12436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788201198.396903:0:12436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201198.396911:0:12436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201198.396913:0:12436:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788201198.396919:0:12436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788201198.396921:0:12436:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1788201198.396923:0:12436:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201198.396924:0:12436:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201198.396926:0:12436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788201198.396928:0:12436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201198.396930:0:12436:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788201198.396933:0:12436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201198.396937:0:12436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201198.396938:0:12436:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201198.396942:0:12436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201198.396943:0:12436:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788201198.396945:0:12436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201198.396948:0:12436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201198.396949:0:12436:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788201198.396952:0:12436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201198.396954:0:12436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201198.396955:0:12436:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788201198.396958:0:12436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788201198.397033:0:12436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201198.397041:0:12436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201198.397043:0:12436:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788201198.397047:0:12436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788201198.397484:0:12433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788201198.397519:0:12433:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788201198.397537:0:12433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.397549:0:12433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201198.397556:0:12433:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96248736f800 from 1 10000000:01000000:3.0:1788201198.397559:0:12433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201198.397609:0:12433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.397618:0:12433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.397637:0:12433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201198.397666:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201198.397742:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201198.397785:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623818afe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201198.399014:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570051200 00000100:00100000:1.0:1788201198.399024:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570051200 00000100:00100000:1.0:1788201198.399078:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788201198.399088:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:12433:x1875064570051200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201198.399104:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201198.399120:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962498ac2c00/0xa81c4c9a2f3cace8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cace1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.399147:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962498ac2c00/0xa81c4c9a2f3cace8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cace1 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.399159:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962498ac2c00/0xa81c4c9a2f3cace8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cace1 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.399168:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac2c00, rc 0) 00000100:00100000:1.0:1788201198.399223:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:12433:x1875064570051200:12345-0@lo:101:mount.lustre.0 Request processed in 136us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201198.399236:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788201198.400565:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201198.400607:0:12433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.400620:0:12433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201198.432058:0:12433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788201198.432919:0:12433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201198.433208:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788201198.433254:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788201198.433318:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788201198.433326:0:12433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788201198.436164:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201198.436225:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201198.436269:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c80540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201198.436983:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570051328 00000100:00100000:2.0:1788201198.437008:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570051328 00000100:00100000:2.0:1788201198.437057:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788201198.437064:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:12433:x1875064570051328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201198.437960:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:12433:x1875064570051328:12345-0@lo:501:mount.lustre.0 Request processed in 892us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201198.437969:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788201198.444969:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201198.445053:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201198.445132:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201198.446739:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c80540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201198.450052:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570051456 00000100:00100000:3.0:1788201198.450067:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570051456 00000100:00100000:3.0:1788201198.450137:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788201198.450149:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:12433:x1875064570051456:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201198.451074:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:12433:x1875064570051456:12345-0@lo:503:mount.lustre.0 Request processed in 922us (5937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201198.451085:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788201198.451295:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051456:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201198.457991:0:12433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201198.458116:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201198.458208:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201198.458266:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c80540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201198.458530:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570051584 00000100:00100000:3.0:1788201198.458538:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570051584 00000100:00100000:3.0:1788201198.458591:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788201198.458601:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:12433:x1875064570051584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201198.458853:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:12433:x1875064570051584:12345-0@lo:502:mount.lustre.0 Request processed in 252us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201198.458870:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788201198.459616:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201198.460439:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788201198.460653:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788201198.460713:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788201198.460752:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788201198.460784:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000100:00100000:0.0:1788201198.460826:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051712:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201198.460907:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201198.460956:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c80540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201198.461250:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570051712 00000100:00100000:1.0:1788201198.461257:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570051712 00000100:00100000:1.0:1788201198.461307:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788201198.461316:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:12433:x1875064570051712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201198.461784:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:12433:x1875064570051712:12345-0@lo:502:mount.lustre.0 Request processed in 468us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201198.461793:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788201198.462121:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051712:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201198.462243:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788201198.462264:0:12433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1788201198.463765:0:12440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201198.463776:0:12440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201198.463778:0:12440:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788201198.463786:0:12440:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96248736f800 00000020:00000080:0.0:1788201198.463788:0:12440:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201198.463796:0:12440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201198.463799:0:12440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201198.463800:0:12440:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788201198.463802:0:12440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201198.463805:0:12440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201198.463806:0:12440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788201198.463810:0:12440:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96248736f800 00000020:00000080:0.0:1788201198.463812:0:12440:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201198.463988:0:12440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201198.463993:0:12440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201198.463994:0:12440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788201198.463997:0:12440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:1.0:1788201198.464818:0:12433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1788201198.464864:0:12433:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201198.464886:0:12433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.464898:0:12433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201198.464945:0:12433:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788201198.464948:0:12433:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96248736f800 10000000:01000000:1.0:1788201198.464951:0:12433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96248736f800 10000000:01000000:1.0:1788201198.464956:0:12433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201198.464962:0:12433:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96248736f800 from 1 10000000:01000000:1.0:1788201198.464965:0:12433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201198.465005:0:12433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.465014:0:12433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.465027:0:12433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201198.465071:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051840:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201198.465141:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201198.465191:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba0de900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201198.465305:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570051840 00000100:00100000:3.0:1788201198.465314:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570051840 00000100:00100000:3.0:1788201198.465398:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788201198.465407:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:12433:x1875064570051840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201198.465433:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201198.465446:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cacf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cacef expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.465469:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cacf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cacef expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.465478:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cacf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cacef expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.465487:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7d000, rc 0) 00000100:00100000:3.0:1788201198.465547:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:12433:x1875064570051840:12345-0@lo:101:mount.lustre.0 Request processed in 141us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201198.465554:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788201198.465870:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201198.465886:0:12433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201198.465896:0:12433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201198.494293:0:12433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788201198.495136:0:12433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201198.495460:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788201198.495521:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788201198.495558:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788201198.495615:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788201198.495653:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788201198.495700:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788201198.495733:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788201198.495766:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788201198.495811:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788201198.495844:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788201198.495876:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788201198.495924:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788201198.495958:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788201198.496011:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788201198.496062:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788201198.496097:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788201198.496129:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788201198.496174:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788201198.496209:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788201198.496238:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788201198.496283:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788201198.496322:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788201198.496381:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788201198.496431:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788201198.496466:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788201198.496513:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788201198.496560:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788201198.496611:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788201198.496689:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788201198.496697:0:12433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788201198.496801:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201198.496879:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201198.496940:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba0deb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201198.498066:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570051968 00000100:00100000:3.0:1788201198.498079:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570051968 00000100:00100000:3.0:1788201198.498145:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788201198.498156:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:12433:x1875064570051968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201198.498470:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:12433:x1875064570051968:12345-0@lo:501:mount.lustre.0 Request processed in 315us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201198.498479:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788201198.503244:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570051968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201198.503315:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570052096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201198.505100:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201198.510987:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba0deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201198.514208:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570052096 00000100:00100000:1.0:1788201198.514221:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570052096 00000100:00100000:1.0:1788201198.514323:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788201198.514333:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:12433:x1875064570052096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201198.514915:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:12433:x1875064570052096:12345-0@lo:503:mount.lustre.0 Request processed in 508us (9747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201198.514924:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788201198.515055:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570052096:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201198.515690:0:12433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201198.515774:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570052224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201198.515832:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201198.516276:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9d09840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201198.516438:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570052224 00000100:00100000:2.0:1788201198.516445:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570052224 00000100:00100000:2.0:1788201198.516481:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788201198.516488:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:12433:x1875064570052224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201198.516799:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:12433:x1875064570052224:12345-0@lo:502:mount.lustre.0 Request processed in 311us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201198.516807:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788201198.517003:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570052224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201198.517268:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788201198.517325:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788201198.517397:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788201198.517448:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788201198.517482:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788201198.517544:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788201198.517590:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788201198.517628:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788201198.517676:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788201198.517711:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788201198.517745:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788201198.517807:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788201198.518386:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788201198.518436:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788201198.518613:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788201198.518662:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788201198.518718:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788201198.518769:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788201198.518810:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788201198.518922:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788201198.518979:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788201198.519015:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788201198.519045:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788201198.519091:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788201198.519129:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788201198.519179:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788201198.519231:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788201198.519270:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788201198.519305:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788201198.519928:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788201198.519977:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788201198.520005:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788201198.520055:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788201198.520106:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788201198.520144:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788201198.520194:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788201198.520232:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788201198.520268:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788201198.520319:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788201198.520693:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788201198.520757:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570052352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201198.520871:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201198.520931:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9d09840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201198.521114:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570052352 00000100:00100000:1.0:1788201198.521123:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570052352 00000100:00100000:1.0:1788201198.521175:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788201198.521184:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:12433:x1875064570052352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201198.521478:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:12433:x1875064570052352:12345-0@lo:502:mount.lustre.0 Request processed in 295us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201198.521487:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788201198.521811:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570052352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201198.522005:0:12433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788201198.522019:0:12433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788201198.525200:0:12443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788201198.525219:0:12443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff962487fc0000) 00000020:00000080:1.0:1788201198.525260:0:12443:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788201198.526471:0:12443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96248736f800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788201198.526477:0:12443:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96248736f800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788201198.526480:0:12443:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96248736f800 3 00010000:00080000:1.0:1788201198.526738:0:12443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96248591a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.156@tcp at head 00010000:00010000:3.0:1788201198.539121:0:12443:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788201198.539225:0:12443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788201198.539266:0:12443:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201198.539279:0:12443:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa81c4c9a2f3cad04 00000100:00080000:3.0:1788201198.539291:0:12443:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201198.539297:0:12443:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96248591a800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1788201198.539334:0:12443:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624b9c40700 x1875064570052480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201198.539401:0:12443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788201198.539847:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201198.539853:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201198.539856:0:36:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201198.539861:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 328 00000100:00080000:1.0:1788201198.539865:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201198.539869:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201198.539884:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624bfd2d880 x1875064570052736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201198.540852:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201198.540874:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570052992:0@lo:400:kworker.0 00000100:00100000:0.0:1788201198.540948:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201198.540993:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570052480:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201198.541025:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201198.541065:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570052736:0@lo:8:kworker.0 00000100:00100000:0.0:1788201198.541087:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201198.541117:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570052480 00000100:00100000:0.0:1788201198.541124:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570052480 00000100:00100000:0.0:1788201198.541158:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201198.541165:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875064570052480:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788201198.541194:0:5827:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:0.0:1788201198.541228:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa81c4c9a2f3cad0b 00000004:00100000:0.0:1788201198.541241:0:5827:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201198.541272:0:5827:0:(import.c:65:import_set_state_nolock()) ffff9624b9777800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201198.541320:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875064570052480:12345-0@lo:38:llog_process_th.0 Request processed in 154us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201198.541328:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201198.541406:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201198.541415:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788201198.541422:0:3281:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788201198.541426:0:3281:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788201198.541428:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96248591a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201198.541434:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570052480:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201198.541733:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570052864:0@lo:400:kworker.0 00000100:00100000:2.0:1788201198.541765:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201198.541796:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201198.541802:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570052608:0@lo:400:kworker.0 00000100:00100000:2.0:1788201198.541822:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201198.542002:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570052992 00000100:00100000:1.0:1788201198.542008:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570052992 00000100:00100000:1.0:1788201198.542049:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570052736 00000100:00100000:1.0:1788201198.542052:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570052736 00000100:00100000:1.0:1788201198.542068:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201198.542076:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570052992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201198.542122:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570052992:12345-0@lo:400:kworker.0 Request processed in 48us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201198.542128:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201198.542141:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201198.542146:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570052736:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788201198.542178:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570052736:12345-0@lo:8:kworker.0 Request processed in 31us (1091us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201198.542184:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201198.542680:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570052864 00000100:00100000:0.0:1788201198.542687:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570052864 00000100:00100000:0.0:1788201198.542726:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570052608 00000100:00100000:0.0:1788201198.542730:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570052608 00000100:00100000:0.0:1788201198.542750:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788201198.542759:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570052864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201198.542817:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570052864:12345-0@lo:400:kworker.0 Request processed in 59us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201198.542832:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788201198.543195:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201198.543207:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570052608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201198.543252:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570052608:12345-0@lo:400:kworker.0 Request processed in 49us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201198.543259:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1788201198.543279:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201198.543283:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201198.543995:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624bfd2d180 x1875064570052992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201198.544012:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570052992:0@lo:400:kworker.0 00000100:00080000:0.0:1788201198.544052:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201198.544058:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788201198.544062:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570052736:0@lo:8:kworker.0 00000100:00100000:0.0:1788201198.544097:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570052608:0@lo:400:kworker.0 00000100:00100000:0.0:1788201198.544108:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570052864:0@lo:400:kworker.0 00000040:00080000:3.0:1788201198.545980:0:12443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788201198.546674:0:12433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788201198.546705:0:12433:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201198.546720:0:12433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201198.546731:0:12433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788201198.546784:0:12433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788201198.546787:0:12433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201198.546788:0:12433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201198.546789:0:12433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201198.546790:0:12433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201198.546791:0:12433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201198.546793:0:12433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201198.546795:0:12433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201198.546796:0:12433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201198.546800:0:12433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788201198.546802:0:12433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201198.546809:0:12433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201198.546810:0:12433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201198.546811:0:12433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201198.546812:0:12433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201198.546814:0:12433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201198.546815:0:12433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201198.546816:0:12433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201198.546817:0:12433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201198.547535:0:12433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788201198.548696:0:12433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570053120:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201198.548804:0:12433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201198.548886:0:12433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9d09840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201198.551004:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570053120 00000100:00100000:0.0:1788201198.551019:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570053120 00000100:00100000:0.0:1788201198.551086:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788201198.551097:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:12433:x1875064570053120:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201198.551133:0:5818:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788201198.551147:0:5818:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788201198.593208:0:5818:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201198.593230:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788201198.595386:0:5841:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201198.595395:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201198.595426:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201198.595448:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962493610800/0xa81c4c9a2f3caa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3caa02 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201198.595480:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624c21f1e00/0xa81c4c9a2f3cac78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd998e2 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201198.595488:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201198.595745:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624c21f1e00/0xa81c4c9a2f3cac78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd998e2 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201198.595759:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9624c21f1e00/0xa81c4c9a2f3cac78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd998e2 expref: 9 pid: 5818 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201198.595775:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570053248:192.168.201.56@tcp:104: 00010000:00010000:2.0:1788201198.595941:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962493610800/0xa81c4c9a2f3caa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3caa02 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201198.595951:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962493610800/0xa81c4c9a2f3caa09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa02 expref: 19 pid: 5819 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201198.595961:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570053376:0@lo:104: 00000100:00100000:2.0:1788201198.596001:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201198.596028:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff962493656300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201198.596492:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570053376 00000100:00100000:1.0:1788201198.596500:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570053376 00000100:00100000:1.0:1788201198.596799:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201198.596811:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570053376:12345-0@lo:104: 00010000:00010000:1.0:1788201198.596826:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3caa09 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.596963:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201198.596970:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570053376:12345-0@lo:104: Request processed in 161us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201198.596978:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1788201198.596999:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201198.597006:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3caa09 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.597015:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624c21f0600 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201198.597020:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3caa09 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.597030:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3caa09 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201198.597038:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3caa09 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201198.597045:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201198.597077:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3caa09 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.597098:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201198.597123:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3caa09 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.597131:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624c21f0600/0xa81c4c9a2f3caa02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3caa09 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.597163:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201198.597165:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201198.597167:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201198.597193:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570053504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201198.597227:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201198.597272:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570053504 00000100:00100000:1.0:1788201198.597278:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570053504 00010000:00010000:1.0:1788201198.597298:0:11284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962493610800/0xa81c4c9a2f3caa09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa02 expref: 20 pid: 5819 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201198.597321:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201198.597328:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+20:3283:x1875064570053504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201198.597338:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201198.597366:0:11284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962493610800/0xa81c4c9a2f3caa09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa02 expref: 20 pid: 5819 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.597376:0:11284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962493610800/0xa81c4c9a2f3caa09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa02 expref: 20 pid: 5819 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201198.597391:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201198.597429:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+20:3283:x1875064570053504:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201198.597443:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201198.597481:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570053504:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201198.597673:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962493610800/0xa81c4c9a2f3caa09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3caa02 expref: 19 pid: 5819 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201198.597685:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570053376:0@lo:104: 00000100:00100000:3.0:1788201198.599482:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201198.599588:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559523968 00000100:00100000:3.0:1788201198.599597:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559523968 00010000:00010000:3.0:1788201198.599634:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624c21f1e00/0xa81c4c9a2f3cac78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd998e2 expref: 10 pid: 5818 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201198.599666:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:3.0:1788201198.599675:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559523968:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201198.599689:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201198.599694:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624c21f1e00/0xa81c4c9a2f3cac78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd998e2 expref: 10 pid: 5818 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.599705:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624c21f1e00/0xa81c4c9a2f3cac78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd998e2 expref: 10 pid: 5818 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.599740:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.599748:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201198.599764:0:5811:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008489459s 00010000:00010000:3.0:1788201198.599768:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.599775:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.599782:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.599789:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.599795:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c4800 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:3.0:1788201198.599799:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.599807:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.599816:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201198.599827:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201198.600050:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559523968:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 374us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201198.600064:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 30 00010000:00010000:2.0:1788201198.600266:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624c21f1e00/0xa81c4c9a2f3cac78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd998e2 expref: 9 pid: 5818 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201198.600282:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570053248:192.168.201.56@tcp:104: 00010000:00010000:2.0:1788201198.600304:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201198.600325:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201198.600332:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201198.600338:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624829c4800/0xa81c4c9a2f3cad12 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201198.626062:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:12433:x1875064570053120:12345-0@lo:253:mount.lustre.0 Request processed in 74958us (77249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201198.626077:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788201198.626584:0:12433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:12433:1875064570053120:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201198.626601:0:12433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788201198.626604:0:12433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201198.626606:0:12433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201198.626607:0:12433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201198.626609:0:12433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201198.626610:0:12433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201198.626611:0:12433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201198.626613:0:12433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201198.626615:0:12433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201198.626617:0:12433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788201198.626632:0:12433:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788201198.632325:0:12433:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201198.633002:0:12433:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201198.633181:0:12433:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201198.633364:0:12433:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201198.635086:0:12433:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201198.636701:0:12433:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00080000:3.0:1788201198.638088:0:12433:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-OST0000, 2 recoverable clients, last_transno 4294967298 00010000:00080000:0.0:1788201198.638944:0:12449:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-OST0000: started recovery thread pid 12449 00010000:00080000:0.0:1788201198.638995:0:12449:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788201198.639000:0:12449:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1788201198.639068:0:12433:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788201198.639113:0:12433:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788201198.639124:0:12433:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788201198.639148:0:12433:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788201199.350981:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201199.990738:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201199.994065:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559524096 00000100:00100000:0.0:1788201199.994077:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559524096 00000100:00100000:0.0:1788201199.994153:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 289 00000100:00100000:0.0:1788201199.994165:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:10055:x1875064559524096:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201199.994182:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201199.994201:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3cad19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd9991a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201199.994231:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3cad19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9991a expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201199.994241:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3cad19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9991a expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201199.994267:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962480031c00, rc 0) 00000100:00100000:0.0:1788201199.994356:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559524096:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 177us (3610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201199.994365:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 289 00000100:00100000:3.0:1788201199.997371:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201199.997642:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559524224 00000100:00100000:1.0:1788201199.997654:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559524224 00000100:00100000:1.0:1788201199.997908:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 290 00000100:00100000:1.0:1788201199.997922:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559524224:12345-192.168.201.56@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201199.998156:0:5818:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1788201199.998175:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201199.998178:0:5818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788201200.011108:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559524224:12345-192.168.201.56@tcp:256:ll_cfg_requeue.0 Request processed in 13178us (13766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.011123:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 290 00000100:00100000:0.0:1788201200.014782:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201200.015029:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559524352 00000100:00100000:1.0:1788201200.015039:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559524352 00000100:00100000:1.0:1788201200.015093:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:1.0:1788201200.015103:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559524352:12345-192.168.201.56@tcp:8:ll_cfg_requeue.0 00010000:00080000:1.0:1788201200.015138:0:8088:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '986744c8-ee81-4a47-8d91-97f81ede1f3e' at ffff9624b9771800, cookie 0xa81c4c9a2f3cacda 00010000:00080000:1.0:1788201200.015144:0:8088:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp recovering/t0 exp ffff9624b9771800 cur 332 last 1788201198 00010000:02000400:1.0:1788201200.015154:0:8088:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1788201200.026659:0:8088:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:2.0:1788201200.038849:0:8088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff9624b9771800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 2097152 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788201200.038886:0:8088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00000100:00080000:2.0:1788201200.039068:0:8088:0:(import.c:65:import_set_state_nolock()) ffff96248ced5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201200.039142:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559524352:12345-192.168.201.56@tcp:8:ll_cfg_requeue.0 Request processed in 24040us (24372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.039150:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:1.0:1788201200.047387:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201200.047587:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559524480 00000100:00100000:3.0:1788201200.047601:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559524480 00000100:00100000:3.0:1788201200.047666:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:3.0:1788201200.047676:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559524480:12345-192.168.201.56@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788201200.048197:0:6670:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff9624bfd2c700 x1875064559524480/t0(0) o400->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:321/0 lens 224/0 e 0 to 0 dl 1788201211 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201200.048216:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559524480:12345-192.168.201.56@tcp:400:ldlm_lock_repla.0 Request processed in 544us (841us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201200.048223:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 58 00010000:00080000:0.0:1788201200.048261:0:12449:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:2.0:1788201200.182437:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201200.182445:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9624902af800 from 6 10000000:01000000:2.0:1788201200.182450:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201200.182493:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.182506:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.182518:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201200.182546:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570053632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201200.182663:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.182726:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962493656e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201200.185370:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570053632 00000100:00100000:0.0:1788201200.185385:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570053632 00000100:00100000:0.0:1788201200.185438:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788201200.185448:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570053632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201200.185465:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201200.185483:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3cad27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cad20 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.185512:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3cad27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cad20 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.185534:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3cad27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cad20 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.185543:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962480031a00, rc 0) 00000100:00100000:0.0:1788201200.185833:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570053632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 386us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201200.185840:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788201200.188987:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570053632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201200.189027:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cad27 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.189056:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cad27 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201200.189132:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570053760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788201200.189200:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.189252:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201200.189283:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570053760 00000100:00100000:0.0:1788201200.189290:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570053760 00000100:00100000:0.0:1788201200.190012:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788201200.190031:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570053760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201200.190058:0:5818:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201200.190078:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201200.190082:0:5818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788201200.190191:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570053760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 166us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201200.190199:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788201200.190254:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570053760:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1788201200.190304:0:5822:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff96249852b000 already not connected (conn 6, was 0): DISCONN 00010000:00080000:0.0:1788201200.190315:0:5822:0:(ldlm_lib.c:85:import_set_conn()) imp ffff96249852b000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.201.156@tcp, moved to head 00000100:00080000:0.0:1788201200.190321:0:5822:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201200.190327:0:5822:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788201200.190445:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962492c24a80 x1875064570053888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1788201200.190489:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201200.190498:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cad27 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.190512:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cad27 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201200.191009:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570053888:0@lo:8:ll_cfg_requeue.0 00000100:00100000:0.0:1788201200.191058:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.191110:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570053888 00000100:00100000:0.0:1788201200.191117:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570053888 00000100:00100000:0.0:1788201200.191149:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201200.191155:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875064570053888:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1788201200.191181:0:6668:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff9624b9775800, cookie 0xa81c4c9a2f3cacd3 00010000:00080000:0.0:1788201200.191187:0:6668:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff9624b9775800 cur 332 last 1788201198 00002000:00100000:0.0:1788201200.191206:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9624b9775800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788201200.191211:0:6668:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788201200.191214:0:6668:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1788201200.191887:0:6668:0:(import.c:65:import_set_state_nolock()) ffff9624902d7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201200.192010:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570053888:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 852us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201200.192019:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788201200.192061:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c24a80 x1875064570053888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201200.192076:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788201200.192087:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1788201200.192092:0:3281:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788201200.192095:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00080000:0.0:1788201200.192107:0:3281:0:(recover.c:53:ptlrpc_replay_next()) import ffff96249852b000 from lustre-OST0000_UUID committed 4294967298 last 0 00000100:00080000:0.0:1788201200.192110:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1788201200.192275:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570053888:0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1788201200.192299:0:12518:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1788201200.192303:0:12518:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:0.0:1788201200.192309:0:12518:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:0.0:1788201200.192441:0:12518:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1788201200.192479:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570054016:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788201200.192516:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.192573:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570054016 00000100:00100000:0.0:1788201200.192579:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570054016 00000100:00100000:0.0:1788201200.192744:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201200.192754:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570054016:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788201200.192768:0:6671:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff962492c24700 x1875064570054016/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:321/0 lens 224/0 e 0 to 0 dl 1788201211 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788201200.197801:0:12449:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788201200.197821:0:12449:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 4294967299 00010000:00080000:1.0:1788201200.197827:0:12449:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294967299 00010000:00080000:1.0:1788201200.197831:0:12449:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00010000:00080000:1.0:1788201200.197837:0:12449:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788201200.197839:0:12449:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788201200.198169:0:12449:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788201200.208761:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570054016:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 15997us (16233us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201200.208777:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788201200.373215:0:12449:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:1.0:1788201200.373240:0:12449:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.201.56@tcp: req@ffff9624bfd2c700 x1875064559524480/t0(0) o400->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:321/0 lens 224/0 e 0 to 0 dl 1788201211 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788201200.373396:0:12449:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff962492c24700 x1875064570054016/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:321/0 lens 224/0 e 0 to 0 dl 1788201211 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788201200.373480:0:12449:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 2 clients 2 recovered and 0 were evicted. 00010000:00080000:2.0:1788201200.373745:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c24a80 x1875064570054016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201216 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201200.373764:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1788201200.373770:0:3281:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff962492c24a80 x1875064570054016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201216 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201200.373779:0:3281:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff962492c24a80 x1875064570054016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201216 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201200.373787:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:2.0:1788201200.373806:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:2.0:1788201200.373810:0:3281:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201200.374030:0:6846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064570054272:0@lo:7:osp-pre-0-0.0 00000100:00100000:3.0:1788201200.374076:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.374120:0:6846:0:(client.c:2702:ptlrpc_set_wait()) set ffff962493656180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201200.374136:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570054144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201200.374163:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1788201200.374331:0:12523:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000100:00100000:0.0:1788201200.374376:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570054272 00000100:00100000:0.0:1788201200.374382:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570054272 00000100:00100000:0.0:1788201200.374429:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201200.374439:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6846:x1875064570054272:12345-0@lo:7:osp-pre-0-0.0 00010000:00010000:0.0:1788201200.382124:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788201200.395107:0:12449:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788201200.395117:0:12449:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00100000:3.0:1788201200.396576:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570054144 00000100:00100000:3.0:1788201200.396596:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570054144 00000100:00100000:3.0:1788201200.396653:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788201200.396663:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e3ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570054144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201200.396690:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201200.396778:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e3ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570054144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (22613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201200.396785:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1788201200.397450:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba43df80 x1875064570054144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201200.397473:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570054144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201200.400194:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570054016:0@lo:400:ldlm_lock_repla.0 00002000:00080000:2.0:1788201200.418896:0:6668:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788201200.418909:0:6668:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x240000400:0x21:0x0] 00000100:00100000:2.0:1788201200.419021:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6846:x1875064570054272:12345-0@lo:7:osp-pre-0-0.0 Request processed in 44578us (44939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.419034:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788201200.420183:0:6846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba43f480 x1875064570054272/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201216 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201200.420201:0:6846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064570054272:0@lo:7:osp-pre-0-0.0 00000004:00080000:3.0:1788201200.420226:0:6846:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x240000400:0x21:0x0] 00000100:00100000:0.0:1788201201.206598:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570054400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201201.206692:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201201.215365:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570054400 00000100:00100000:3.0:1788201201.215381:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570054400 00000100:00100000:3.0:1788201201.215445:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201201.215456:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570054400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201201.215494:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201201.215585:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570054400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (8892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201201.215591:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788201201.215682:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201201.215722:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962485739500 x1875064570054400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201201.215748:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570054400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201201.399067:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201201.462701:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201201.462747:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201201.462799:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559524736 00000100:00100000:2.0:1788201201.462809:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559524736 00000100:00100000:2.0:1788201201.462880:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 133 00000100:00100000:2.0:1788201201.462892:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559524736:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201201.462963:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559524736:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 75us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201201.462988:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 133 00000100:00080000:2.0:1788201201.463007:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201201.467217:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559524608 00000100:00100000:1.0:1788201201.467231:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559524608 00000100:00100000:1.0:1788201201.467280:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 293 00000100:00100000:1.0:1788201201.467288:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559524608:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201201.467395:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559524608:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 106us (4645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201201.467403:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 293 00000100:00100000:2.0:1788201201.472725:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201201.472795:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559524864 00000100:00100000:0.0:1788201201.472805:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559524864 00000100:00100000:0.0:1788201201.472867:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:0.0:1788201201.472877:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559524864:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201201.472956:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559524864:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201201.472963:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 60 00010000:00010000:2.0:1788201202.429993:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201203.455405:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201203.775970:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570054528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201203.776082:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201203.776179:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570054912:0@lo:400:kworker.0 00000100:00100000:0.0:1788201203.776217:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201203.776263:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570054912 00000100:00100000:0.0:1788201203.776280:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201203.776282:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570054912 00000100:00100000:3.0:1788201203.776373:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201203.776385:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570054912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201203.776441:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570054912:12345-0@lo:400:kworker.0 Request processed in 60us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201203.776449:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788201203.776542:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570055040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201203.776574:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201203.776622:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201203.776628:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570054656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201203.776662:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201203.776682:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570055168:0@lo:400:kworker.0 00000100:00100000:1.0:1788201203.776706:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201203.776737:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570054656 00000100:00100000:1.0:1788201203.776741:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570054656 00000100:00100000:1.0:1788201203.776764:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570055168 00000100:00100000:1.0:1788201203.776767:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570055168 00000100:00100000:1.0:1788201203.776794:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788201203.776801:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570054656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201203.776846:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570054656:12345-0@lo:400:kworker.0 Request processed in 46us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201203.776853:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788201203.776866:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788201203.776873:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570055168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201203.776904:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570055168:12345-0@lo:400:kworker.0 Request processed in 33us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201203.776910:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788201203.776949:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570054656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201203.776960:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570055168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201203.777705:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570055040 00000100:00100000:3.0:1788201203.777713:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570055040 00000100:00100000:3.0:1788201203.777755:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201203.777761:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570054784:0@lo:400:kworker.0 00000100:00100000:3.0:1788201203.777763:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570055040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201203.777812:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201203.777823:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570055040:12345-0@lo:400:kworker.0 Request processed in 62us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201203.777829:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788201203.777842:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570054784 00000100:00100000:0.0:1788201203.777845:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570054912:0@lo:400:kworker.0 00000100:00100000:3.0:1788201203.777845:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570054784 00000100:00100000:3.0:1788201203.777866:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788201203.777872:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570054784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201203.777920:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570054784:12345-0@lo:400:kworker.0 Request processed in 48us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201203.777927:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1788201203.778066:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248573bb80 x1875064570054784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201203.778084:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570054784:0@lo:400:kworker.0 00010000:00080000:1.0:1788201203.778772:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c843480 x1875064570055040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201203.778793:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570055040:0@lo:400:kworker.0 00000100:00080000:1.0:1788201203.779771:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201203.779805:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201203.779809:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201203.779929:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570054528 00000100:00100000:2.0:1788201203.779938:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570054528 00000100:00100000:2.0:1788201203.780131:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788201203.780142:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570054528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201203.780246:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570054528:12345-0@lo:400:kworker.0 Request processed in 106us (4165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201203.780253:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788201203.780456:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570054528:0@lo:400:kworker.0 00010000:00010000:0.0:1788201204.479815:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.494779:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201205.820117:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570055296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201205.820583:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201205.821076:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570055296 00000100:00100000:3.0:1788201205.821087:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570055296 00000100:00100000:3.0:1788201205.821275:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788201205.821289:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570055296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201205.821333:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201205.821416:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570055296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (833us total) trans 0 rc 0/0 00000100:00080000:1.0:1788201205.821847:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201205.822232:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788201205.822835:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c26d80 x1875064570055296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201205.822863:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570055296:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788201205.946912:0:12793:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788201206.337921:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570055424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201206.338019:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201206.345199:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570055424 00000100:00100000:0.0:1788201206.345214:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570055424 00000100:00100000:0.0:1788201206.345294:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201206.345305:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570055424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201206.345358:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788201206.347906:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201206.350398:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570055424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5085us (12369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201206.350412:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788201206.352370:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c840000 x1875064570055424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201206.352399:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570055424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201206.524327:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201206.579547:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201206.579601:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201206.579685:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201206.579720:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559525248 00000100:00100000:3.0:1788201206.579731:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559525248 00000100:00100000:3.0:1788201206.579807:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:3.0:1788201206.579819:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559525248:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201206.579913:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559525248:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.579921:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:3.0:1788201206.579951:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559525120 00000100:00100000:3.0:1788201206.579955:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559525120 00000100:00100000:3.0:1788201206.579989:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 137 00000100:00100000:3.0:1788201206.579996:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559525120:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201206.580091:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559525120:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 93us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.580102:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 137 00000100:00080000:3.0:1788201206.580132:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201206.580138:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201206.580384:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559524992 00000100:00100000:0.0:1788201206.580390:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559524992 00000100:00100000:0.0:1788201206.580421:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 295 00000100:00100000:0.0:1788201206.580428:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559524992:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201206.580473:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559524992:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 46us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201206.580480:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 295 00010000:00010000:1.0:1788201207.543641:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.567100:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201208.887667:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570055680:0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.887785:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.887850:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570056192:0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.887874:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.887902:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201208.887907:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570055552:0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.887939:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.887960:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570056064:0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.887986:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.888014:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570055936:0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.888039:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.888082:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201208.888088:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570055808:0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.888112:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.888148:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570055680 00000100:00100000:1.0:1788201208.888157:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570055680 00000100:00100000:1.0:1788201208.888206:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570056192 00000100:00100000:1.0:1788201208.888210:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570056192 00000100:00100000:1.0:1788201208.888232:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570055936 00000100:00100000:1.0:1788201208.888235:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570055936 00000100:00100000:1.0:1788201208.888251:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788201208.888261:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570055680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.888319:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570055680:12345-0@lo:400:kworker.0 Request processed in 59us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.888326:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788201208.888366:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788201208.888373:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570056192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.888605:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570056192:12345-0@lo:400:kworker.0 Request processed in 232us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.888612:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788201208.888624:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788201208.888631:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570055936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.888663:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570055936:12345-0@lo:400:kworker.0 Request processed in 33us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.888669:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788201208.888690:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570055552 00000100:00100000:1.0:1788201208.888693:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570055552 00000100:00100000:1.0:1788201208.888719:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788201208.888725:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570055552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.888763:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570055552:12345-0@lo:400:kworker.0 Request processed in 39us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.888769:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788201208.888794:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570056064 00000100:00100000:1.0:1788201208.888797:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570056064 00000100:00100000:1.0:1788201208.888822:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570055808 00000100:00100000:1.0:1788201208.888824:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570055808 00000100:00100000:1.0:1788201208.888842:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201208.888847:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570056064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.888875:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570056064:12345-0@lo:400:kworker.0 Request processed in 28us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.888881:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201208.888891:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201208.888896:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570055808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.888922:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570055808:12345-0@lo:400:kworker.0 Request processed in 26us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.888928:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788201208.888950:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201208.888955:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201208.888957:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788201208.889014:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd2ca80 x1875064570055808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201208.889028:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570055808:0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.889040:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570055936:0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.889070:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570055552:0@lo:400:kworker.0 00010000:00080000:1.0:1788201208.889093:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd2ed80 x1875064570056064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201208.889102:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570056064:0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.889113:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570055680:0@lo:400:kworker.0 00000100:00100000:1.0:1788201208.889122:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570056192:0@lo:400:kworker.0 00010000:00010000:1.0:1788201209.591060:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201210.132391:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201210.132490:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559525376 00000100:00100000:1.0:1788201210.132499:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559525376 00000100:00100000:1.0:1788201210.132577:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:1.0:1788201210.132588:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:10946:x1875064559525376:12345-192.168.201.56@tcp:41:lfs.0 00000004:00000024:1.0:1788201210.132702:0:5827:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201210.132784:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:10946:x1875064559525376:12345-192.168.201.56@tcp:41:lfs.0 Request processed in 198us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201210.132790:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00080000:3.0:1788201210.132866:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201210.141705:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201210.141821:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559525504 00000100:00100000:2.0:1788201210.141831:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559525504 00000100:00100000:2.0:1788201210.141894:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 72 00000100:00100000:2.0:1788201210.141902:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:10946:x1875064559525504:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:2.0:1788201210.141935:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201210.142022:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:10946:x1875064559525504:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 120us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.142030:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 72 00000100:00080000:3.0:1788201210.147674:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201210.147884:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201210.147979:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559525632 00000100:00100000:1.0:1788201210.147992:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559525632 00000100:00100000:1.0:1788201210.148087:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:1.0:1788201210.148096:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559525632:12345-192.168.201.56@tcp:8:lfs.0 00010000:00080000:1.0:1788201210.148132:0:6668:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:1.0:1788201210.148173:0:6668:0:(genops.c:1406:class_connect()) connect: client 986744c8-ee81-4a47-8d91-97f81ede1f3e, cookie 0xa81c4c9a2f3cad2e 00002000:00100000:1.0:1788201210.148186:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff96248591d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201210.148222:0:6668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:1.0:1788201210.148490:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788201210.148535:0:6668:0:(import.c:65:import_set_state_nolock()) ffff96248591f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201210.148712:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559525632:12345-192.168.201.56@tcp:8:lfs.0 Request processed in 615us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201210.148720:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:1.0:1788201210.158579:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201210.158697:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559525760 00000100:00100000:2.0:1788201210.158707:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559525760 00000100:00100000:2.0:1788201210.158778:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 73 00000100:00100000:2.0:1788201210.158789:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:10946:x1875064559525760:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:2.0:1788201210.158817:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201210.158897:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:10946:x1875064559525760:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 110us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201210.158919:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 73 00000100:00080000:3.0:1788201210.159625:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201210.614823:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201210.934747:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201210.934770:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570056320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201210.934838:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201210.934966:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570056320 00000100:00100000:0.0:1788201210.934974:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570056320 00000100:00100000:0.0:1788201210.935044:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788201210.935053:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570056320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201210.935077:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201210.935147:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570056320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201210.935154:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1788201210.935194:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c24a80 x1875064570056320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201210.935215:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570056320:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788201210.935373:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201211.446800:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570056448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201211.446908:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201211.447643:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570056448 00000100:00100000:2.0:1788201211.447655:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570056448 00000100:00100000:2.0:1788201211.447761:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201211.447771:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570056448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201211.447795:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201211.447866:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570056448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201211.447872:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1788201211.447954:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c843b80 x1875064570056448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201211.447973:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570056448:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201211.448111:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201211.642118:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201211.709079:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201211.709126:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201211.709134:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559525888 00000100:00100000:0.0:1788201211.709146:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559525888 00000100:00100000:0.0:1788201211.709206:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 297 00000100:00100000:0.0:1788201211.709217:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559525888:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201211.709316:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559525888:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 102us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.709323:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 297 00000100:00100000:3.0:1788201211.713017:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201211.713063:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201211.714255:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559526144 00000100:00100000:1.0:1788201211.714269:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559526144 00000100:00100000:1.0:1788201211.714366:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 66 00000100:00100000:1.0:1788201211.714378:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559526144:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201211.714464:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559526144:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 87us (5337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201211.714473:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 66 00000100:00100000:1.0:1788201211.714491:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559526272 00000100:00100000:1.0:1788201211.714495:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559526272 00000100:00100000:1.0:1788201211.714520:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 67 00000100:00100000:1.0:1788201211.714528:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559526272:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201211.714554:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559526272:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 28us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201211.714574:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 67 00000100:00100000:3.0:1788201211.714622:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559526016 00000100:00100000:3.0:1788201211.714628:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559526016 00000100:00100000:3.0:1788201211.714665:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 141 00000100:00100000:3.0:1788201211.714673:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559526016:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201211.714809:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559526016:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 50us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201211.714816:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 141 00010000:00010000:0.0:1788201212.662504:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201213.686588:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201214.007895:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570056960:0@lo:400:kworker.0 00000100:00100000:2.0:1788201214.007961:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201214.008021:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201214.008026:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570056832:0@lo:400:kworker.0 00000100:00100000:2.0:1788201214.008048:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201214.008079:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570056960 00000100:00100000:2.0:1788201214.008085:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570056960 00000100:00100000:2.0:1788201214.008145:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788201214.008153:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570056960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201214.008202:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570056960:12345-0@lo:400:kworker.0 Request processed in 50us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201214.008209:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788201214.008232:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570056832 00000100:00100000:2.0:1788201214.008235:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570056832 00000100:00100000:2.0:1788201214.008255:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788201214.008261:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570056832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201214.008286:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570056832:12345-0@lo:400:kworker.0 Request processed in 26us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201214.008304:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788201214.008331:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201214.008335:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788201214.008380:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c841c00 x1875064570056832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201214.008393:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570056832:0@lo:400:kworker.0 00000100:00100000:2.0:1788201214.008404:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570056960:0@lo:400:kworker.0 00000100:00100000:1.0:1788201214.008474:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570056704:0@lo:400:kworker.0 00000100:00100000:1.0:1788201214.008512:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201214.008536:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570057216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201214.008567:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201214.008584:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201214.008590:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570056576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201214.008619:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201214.008639:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570057088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201214.008657:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201214.008679:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570057088 00000100:00100000:1.0:1788201214.008683:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570057088 00000100:00100000:1.0:1788201214.008714:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788201214.008721:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570057088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201214.008757:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570057088:12345-0@lo:400:kworker.0 Request processed in 37us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201214.008762:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788201214.008777:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570056704 00000100:00100000:1.0:1788201214.008780:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570056704 00000100:00100000:1.0:1788201214.008799:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570057216 00000100:00100000:1.0:1788201214.008802:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570057216 00000100:00100000:1.0:1788201214.008816:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788201214.008822:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570056704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201214.008849:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570056704:12345-0@lo:400:kworker.0 Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201214.008854:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788201214.008863:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788201214.008869:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570057216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201214.008899:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570057216:12345-0@lo:400:kworker.0 Request processed in 31us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201214.008905:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788201214.008921:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570056576 00000100:00100000:1.0:1788201214.008924:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570056576 00000100:00100000:1.0:1788201214.008943:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788201214.008949:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570056576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201214.008972:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570056576:12345-0@lo:400:kworker.0 Request processed in 24us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201214.008978:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:1.0:1788201214.009001:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201214.009004:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201214.009018:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570056576:0@lo:400:kworker.0 00010000:00080000:1.0:1788201214.009029:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c843b80 x1875064570057088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201214.009038:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570057088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201214.009047:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570056704:0@lo:400:kworker.0 00000100:00100000:1.0:1788201214.009054:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570057216:0@lo:400:kworker.0 00000001:00100000:2.0:1788201214.581690:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00010000:00010000:0.0:1788201214.711687:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201215.430951:0:13093:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00010000:00010000:1.0:1788201215.734717:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201216.056237:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201216.056990:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570057344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201216.058152:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201216.058640:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570057344 00000100:00100000:2.0:1788201216.058652:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570057344 00000100:00100000:2.0:1788201216.058736:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788201216.058750:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570057344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201216.058799:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201216.058863:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570057344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201216.058871:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1788201216.058931:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba43f100 x1875064570057344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201216.058957:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570057344:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201216.060375:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201216.566592:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570057472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201216.566702:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201216.569431:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570057472 00000100:00100000:1.0:1788201216.569461:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570057472 00000100:00100000:1.0:1788201216.569548:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788201216.569561:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570057472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201216.569617:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201216.570192:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570057472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 631us (3487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.570202:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788201216.570229:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788201216.571057:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd2f100 x1875064570057472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201216.571087:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570057472:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201216.758592:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201216.818111:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201216.818174:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201216.818217:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201216.818251:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201216.818307:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559526400 00000100:00100000:3.0:1788201216.818321:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559526400 00000100:00100000:3.0:1788201216.818411:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 299 00000100:00100000:3.0:1788201216.818422:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559526400:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201216.818517:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559526400:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 96us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201216.818525:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 299 00000100:00100000:3.0:1788201216.818570:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559526784 00000100:00100000:3.0:1788201216.818574:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559526784 00000100:00100000:3.0:1788201216.818612:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559526656 00000100:00100000:3.0:1788201216.818615:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559526656 00000100:00100000:3.0:1788201216.818635:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00100000:3.0:1788201216.818643:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559526784:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201216.818675:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559526784:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 33us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201216.818694:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00100000:3.0:1788201216.818710:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 71 00000100:00100000:3.0:1788201216.818717:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559526656:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201216.818748:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559526656:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 32us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201216.818755:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 71 00000100:00080000:3.0:1788201216.818909:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201216.818915:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201216.818997:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559526528 00000100:00100000:1.0:1788201216.819002:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559526528 00000100:00100000:1.0:1788201216.819053:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 145 00000100:00100000:1.0:1788201216.819062:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559526528:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201216.819105:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559526528:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 44us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.819111:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 145 00000100:00080000:3.0:1788201216.822244:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788201216.861869:0:13142:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1788201217.789295:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201218.601488:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201218.603981:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559526912 00000100:00100000:0.0:1788201218.604004:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559526912 00000100:00100000:0.0:1788201218.604142:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:0.0:1788201218.604157:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:11412:x1875064559526912:12345-192.168.201.56@tcp:41:lfs.0 00000004:00000024:0.0:1788201218.604249:0:6693:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788201218.604395:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:11412:x1875064559526912:12345-192.168.201.56@tcp:41:lfs.0 Request processed in 241us (2923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201218.604403:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00080000:3.0:1788201218.604558:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201218.608076:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201218.609141:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559527040 00000100:00100000:0.0:1788201218.609155:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559527040 00000100:00100000:0.0:1788201218.609311:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00100000:0.0:1788201218.609326:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:11412:x1875064559527040:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:0.0:1788201218.609417:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201218.609873:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:11412:x1875064559527040:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 549us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201218.609883:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00080000:3.0:1788201218.616401:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201218.616620:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201218.617870:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559527168 00000100:00100000:0.0:1788201218.617888:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559527168 00000100:00100000:0.0:1788201218.617995:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 79 00000100:00100000:0.0:1788201218.618257:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:11412:x1875064559527168:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:0.0:1788201218.618317:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201218.618460:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:11412:x1875064559527168:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 454us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201218.618468:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 79 00000100:00080000:3.0:1788201218.619374:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201218.650943:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201218.651128:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559527296 00000100:00100000:1.0:1788201218.651143:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559527296 00000100:00100000:1.0:1788201218.651236:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:1.0:1788201218.651249:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:11428:x1875064559527296:12345-192.168.201.56@tcp:101:cp.0 00010000:00010000:1.0:1788201218.651280:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201218.655815:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962480030000/0xa81c4c9a2f3cad35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99921 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.655906:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cad3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.655938:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cad3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.655952:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cad3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.655989:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cad43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.655997:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cad43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.656005:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cad43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.656878:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cad4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.656892:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cad4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.656902:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cad4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201218.657001:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788201218.657006:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201218.657109:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cad4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657124:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cad3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657139:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cad3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657146:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cad3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657153:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962480030800 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201218.657157:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cad3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657164:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cad3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657177:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6000) 00010000:00010000:0.0:1788201218.657180:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201218.657184:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cad3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657191:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962480030800/0xa81c4c9a2f3cad3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657203:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cad43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657209:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cad43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657214:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cad43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657219:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962480030a00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201218.657239:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cad43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657247:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cad43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657256:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff9624a8e9f300) 00010000:00010000:0.0:1788201218.657258:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201218.657262:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cad43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657267:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962480030a00/0xa81c4c9a2f3cad43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657308:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962480030000/0xa81c4c9a2f3cad35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99921 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657321:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cad4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99921 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.657328:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff962487f56f00) 00010000:00010000:0.0:1788201218.657331:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201218.657333:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dec00, rc 0) 00000100:00100000:0.0:1788201218.658155:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:11428:x1875064559527296:12345-192.168.201.56@tcp:101:cp.0 Request processed in 6903us (7222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201218.658166:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:1.0:1788201218.661291:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201218.661803:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559527424 00000100:00100000:2.0:1788201218.661815:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559527424 00000100:00100000:2.0:1788201218.661876:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:2.0:1788201218.661886:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:11428:x1875064559527424:12345-192.168.201.56@tcp:101:cp.0 00010000:00010000:2.0:1788201218.661910:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201218.661935:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cad51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99928 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662012:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662027:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662038:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662052:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cad5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662058:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cad5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662064:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cad5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662780:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662792:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662799:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662806:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201218.662810:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662830:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662843:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff962487f56f00) 00010000:00010000:2.0:1788201218.662847:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201218.662851:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662857:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662870:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cad5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662875:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cad5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662880:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cad5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662886:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5200 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201218.662889:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cad5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662895:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cad5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662902:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbc2861ed (ffff9624a84c1c00) 00010000:00010000:2.0:1788201218.662904:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201218.662907:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cad5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662923:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cad5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662964:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cad51 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99928 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662975:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff962487f56f00) 00010000:00010000:2.0:1788201218.662977:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201218.662981:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cad51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99928 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.662990:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5e00, rc 0) 00000100:00100000:2.0:1788201218.663071:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:11428:x1875064559527424:12345-192.168.201.56@tcp:101:cp.0 Request processed in 1185us (1790us total) trans 0 rc 301/301 00000100:00100000:2.0:1788201218.663078:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:1.0:1788201218.668743:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201218.669064:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559527552 00000100:00100000:3.0:1788201218.669074:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559527552 00000100:00100000:3.0:1788201218.669127:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:3.0:1788201218.669137:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:11428:x1875064559527552:12345-192.168.201.56@tcp:700:cp.0 00000100:00100000:3.0:1788201218.670510:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:11428:x1875064559527552:12345-192.168.201.56@tcp:700:cp.0 Request processed in 1364us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201218.670523:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:3.0:1788201218.683257:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201218.683801:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559527808 00000100:00100000:2.0:1788201218.683814:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559527808 00000100:00100000:2.0:1788201218.683922:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 32 00000100:00100000:2.0:1788201218.683934:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:11428:x1875064559527808:12345-192.168.201.56@tcp:101:cp.0 00010000:00010000:2.0:1788201218.683959:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201218.683962:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788201218.683989:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cad4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99921 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.684009:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff962487f56f00) 00010000:00010000:2.0:1788201218.684013:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201218.684052:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cad66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd9992f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.684422:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.684438:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1000/0xa81c4c9a2f3cac39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99895 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.684446:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cac5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9989c expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.684455:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 5/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.684508:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cac5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd9989c expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.684520:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cac5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd9989c expref: 7 pid: 5825 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201218.684534:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5827:1875064570057600:192.168.201.56@tcp:104: 00010000:00010000:2.0:1788201218.684662:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1000/0xa81c4c9a2f3cac39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99895 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201218.684672:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1000/0xa81c4c9a2f3cac39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99895 expref: 7 pid: 5826 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201218.684682:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5827:1875064570057728:192.168.201.56@tcp:104: 00000100:00100000:2.0:1788201218.684725:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9e72f00 going to sleep for 11 seconds 00010000:00020000:1.0:1788201218.691160:0:5827:0:(ldlm_lockd.c:727:ldlm_handle_ast_error()) ### client (nid 192.168.201.56@tcp) returned error from blocking AST (req@00000000c80a76e2 x1875064570057600 status -107 rc -107), evict it ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cac5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd9989c expref: 7 pid: 5825 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02020000:1.0:1788201218.734285:0:5827:0:(ldlm_lockd.c:665:ldlm_failed_ast()) lustre-MDT0000: A client on nid 192.168.201.56@tcp was evicted due to a lock blocking callback time out: rc -107 00000100:00100000:1.0:1788201218.741493:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5827:1875064570057600:192.168.201.56@tcp:104: 00010000:00020000:1.0:1788201218.741597:0:5827:0:(ldlm_lockd.c:727:ldlm_handle_ast_error()) ### client (nid 192.168.201.56@tcp) returned error from blocking AST (req@00000000fa67b2fd x1875064570057728 status -107 rc -107), evict it ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1000/0xa81c4c9a2f3cac39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99895 expref: 7 pid: 5826 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:2.0:1788201218.741718:0:5815:0:(ldlm_lockd.c:255:expired_lock_main()) ### lock callback timer expired after 0s: evicting client at 192.168.201.56@tcp ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cac5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd9989c expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02020000:1.0:1788201218.742165:0:5827:0:(ldlm_lockd.c:665:ldlm_failed_ast()) lustre-MDT0000: A client on nid 192.168.201.56@tcp was evicted due to a lock blocking callback time out: rc -107 00000100:00100000:1.0:1788201218.742174:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5827:1875064570057728:192.168.201.56@tcp:104: 00010000:00010000:1.0:1788201218.742214:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788201218.779841:0:5815:0:(genops.c:1655:class_fail_export()) disconnecting export ffff962381a3a000/01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 00000020:00000080:2.0:1788201218.779856:0:5815:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3caa6b 00000020:00010000:2.0:1788201218.779873:0:5815:0:(genops.c:1942:obd_stale_export_put()) Put export ffff962381a3a000: total 0 00000100:00080000:2.0:1788201218.779878:0:5815:0:(import.c:65:import_set_state_nolock()) ffff96248cec6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201218.779909:0:5815:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967304 00000020:00010000:0.0:1788201218.780440:0:5813:0:(genops.c:1928:obd_stale_export_get()) Get export ffff962381a3a000: total 0 00010000:00010000:0.0:1788201218.780446:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201218.780492:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1000/0xa81c4c9a2f3cac39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99895 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.780541:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff962487f56f00) 00010000:00010000:0.0:1788201218.780544:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201218.780548:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.780560:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624c21f1000/0xa81c4c9a2f3cac39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99895 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.780592:0:5813:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff962381a3a000, canceled 1 locks, left on hash table 2. 00000020:00010000:0.0:1788201218.780596:0:5813:0:(genops.c:1942:obd_stale_export_put()) Put export ffff962381a3a000: total 0 00000020:00010000:0.0:1788201218.780599:0:5813:0:(genops.c:1928:obd_stale_export_get()) Get export ffff962381a3a000: total 0 00010000:00010000:0.0:1788201218.780622:0:5813:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff962381a3a000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788201218.780641:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6000) 00010000:00010000:0.0:1788201218.780644:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201218.780649:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cabde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99880 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.780663:0:5813:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cac5c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd9989c expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.780671:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff962487f56f00) 00010000:00010000:0.0:1788201218.780673:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201218.780676:0:5813:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.780683:0:5813:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.780690:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.780749:0:5813:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff962381a3a000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788201218.780761:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201218.780763:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201218.780765:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201218.780964:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.780973:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.780998:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cad74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.781018:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cad74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.781026:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cad74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788201218.782466:0:5815:0:(genops.c:1672:class_fail_export()) disconnected export ffff962381a3a000/01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 00010000:00010000:2.0:1788201218.782485:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cac5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd9989c expref: 2 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201218.783807:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788201218.784245:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d200/0xa81c4c9a2f3cad7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.784263:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d200/0xa81c4c9a2f3cad7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.784285:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d200/0xa81c4c9a2f3cad7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.784332:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.784373:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.784382:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.784388:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201218.784393:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.784401:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.784416:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff962487f56f00) 00010000:00010000:3.0:1788201218.784419:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201218.784424:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.784430:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3cad6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201218.784446:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000652a45a1 reply state 0000000020f87587 transno 4294967305 ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cad74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201218.784455:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201218.784507:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cad66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9992f expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.784525:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d200/0xa81c4c9a2f3cad7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9992f expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.784532:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9624942a6c00) 00010000:00010000:3.0:1788201218.784535:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201218.784537:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7d200, rc 0) 00000100:00100000:3.0:1788201218.784630:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:11428:x1875064559527808:12345-192.168.201.56@tcp:101:cp.0 Request processed in 100698us (101382us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788201218.784639:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 32 00010000:00010000:3.0:1788201218.799390:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cad74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.799420:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cad74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.799430:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cad74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.799438:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3c00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201218.799445:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cad74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.799456:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cad74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.799485:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbc2861ed (ffff962487f56000) 00010000:00010000:3.0:1788201218.799490:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201218.799520:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cad74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.799529:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cad74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201218.804641:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201218.805624:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559527936 00000100:00100000:3.0:1788201218.805643:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559527936 00000100:00100000:3.0:1788201218.807581:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:3.0:1788201218.807611:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559527936:12345-192.168.201.56@tcp:101:cp.0 00010000:00010000:3.0:1788201218.807646:0:8088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201218.807700:0:8088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c1b46d8/0xa81c4c9a2f3cad89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99936 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.808285:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201218.826157:0:8088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201218.826195:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1788201218.826200:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201218.826217:0:8088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c1b46d8/0xa81c4c9a2f3cad89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99936 expref: 6 pid: 8088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.828696:0:8088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c1b46d8/0xa81c4c9a2f3cad89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99936 expref: 6 pid: 8088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.828716:0:8088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7c400, rc 0) 00000100:00100000:1.0:1788201218.828808:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559527936:12345-192.168.201.56@tcp:101:cp.0 Request processed in 21211us (24194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201218.828818:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:1.0:1788201218.853632:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201218.853841:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559528064 00000100:00100000:3.0:1788201218.853854:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559528064 00000100:00100000:3.0:1788201218.853918:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:3.0:1788201218.853929:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:11428:x1875064559528064:12345-192.168.201.56@tcp:101:cp.0 00010000:00010000:3.0:1788201218.853951:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201218.853973:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cad90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd9993d expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.854019:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c1b46d8/0xa81c4c9a2f3cad89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99936 expref: 7 pid: 8088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.854029:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201218.854034:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201218.854040:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cad90 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9993d expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.854089:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c1b46d8/0xa81c4c9a2f3cad89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99936 expref: 7 pid: 8088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201218.854102:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c1b46d8/0xa81c4c9a2f3cad89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99936 expref: 7 pid: 8088 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201218.854117:0:6671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570057856:192.168.201.56@tcp:104: 00000100:00100000:3.0:1788201218.854220:0:6671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624812e3600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201218.857258:0:6671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570057856:192.168.201.56@tcp:104: 00010000:00010000:0.0:1788201218.857305:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cad90 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0x390884812bd9993d expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.857331:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7cc00, rc 0) 00000100:00100000:0.0:1788201218.857448:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:11428:x1875064559528064:12345-192.168.201.56@tcp:101:cp.0 Request processed in 3520us (3841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201218.857456:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:2.0:1788201218.858213:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201218.859402:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559528192 00000100:00100000:0.0:1788201218.859414:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559528192 00010000:00010000:0.0:1788201218.859456:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c1b46d8/0xa81c4c9a2f3cad89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99936 expref: 7 pid: 8088 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201218.859502:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:0.0:1788201218.859512:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2341:x1875064559528192:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201218.859529:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201218.859551:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c1b46d8/0xa81c4c9a2f3cad89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99936 expref: 7 pid: 8088 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.859566:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c1b46d8/0xa81c4c9a2f3cad89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99936 expref: 7 pid: 8088 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.860463:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c1b46d8/0xa81c4c9a2f3cad89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99936 expref: 7 pid: 8088 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.860489:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201218.860494:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201218.860504:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cad90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0x390884812bd9993d expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.860515:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cad90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0x390884812bd9993d expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.860556:0:5812:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cad90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0x390884812bd9993d expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201218.860573:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5812:1875064570057984:192.168.201.56@tcp:105: 00000100:00100000:0.0:1788201218.860934:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba0dec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201218.868681:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5812:1875064570057984:192.168.201.56@tcp:105: 00010000:00010000:0.0:1788201218.868713:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201218.868787:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559528192:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 9275us (10576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201218.868799:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:3.0:1788201218.873092:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201218.873215:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559528448 00000100:00100000:0.0:1788201218.873247:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559528448 00000100:00100000:3.0:1788201218.873845:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:3.0:1788201218.873868:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:11428:x1875064559528448:12345-192.168.201.56@tcp:35:cp.0 00000100:00100000:3.0:1788201218.875156:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:11428:x1875064559528448:12345-192.168.201.56@tcp:35:cp.0 Request processed in 1284us (2069us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788201218.875295:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:1.0:1788201218.919212:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201218.921300:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559528576 00000100:00100000:0.0:1788201218.921388:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559528576 00002000:00100000:0.0:1788201218.921476:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->2122) req@ffff96248573a680 x1875064559528576/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:339/0 lens 2616/0 e 0 to 0 dl 1788201229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201218.921489:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248573a680 with x1875064559528576 ext(0->2122) 00002000:00010000:0.0:1788201218.921497:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248573a680 00000100:00100000:0.0:1788201218.921541:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:0.0:1788201218.921553:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559528576:12345-192.168.201.56@tcp:4:cp.0 00000100:00100000:0.0:1788201218.925529:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559528576:12345-192.168.201.56@tcp:4:cp.0 Request processed in 3964us (6314us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788201218.925547:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 0 00002000:00100000:0.0:1788201218.925564:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->2122) req@ffff96248573a680 x1875064559528576/t8589934593(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:339/0 lens 2616/448 e 0 to 0 dl 1788201229 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201218.925577:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248573a680 with x1875064559528576 ext(0->2122) 00002000:00010000:0.0:1788201218.925585:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248573a680 00000100:00100000:2.0:1788201218.970144:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201218.970495:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559528704 00000100:00100000:0.0:1788201218.970509:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559528704 00000100:00100000:0.0:1788201218.970586:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:0.0:1788201218.970596:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:11440:x1875064559528704:12345-192.168.201.56@tcp:101:diff.0 00010000:00010000:0.0:1788201218.970626:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201218.970650:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cad97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99944 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.970729:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cad9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.970742:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cad9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.970773:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cad9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.970787:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cada5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.970792:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cada5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.970796:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cada5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.971268:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfe00/0xa81c4c9a2f3cadac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.971278:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfe00/0xa81c4c9a2f3cadac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.971286:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfe00/0xa81c4c9a2f3cadac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201218.971329:0:6693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788201218.971334:0:6693:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201218.974408:0:6693:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfe00/0xa81c4c9a2f3cadac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974444:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cad9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974453:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cad9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974463:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cad9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974471:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201218.974478:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cad9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974488:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cad9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974539:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6000) 00010000:00010000:1.0:1788201218.974542:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201218.974548:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cad9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974554:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cad9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974575:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cada5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974582:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cada5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974588:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cada5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974594:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201218.974597:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cada5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974603:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cada5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974613:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x37933f71 (ffff9624a8e9f300) 00010000:00010000:1.0:1788201218.974615:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201218.974618:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cada5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974623:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cada5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x37933f71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974702:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cad97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99944 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974720:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfe00/0xa81c4c9a2f3cadac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99944 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201218.974727:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201218.974729:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788201218.974732:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dfe00, rc 0) 00000100:00100000:1.0:1788201218.974916:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:11440:x1875064559528704:12345-192.168.201.56@tcp:101:diff.0 Request processed in 4318us (4785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201218.974927:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:3.0:1788201218.981115:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201218.982201:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559528960 00000100:00100000:0.0:1788201218.982230:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559528960 00000100:00100000:0.0:1788201218.982328:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:0.0:1788201218.982392:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:11440:x1875064559528960:12345-192.168.201.56@tcp:101:diff.0 00010000:00010000:0.0:1788201218.982428:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201218.982462:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cadb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd9994b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.982636:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cadba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.982654:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cadba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.982668:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cadba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201218.982682:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 2123 00010000:00010000:0.0:1788201218.982891:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cadb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9994b expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.982915:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cadba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9994b expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201218.982924:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9624942a6c00) 00010000:00010000:0.0:1788201218.982928:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201218.982932:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4de200, rc 0) 00000100:00100000:0.0:1788201218.983041:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:11440:x1875064559528960:12345-192.168.201.56@tcp:101:diff.0 Request processed in 703us (1940us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788201218.984898:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:3.0:1788201218.998020:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201218.998411:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559529216 00000100:00100000:0.0:1788201218.998427:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559529216 00000100:00100000:0.0:1788201218.998508:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:0.0:1788201218.998521:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:11440:x1875064559529216:12345-192.168.201.56@tcp:35:diff.0 00000100:00100000:0.0:1788201218.998917:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:11440:x1875064559529216:12345-192.168.201.56@tcp:35:diff.0 Request processed in 397us (914us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788201218.998944:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:2.0:1788201219.003546:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201219.006736:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559529344 00000100:00100000:3.0:1788201219.006765:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559529344 00000100:00100000:3.0:1788201219.007020:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:3.0:1788201219.007035:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:2344:x1875064559529344:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201219.007255:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201219.007295:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cadba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9994b expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.007376:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9624942a6c00) 00010000:00010000:3.0:1788201219.007383:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201219.007617:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559529344:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 462us (4014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201219.007627:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:2.0:1788201219.041763:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201219.041911:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559529600 00000100:00100000:3.0:1788201219.041927:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559529600 00000100:00100000:3.0:1788201219.042014:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00100000:3.0:1788201219.042027:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:11441:x1875064559529600:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:3.0:1788201219.042115:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201219.042156:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d200/0xa81c4c9a2f3cad7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9992f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.042182:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9624942a6c00) 00010000:00010000:3.0:1788201219.042196:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201219.042237:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3cadc8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.042255:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3cadc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.042267:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3cadc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.042286:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d400/0xa81c4c9a2f3cadcf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.042293:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d400/0xa81c4c9a2f3cadcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.042322:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d400/0xa81c4c9a2f3cadcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.042713:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7de00/0xa81c4c9a2f3cadd6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.042723:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7de00/0xa81c4c9a2f3cadd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.042732:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7de00/0xa81c4c9a2f3cadd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201219.044755:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788201219.044778:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351117435216ns, next at 352117429182ns, rc = 0 00010000:00010000:3.0:1788201219.044878:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3caddd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.044897:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3caddd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.044908:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3caddd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.044919:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3caddd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.044926:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3caddd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.044933:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3caddd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045015:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201219.045070:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7de00/0xa81c4c9a2f3cadd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045078:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7de00/0xa81c4c9a2f3cadd6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045085:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7de00/0xa81c4c9a2f3cadd6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045092:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7de00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201219.045096:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7de00/0xa81c4c9a2f3cadd6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045105:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7de00/0xa81c4c9a2f3cadd6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045118:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9624942a6b00) 00010000:00010000:3.0:1788201219.045127:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201219.045132:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7de00/0xa81c4c9a2f3cadd6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045139:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7de00/0xa81c4c9a2f3cadd6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045161:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3cadc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045167:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3cadc8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045173:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3cadc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045184:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7d600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201219.045187:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3cadc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045194:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3cadc8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045201:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:3.0:1788201219.045204:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201219.045207:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3cadc8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.045213:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3cadc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201219.045232:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045f1f774 reply state 000000004b0d6684 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d400/0xa81c4c9a2f3cadcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201219.045242:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201219.045385:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:11441:x1875064559529600:12345-192.168.201.56@tcp:36:rm.0 Request processed in 3354us (3634us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788201219.045395:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 35 00010000:00010000:0.0:1788201219.049197:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201219.049229:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3caddd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.049245:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7d800 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:0.0:1788201219.049250:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3caddd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.049262:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3caddd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.049291:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9624942a6b00) 00010000:00010000:0.0:1788201219.049294:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201219.049300:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3caddd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.049306:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3caddd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.049366:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201219.049369:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201219.049371:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201219.054403:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d400/0xa81c4c9a2f3cadcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.054432:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d400/0xa81c4c9a2f3cadcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.054442:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d400/0xa81c4c9a2f3cadcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.054482:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7d400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201219.054489:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d400/0xa81c4c9a2f3cadcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.054498:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d400/0xa81c4c9a2f3cadcf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.054521:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbc2861ed (ffff9624942a6300) 00010000:00010000:0.0:1788201219.054525:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201219.054529:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d400/0xa81c4c9a2f3cadcf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.054535:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d400/0xa81c4c9a2f3cadcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbc2861ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201219.131014:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570058368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201219.131078:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570058112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201219.131155:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201219.131182:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201219.131260:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201219.131271:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570058496:0@lo:400:kworker.0 00000100:00100000:0.0:1788201219.131311:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201219.131399:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570058112 00000100:00100000:0.0:1788201219.131410:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570058112 00000100:00100000:3.0:1788201219.131419:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570058624:0@lo:400:kworker.0 00000100:00100000:3.0:1788201219.131468:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201219.131487:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788201219.131513:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570058112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201219.131583:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570058112:12345-0@lo:400:kworker.0 Request processed in 72us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201219.131592:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788201219.131667:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570058112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201219.131692:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201219.131700:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570058496 00000100:00100000:0.0:1788201219.131707:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570058496 00000100:00100000:3.0:1788201219.131724:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570058240:0@lo:400:kworker.0 00000100:00080000:0.0:1788201219.131746:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201219.131776:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201219.131872:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570058368 00000100:00100000:1.0:1788201219.131878:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570058368 00000100:00100000:1.0:1788201219.131920:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570058624 00000100:00100000:1.0:1788201219.131924:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570058624 00000100:00100000:1.0:1788201219.131951:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201219.131959:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570058368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201219.132016:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570058368:12345-0@lo:400:kworker.0 Request processed in 58us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201219.132024:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201219.132038:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201219.132044:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570058624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201219.132078:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570058624:12345-0@lo:400:kworker.0 Request processed in 34us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201219.132083:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788201219.132117:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201219.132120:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201219.132154:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570058368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201219.132964:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570058752:0@lo:400:kworker.0 00000100:00100000:3.0:1788201219.133404:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201219.133459:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570058240 00000100:00100000:0.0:1788201219.133472:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570058240 00000100:00100000:0.0:1788201219.133538:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788201219.133548:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570058496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201219.133629:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570058496:12345-0@lo:400:kworker.0 Request processed in 82us (2316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201219.133635:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788201219.133652:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788201219.133658:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570058240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201219.133691:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570058240:12345-0@lo:400:kworker.0 Request processed in 33us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201219.133698:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788201219.133796:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570058496:0@lo:400:kworker.0 00010000:00080000:3.0:1788201219.134132:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c27b80 x1875064570058624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201219.134151:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570058624:0@lo:400:kworker.0 00000100:00100000:3.0:1788201219.134187:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570058240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201219.134266:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570058752 00000100:00100000:0.0:1788201219.134273:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570058752 00000100:00100000:0.0:1788201219.134329:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788201219.134337:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570058752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201219.134426:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570058752:12345-0@lo:400:kworker.0 Request processed in 90us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201219.134433:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788201219.134471:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570058752:0@lo:400:kworker.0 00000100:00080000:0.0:1788201219.134905:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788201219.213529:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000001:00100000:3.0:1788201219.213639:0:5847:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 00000020:00000080:3.0:1788201219.213646:0:5847:0:(genops.c:906:class_export_put()) final put ffff962381a3a000/01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 00000020:00000080:0.0:1788201219.213737:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff962381a3a000/01132c3b-be7f-4b1d-8dc1-ddb57dc2e2b0 for lustre-MDT0000 00000020:00000080:0.0:1788201219.213829:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96248cec6800 for lustre-MDT0000 00000001:00080000:3.0:1788201219.213999:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000004:00080000:3.0:1788201219.214133:0:5847:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788201219.214754:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570058880:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201219.214861:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201219.215033:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570058880 00000100:00100000:2.0:1788201219.215052:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570058880 00000100:00100000:2.0:1788201219.215126:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201219.215139:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570058880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201219.215177:0:6668:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00010000:00010000:2.0:1788201219.215231:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.215262:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cad90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0x390884812bd9993d expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.215289:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788201219.215294:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201219.215299:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.215369:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cad90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.201.56@tcp remote: 0x390884812bd9993d expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.215390:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cad90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.201.56@tcp remote: 0x390884812bd9993d expref: 7 pid: 6671 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201219.215405:0:6668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570059008:192.168.201.56@tcp:104: 00000100:00100000:2.0:1788201219.215501:0:6668:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9e72e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201219.222303:0:6668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570059008:192.168.201.56@tcp:104: 00010000:00010000:1.0:1788201219.222497:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201219.223064:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201219.223214:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559529728 00000100:00100000:0.0:1788201219.223236:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559529728 00010000:00010000:0.0:1788201219.223298:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cad90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.56@tcp remote: 0x390884812bd9993d expref: 8 pid: 6671 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201219.223379:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 32 00000100:00100000:0.0:1788201219.223392:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485695850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559529728:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201219.223416:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201219.223422:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cad90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.56@tcp remote: 0x390884812bd9993d expref: 8 pid: 6671 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.223439:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cad90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.201.56@tcp remote: 0x390884812bd9993d expref: 8 pid: 6671 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.223830:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cad90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.201.56@tcp remote: 0x390884812bd9993d expref: 8 pid: 6671 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.223857:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788201219.223862:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788201219.223870:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.223881:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.223954:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201219.224042:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485695850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2343:x1875064559529728:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 651us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201219.224059:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 32 00010000:00010000:2.0:1788201219.224625:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.224639:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.224651:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.224660:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.224706:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201219.225184:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201219.225193:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.225203:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5800 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:0.0:1788201219.225210:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.225232:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.225256:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.225263:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea0d9457/0xa81c4c9a2f3cade4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.225309:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201219.225310:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201219.225312:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201219.226016:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570058880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10873us (11148us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788201219.226024:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:0.0:1788201219.227863:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9624ba472d80/2, rc 0, transno 8589934594 00000100:00100000:0.0:1788201219.227884:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570058880:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201219.830676:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201220.857463:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201221.174750:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570059136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201221.174846:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.174991:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570059136 00000100:00100000:2.0:1788201221.175001:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570059136 00000100:00100000:2.0:1788201221.175065:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788201221.175076:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875064570059136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201221.175115:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 46465024 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788201221.175237:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201221.186811:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875064570059136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11728us (11956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.186829:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201221.191586:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570059136:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788201221.249807:0:12523:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00080000:0.0:1788201221.249827:0:12523:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000100:00100000:1.0:1788201221.697222:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201221.697248:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570059264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201221.697378:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201221.697473:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570059264 00000100:00100000:1.0:1788201221.697482:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570059264 00000100:00100000:1.0:1788201221.697543:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201221.697553:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570059264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201221.697590:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201221.697636:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570059264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201221.697643:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788201221.697665:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201221.697695:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba473100 x1875064570059264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201221.697715:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570059264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201221.878532:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201221.941693:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201221.941747:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201221.941770:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559529984 00000100:00100000:0.0:1788201221.941781:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559529984 00000100:00100000:3.0:1788201221.941787:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201221.941827:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201221.941846:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 149 00000100:00100000:3.0:1788201221.941849:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559530240 00000100:00100000:3.0:1788201221.941853:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559530240 00000100:00100000:0.0:1788201221.941856:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2341:x1875064559529984:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201221.941882:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559530112 00000100:00100000:3.0:1788201221.941884:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559530112 00000100:00100000:3.0:1788201221.941902:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 74 00000100:00100000:3.0:1788201221.941908:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1d5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559530240:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201221.941939:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2341:x1875064559529984:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 84us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201221.941947:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 149 00000100:00100000:3.0:1788201221.941948:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1d5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559530240:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 40us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201221.941966:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 74 00000100:00100000:3.0:1788201221.942097:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00100000:3.0:1788201221.942105:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559530112:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201221.942130:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559530112:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201221.942137:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00080000:1.0:1788201221.942748:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201221.942754:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201221.942768:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201221.943696:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559529856 00000100:00100000:2.0:1788201221.943709:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559529856 00000100:00100000:2.0:1788201221.943762:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 301 00000100:00100000:2.0:1788201221.943771:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559529856:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201221.943829:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559529856:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 59us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.943836:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 301 00010000:00010000:0.0:1788201222.904140:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201223.926778:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201224.246705:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570059520:0@lo:400:kworker.0 00000100:00100000:0.0:1788201224.246831:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201224.246929:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570060032:0@lo:400:kworker.0 00000100:00100000:0.0:1788201224.246956:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201224.246989:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201224.246995:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570059648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201224.247027:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201224.247084:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570059520 00000100:00100000:0.0:1788201224.247094:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570059520 00000100:00100000:0.0:1788201224.247174:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570060032 00000100:00100000:0.0:1788201224.247179:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570060032 00000100:00100000:0.0:1788201224.247218:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788201224.247230:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570059520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201224.247304:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570059520:12345-0@lo:400:kworker.0 Request processed in 75us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201224.247335:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788201224.247402:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788201224.247409:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570060032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201224.247441:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570060032:12345-0@lo:400:kworker.0 Request processed in 32us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201224.247447:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788201224.247474:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570059648 00000100:00100000:0.0:1788201224.247479:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570059648 00000100:00100000:0.0:1788201224.247513:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788201224.247520:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570059648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201224.247553:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570059648:12345-0@lo:400:kworker.0 Request processed in 33us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201224.247558:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788201224.247608:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000004:00080000:0.0:1788201224.247615:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9624ba472d80, transno 8589934594 00000100:00100000:0.0:1788201224.247630:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570059648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201224.247641:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570059520:0@lo:400:kworker.0 00000100:00100000:0.0:1788201224.247650:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570060032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201224.247800:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570059392:0@lo:400:kworker.0 00000100:00100000:1.0:1788201224.247848:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201224.247891:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570059904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201224.247919:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201224.247943:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201224.247950:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570059776:0@lo:400:kworker.0 00000100:00100000:1.0:1788201224.247975:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201224.248003:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201224.248009:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201224.248498:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570059904 00000100:00100000:1.0:1788201224.248505:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570059904 00000100:00100000:1.0:1788201224.248545:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788201224.248553:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570059904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201224.249980:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570059392 00000100:00100000:0.0:1788201224.249995:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570059392 00000100:00100000:0.0:1788201224.250057:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788201224.250066:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570059392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201224.250194:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570059392:12345-0@lo:400:kworker.0 Request processed in 128us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201224.250220:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788201224.250385:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570059904:12345-0@lo:400:kworker.0 Request processed in 1832us (2464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201224.250394:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788201224.250424:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201224.250463:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570059392:0@lo:400:kworker.0 00010000:00080000:1.0:1788201224.250481:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0ed80 x1875064570059904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201224.250495:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570059904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201224.250537:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570059776 00000100:00100000:1.0:1788201224.250541:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570059776 00000100:00100000:1.0:1788201224.250590:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788201224.250597:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570059776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201224.250658:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570059776:12345-0@lo:400:kworker.0 Request processed in 61us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201224.250664:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788201224.250694:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570059776:0@lo:400:kworker.0 00000100:00080000:0.0:1788201224.251095:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201224.957246:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201225.976037:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201226.232188:0:13342:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 1: touch ======================= 14:33:44 (1788201224) 00000100:00100000:0.0:1788201226.275047:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201226.275083:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559530496 00000100:00100000:0.0:1788201226.275092:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559530496 00000100:00100000:0.0:1788201226.275168:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:0.0:1788201226.275178:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:12000:x1875064559530496:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1788201226.275203:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201226.275295:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cadeb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99952 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.276681:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cadf2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.276703:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cadf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.276717:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cadf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.276773:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de000/0xa81c4c9a2f3cadf9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.276781:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de000/0xa81c4c9a2f3cadf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.276789:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de000/0xa81c4c9a2f3cadf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788201226.277491:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788201226.280681:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788201226.282180:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cae00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.282206:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cae00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.282512:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cae00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.282565:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cadf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.282572:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cadf2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.282579:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cadf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.282587:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4dfc00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201226.282591:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cadf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.282600:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cadf2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.282614:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:0.0:1788201226.282618:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201226.282623:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cadf2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.282642:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cadf2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201226.282663:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000371af63b reply state 000000008f13b47b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de000/0xa81c4c9a2f3cadf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201226.282673:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201226.282719:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cadeb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99952 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.282732:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cae00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99952 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.282739:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9624a8e9fc00) 00010000:00010000:0.0:1788201226.282741:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201226.282743:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dea00, rc 0) 00000100:00100000:0.0:1788201226.284508:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:12000:x1875064559530496:12345-192.168.201.56@tcp:101:bash.0 Request processed in 9317us (9457us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788201226.284522:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 36 00010000:00010000:0.0:1788201226.290805:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de000/0xa81c4c9a2f3cadf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.290825:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de000/0xa81c4c9a2f3cadf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.290834:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de000/0xa81c4c9a2f3cadf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.290841:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4de000 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201226.290854:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de000/0xa81c4c9a2f3cadf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.290862:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de000/0xa81c4c9a2f3cadf9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.290891:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3509f068 (ffff9624a8e9f600) 00010000:00010000:0.0:1788201226.290895:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201226.290900:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de000/0xa81c4c9a2f3cadf9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201226.290906:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de000/0xa81c4c9a2f3cadf9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201226.297579:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570060160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201226.297667:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201226.299743:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570060160 00000100:00100000:0.0:1788201226.299759:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570060160 00000100:00100000:0.0:1788201226.299889:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788201226.299902:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570060160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201226.299945:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44761088 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201226.300027:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570060160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201226.300034:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788201226.300143:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570060160:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201226.304053:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201226.319890:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201226.322032:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559530624 00000100:00100000:2.0:1788201226.322053:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559530624 00000100:00100000:2.0:1788201226.322200:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:2.0:1788201226.322231:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559530624:12345-192.168.201.56@tcp:101:date.0 00010000:00010000:2.0:1788201226.322255:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201226.322282:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeb1d4da/0xa81c4c9a2f3cae0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99959 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201226.327754:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201226.327793:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1788201226.327800:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201226.327816:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb1d4da/0xa81c4c9a2f3cae0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99959 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201226.327845:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eeb1d4da/0xa81c4c9a2f3cae0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99959 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201226.327860:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c4e00, rc 0) 00000100:00100000:2.0:1788201226.327959:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559530624:12345-192.168.201.56@tcp:101:date.0 Request processed in 5730us (8088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.327968:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00080000:0.0:1788201226.328719:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201226.338185:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201226.338322:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559530752 00000100:00100000:3.0:1788201226.338336:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559530752 00000100:00100000:3.0:1788201226.338500:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:3.0:1788201226.338510:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:12000:x1875064559530752:12345-192.168.201.56@tcp:101:date.0 00010000:00010000:3.0:1788201226.338534:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201226.338559:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962d9859/0xa81c4c9a2f3cae15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99960 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201226.338601:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eeb1d4da/0xa81c4c9a2f3cae0e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99959 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201226.338611:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201226.338616:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201226.338622:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962d9859/0xa81c4c9a2f3cae15 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201226.338669:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eeb1d4da/0xa81c4c9a2f3cae0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99959 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201226.338705:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eeb1d4da/0xa81c4c9a2f3cae0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99959 expref: 7 pid: 6671 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201226.338724:0:6668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570060288:192.168.201.56@tcp:104: 00000100:00100000:3.0:1788201226.338842:0:6668:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624812e3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201226.350497:0:6668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570060288:192.168.201.56@tcp:104: 00010000:00010000:3.0:1788201226.350536:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000962d9859/0xa81c4c9a2f3cae15 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201226.350559:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7d600, rc 0) 00000100:00100000:3.0:1788201226.350732:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:12000:x1875064559530752:12345-192.168.201.56@tcp:101:date.0 Request processed in 12223us (12555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201226.350743:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:1.0:1788201226.350818:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201226.351036:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559530880 00000100:00100000:3.0:1788201226.351044:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559530880 00010000:00010000:3.0:1788201226.351074:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb1d4da/0xa81c4c9a2f3cae0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99959 expref: 7 pid: 6671 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201226.351122:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:3.0:1788201226.351134:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2343:x1875064559530880:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201226.351150:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201226.351179:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eeb1d4da/0xa81c4c9a2f3cae0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99959 expref: 7 pid: 6671 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201226.351224:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eeb1d4da/0xa81c4c9a2f3cae0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99959 expref: 7 pid: 6671 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201226.351255:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeb1d4da/0xa81c4c9a2f3cae0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99959 expref: 7 pid: 6671 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201226.351271:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201226.351276:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201226.351285:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000962d9859/0xa81c4c9a2f3cae15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 6 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201226.351297:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962d9859/0xa81c4c9a2f3cae15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 6 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201226.351333:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000962d9859/0xa81c4c9a2f3cae15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 6 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201226.351397:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c42300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5810:1875064570060416:192.168.201.56@tcp:105: 00000100:00100000:3.0:1788201226.352337:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624812e3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201226.360769:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201226.360951:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c42300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5810:1875064570060416:192.168.201.56@tcp:105: 00010000:00010000:3.0:1788201226.360976:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201226.361040:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559530880:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 9908us (10703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201226.361052:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:3.0:1788201226.361122:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559531136 00000100:00100000:3.0:1788201226.361130:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559531136 00000100:00100000:3.0:1788201226.361172:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:3.0:1788201226.361180:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:12000:x1875064559531136:12345-192.168.201.56@tcp:35:date.0 00000100:00100000:3.0:1788201226.361778:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:12000:x1875064559531136:12345-192.168.201.56@tcp:35:date.0 Request processed in 595us (1020us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788201226.361786:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:0.0:1788201226.812441:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201226.812476:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570060544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201226.812582:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201226.812655:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570060544 00000100:00100000:0.0:1788201226.812663:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570060544 00000100:00100000:0.0:1788201226.812735:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788201226.812745:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570060544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201226.812782:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201226.813042:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570060544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 297us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201226.813050:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788201226.813071:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201226.813111:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0df80 x1875064570060544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201226.813131:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570060544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201226.998465:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201227.058169:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201227.058251:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201227.058381:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559531392 00000100:00100000:3.0:1788201227.058391:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559531392 00000100:00080000:1.0:1788201227.058481:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201227.058854:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00100000:3.0:1788201227.058880:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559531392:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201227.058967:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559531392:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 103us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201227.058976:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00100000:0.0:1788201227.063756:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559531264 00000100:00100000:0.0:1788201227.063773:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559531264 00000100:00100000:0.0:1788201227.063905:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 303 00000100:00100000:0.0:1788201227.063917:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559531264:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201227.064078:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559531264:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 163us (5920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201227.064700:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 303 00010000:00010000:2.0:1788201228.032604:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788201228.242218:0:13439:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788201228.242262:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.242275:0:13439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.242295:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.242302:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.242327:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201228.242333:0:13439:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788201228.242472:0:13439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201228.242477:0:13439:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788201228.242483:0:13439:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201228.242505:0:13439:0:(import.c:65:import_set_state_nolock()) ffff96248591a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788201228.242633:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201228.242640:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.242648:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2400 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201228.242652:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.242659:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201228.242665:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201228.242671:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201228.242674:0:5814:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788201228.242676:0:5814:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788201228.242998:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.243006:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201228.243030:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.243039:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962498ac2400/0xa81c4c9a2f3cacef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cacf6 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.243053:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201228.243054:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201228.243056:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201228.243232:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201228.243256:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570060800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201228.243362:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201228.243456:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570060800 00000100:00100000:3.0:1788201228.243464:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570060800 00000100:00100000:3.0:1788201228.243517:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201228.243526:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570060800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201228.243540:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788201228.243672:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570060672:0@lo:39:umount.0 00000100:00100000:1.0:1788201228.243708:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201228.243741:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570060672 00000100:00100000:1.0:1788201228.243745:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570060672 00000100:00100000:1.0:1788201228.243782:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201228.243788:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875064570060672:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788201228.243810:0:5826:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cad0b 00000100:00080000:1.0:1788201228.243818:0:5826:0:(import.c:65:import_set_state_nolock()) ffff9624b9777800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788201228.244682:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+1:3281:x1875064570060672:12345-0@lo:39:umount.0 Request processed in 891us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201228.244692:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:00000080:1.0:1788201228.244702:0:5826:0:(genops.c:906:class_export_put()) final put ffff9624b9772800/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:1.0:1788201228.244732:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788201228.244743:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201228.244752:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9624b9772800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201228.244799:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9624b9777800 for lustre-MDT0000 00010000:00010000:3.0:1788201228.244932:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cacf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cacef expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201228.244948:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201228.245001:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3282:x1875064570060800:12345-0@lo:103:ldlm_bl.0 Request processed in 1477us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201228.245009:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788201228.245159:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96248591a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788201228.245173:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570060672:0@lo:39:umount.0 00000100:00080000:0.0:1788201228.245199:0:13439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201228.245202:0:13439:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788201228.245207:0:13439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788201228.245657:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570060800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201228.247499:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.247518:0:13439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.247525:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.247532:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.248194:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201228.248204:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.248212:0:13439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.248217:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.248223:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.248532:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201228.248551:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.248562:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7ce00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201228.248566:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.248574:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201228.248580:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201228.248586:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201228.248588:0:5814:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788201228.248624:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.248630:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201228.248667:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.248673:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624b9a7ce00/0xa81c4c9a2f3cacb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cacbe expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.248684:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201228.248687:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.248692:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7dc00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201228.248704:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.248711:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201228.248717:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201228.248722:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788201228.248724:0:5814:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788201228.248737:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.248743:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201228.248749:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.248756:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201228.248758:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201228.248760:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201228.248926:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570061056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201228.248992:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201228.249054:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201228.249069:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570060928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201228.249092:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201228.249122:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570061056 00000100:00100000:3.0:1788201228.249129:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570061056 00000100:00100000:3.0:1788201228.249169:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570060928 00000100:00100000:3.0:1788201228.249171:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570060928 00000100:00100000:3.0:1788201228.249191:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201228.249200:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570061056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201228.249213:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201228.249229:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962498ac2c00/0xa81c4c9a2f3cace8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cace1 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201228.249242:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201228.249277:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3285:x1875064570061056:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201228.249285:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201228.249309:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201228.249315:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3285:x1875064570060928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201228.249325:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201228.249333:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962480030e00/0xa81c4c9a2f3cacbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cacb7 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201228.249429:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201228.249453:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570060928:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201228.249459:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201228.249496:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570060928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201228.249506:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570061056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201228.249811:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201228.249818:0:13439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624b9a7dc00/0xa81c4c9a2f3cace1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cace8 expref: -99 pid: 12433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201228.249829:0:13439:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788201228.249834:0:13439:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788201228.249836:0:13439:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788201228.249935:0:13439:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788201228.249940:0:13439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:0.0:1788201228.249946:0:13439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788201228.249952:0:13439:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:1.0:1788201228.251899:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000080:0.0:1788201228.252318:0:13439:0:(ofd_obd.c:1269:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:0.0:1788201228.252584:0:13439:0:(ofd_obd.c:1283:ofd_iocontrol()) syncing ost lustre-OST0000 00000020:00000080:0.0:1788201228.263210:0:13439:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788201228.263226:0:13439:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9624b9771800 986744c8-ee81-4a47-8d91-97f81ede1f3e 192.168.201.56@tcp 5 (0 0 1) 0 0 0 0: 0000000000000000 8589934593 stale:0 00000020:00080000:0.0:1788201228.263234:0:13439:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9624b9775800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 8589934594 stale:0 00000020:00080000:0.0:1788201228.263252:0:13439:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9624909db380) has exports, disconnecting them 00000020:00080000:0.0:1788201228.263257:0:13439:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.201.56@tcp (ffff9624b9771800), last request at 1788201226 00000020:00000080:0.0:1788201228.263271:0:13439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cacda 00000020:00010000:0.0:1788201228.263279:0:13439:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9624b9771800: total 0 00000100:00080000:0.0:1788201228.263284:0:13439:0:(import.c:65:import_set_state_nolock()) ffff96248ced5000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201228.263389:0:13439:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.56@tcp (ffff9624b9771800): rc 0 00000020:00080000:0.0:1788201228.263393:0:13439:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9624b9775800), last request at 1788201226 00000020:00000080:0.0:1788201228.263396:0:13439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cacd3 00000100:00080000:0.0:1788201228.263401:0:13439:0:(import.c:65:import_set_state_nolock()) ffff9624902d7800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201228.263409:0:13439:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9624b9775800): rc 0 00000020:00000080:0.0:1788201228.263411:0:13439:0:(genops.c:906:class_export_put()) final put ffff9624b9775800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:0.0:1788201228.263444:0:13439:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9624909db380) has no exports 00010000:00010000:0.0:1788201228.263504:0:13439:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000962d9859/0xa81c4c9a2f3cae15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40106400020000 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 2 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.263533:0:13439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962d9859/0xa81c4c9a2f3cae15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44907400020000 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 2 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788201228.263636:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9624b9775800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788201228.263675:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9624902d7800 for lustre-OST0000 00000020:00010000:1.0:1788201228.264672:0:5813:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9624b9771800: total 0 00010000:00010000:1.0:1788201228.264679:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201228.264728:0:5813:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9624b9771800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788201228.264742:0:5813:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9624b9771800, canceled 0 locks, left on hash table 0. 00000020:00000080:1.0:1788201228.264750:0:5813:0:(genops.c:906:class_export_put()) final put ffff9624b9771800/986744c8-ee81-4a47-8d91-97f81ede1f3e 00010000:00010000:1.0:1788201228.265646:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201228.265651:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201228.265653:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201228.266709:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9624b9771800/986744c8-ee81-4a47-8d91-97f81ede1f3e for lustre-OST0000 00000020:00000080:3.0:1788201228.266758:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96248ced5000 for lustre-OST0000 00000020:01000000:0.0:1788201228.266830:0:13439:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9624ba3b70c0 - data ffff962493aec870/ffff9624b9aeec00 00000020:01000000:0.0:1788201228.267029:0:13439:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96248cd39360 - data ffff9624b3f8b870/ffff9623827bcc00 00010000:00010000:2.0:1788201228.267425:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788201228.276215:0:13439:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788201228.293464:0:13439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3caccc 00000020:00000080:1.0:1788201228.293485:0:13439:0:(genops.c:906:class_export_put()) final put ffff96248c8c0000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788201228.293503:0:13439:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96248736f800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788201228.293507:0:13439:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96248736f800 2 00000020:01000004:1.0:1788201228.293510:0:13439:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96248736f800 from lustre-OST0000 00000020:00000080:1.0:1788201228.293531:0:13439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201228.293554:0:13439:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788201228.293557:0:13439:0:(genops.c:906:class_export_put()) final put ffff96248736a000/lustre-OST0000_UUID 00000020:00000080:1.0:1788201228.293561:0:13439:0:(genops.c:865:class_export_destroy()) destroying export ffff96248736a000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788201228.293568:0:13439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788201228.293612:0:13439:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788201228.293616:0:13439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788201228.293620:0:13439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201228.293627:0:13439:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201228.293635:0:13439:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff96248e16e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201228.293642:0:13439:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff962487fc0000) has exports, disconnecting them 00000020:00080000:1.0:1788201228.293646:0:13439:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff96248e16e000), last request at 1788201198 00000020:00000080:1.0:1788201228.293650:0:13439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cad04 00000020:00080000:1.0:1788201228.293660:0:13439:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96248e16e000): rc 0 00000020:00000080:1.0:1788201228.293664:0:13439:0:(genops.c:906:class_export_put()) final put ffff96248e16e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788201228.294704:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96248c8c0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788201228.294721:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96248e16e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788201228.298439:0:13439:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788201228.298449:0:13439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201228.298454:0:13439:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788201228.298462:0:13439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201228.298639:0:13439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201228.298650:0:13439:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788201228.298657:0:13439:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96248736f800 1 00000020:00000080:2.0:1788201228.298675:0:13439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cacb0 00000020:00000080:2.0:1788201228.298684:0:13439:0:(genops.c:906:class_export_put()) final put ffff9624902d2000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788201228.298690:0:13439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788201228.298694:0:13439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201228.298699:0:13439:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201228.298702:0:13439:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff962487fc19c0) has no exports 00000020:00000080:3.0:1788201228.298929:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96248591a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788201228.298936:0:37:0:(genops.c:906:class_export_put()) final put ffff96248e16c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788201228.298940:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96248e16c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788201228.298946:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788201228.299028:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9624902d2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788201228.312290:0:13439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201228.312308:0:13439:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788201228.312314:0:13439:0:(genops.c:906:class_export_put()) final put ffff96248cac6800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788201228.312318:0:13439:0:(genops.c:865:class_export_destroy()) destroying export ffff96248cac6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788201228.312324:0:13439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788201228.312485:0:13439:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96248cac3000 00000020:02000400:3.0:1788201228.312561:0:13439:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788201229.047490:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201229.366656:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570061184:0@lo:400:kworker.0 00000100:00100000:0.0:1788201229.366719:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570061312:0@lo:400:kworker.0 00000100:00100000:1.0:1788201229.366756:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201229.366808:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570061184 00000100:00100000:2.0:1788201229.366816:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570061184 00000100:00100000:2.0:1788201229.366876:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788201229.366886:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570061184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201229.366960:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570061440:0@lo:400:kworker.0 00000100:00100000:0.0:1788201229.376187:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201229.376266:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201229.376279:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570061696:0@lo:400:kworker.0 00000100:00100000:0.0:1788201229.376325:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201229.376907:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570061696 00000100:00100000:1.0:1788201229.376917:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570061696 00000100:00100000:1.0:1788201229.376980:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201229.376992:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570061696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201229.377070:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570061696:12345-0@lo:400:kworker.0 Request processed in 80us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201229.377076:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788201229.377105:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201229.377165:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248c840380 x1875064570061696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201229.377180:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570061696:0@lo:400:kworker.0 00000100:00100000:2.0:1788201229.378331:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570061184:12345-0@lo:400:kworker.0 Request processed in 11374us (11503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201229.378361:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788201229.378409:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570061312 00000100:00100000:2.0:1788201229.378415:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570061312 00000100:00100000:1.0:1788201229.378567:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570061184:0@lo:400:kworker.0 00000100:00100000:2.0:1788201229.378871:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788201229.378881:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570061312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201229.379334:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570061312:12345-0@lo:400:kworker.0 Request processed in 454us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201229.379361:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788201229.379400:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570061312:0@lo:400:kworker.0 00000100:00100000:3.0:1788201229.381821:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201229.382022:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570061568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201229.382090:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201229.382152:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570061568 00000100:00100000:2.0:1788201229.382162:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570061568 00000100:00100000:2.0:1788201229.382225:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788201229.382234:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570061568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201229.382294:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570061568:12345-0@lo:400:kworker.0 Request processed in 61us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201229.382313:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1788201229.382335:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201229.382387:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570061568:0@lo:400:kworker.0 00000100:00100000:3.0:1788201229.382499:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570061440 00000100:00100000:3.0:1788201229.382503:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570061440 00000100:00100000:3.0:1788201229.382540:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788201229.382545:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1875064570061440:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788201229.382551:0:6668:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788201229.382586:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1875064570061440:12345-0@lo:400:kworker.0 Request processed in 40us (776us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201229.382593:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788201229.382623:0:3284:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788201229.382628:0:3284:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201229.382631:0:3284:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1788201229.398678:0:3284:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1788201229.398688:0:3284:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201229.398698:0:3284:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 332 00000100:00080000:3.0:1788201229.398708:0:3284:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1788201229.398757:0:3284:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624b9c43480 x1875064570061824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201229.398784:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570061440:0@lo:400:kworker.0 00000100:00100000:3.0:1788201229.398820:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570061824:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:3.0:1788201229.399017:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201229.399092:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570061824 00000100:00100000:3.0:1788201229.399101:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570061824 00000100:00100000:3.0:1788201229.399142:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201229.399151:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570061824:12345-0@lo:8:ptlrpcd_00_02.0 00010000:00020000:3.0:1788201229.399172:0:6670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201229.430457:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570061824:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 31296us (31429us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201229.430473:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788201229.431056:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201229.431064:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201229.431069:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570061824:0@lo:8:ptlrpcd_00_02.0 00000001:00080000:2.0:1788201229.479904:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000001:00080000:2.0:1788201229.479923:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967311 is committed 00010000:00010000:2.0:1788201230.073646:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201231.102676:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201231.667785:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201231.667839:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201231.667940:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559531520 00000100:00100000:2.0:1788201231.667959:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559531520 00000100:00100000:2.0:1788201231.668014:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:2.0:1788201231.668023:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0+-99:2344:x1875064559531520:12345-192.168.201.56@tcp:4:date.0 00000020:00080000:2.0:1788201231.668032:0:6675:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.201.56@tcp 00000100:00100000:2.0:1788201231.668090:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0+-99:2344:x1875064559531520:12345-192.168.201.56@tcp:4:date.0 Request processed in 67us (315us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201231.668097:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:0.0:1788201231.668387:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559531648 00000100:00100000:0.0:1788201231.668393:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559531648 00000100:00100000:0.0:1788201231.668426:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 37 00000100:00100000:0.0:1788201231.668432:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1875064559531648:12345-192.168.201.56@tcp:16:kworker.0 00000020:00080000:0.0:1788201231.668438:0:8088:0:(tgt_handler.c:807:tgt_request_handle()) operation 16 on unconnected OST from 12345-192.168.201.56@tcp 00000100:00100000:0.0:1788201231.668461:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1875064559531648:12345-192.168.201.56@tcp:16:kworker.0 Request processed in 29us (621us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201231.668467:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 37 00000100:00100000:0.0:1788201231.706391:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201231.706553:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559531776 00000100:00100000:2.0:1788201231.706564:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559531776 00000100:00100000:2.0:1788201231.706610:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:2.0:1788201231.706618:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559531776:12345-192.168.201.56@tcp:8:ptlrpcd_01_01.0 00010000:00020000:2.0:1788201231.706641:0:6668:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201231.706717:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559531776:12345-192.168.201.56@tcp:8:ptlrpcd_01_01.0 Request processed in 97us (377us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201231.706725:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:1.0:1788201231.927293:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201231.927321:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570061952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201231.927427:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201231.927761:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570061952 00000100:00100000:0.0:1788201231.927771:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570061952 00000100:00100000:0.0:1788201231.927868:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788201231.927878:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570061952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201231.927918:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201231.927973:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570061952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.927980:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1788201231.928035:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624bfd2c700 x1875064570061952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201231.928056:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570061952:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201231.928562:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201232.119211:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201232.179737:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201232.180513:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559532160 00000100:00100000:0.0:1788201232.180524:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559532160 00000100:00100000:0.0:1788201232.180598:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:0.0:1788201232.180606:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559532160:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:0.0:1788201232.180630:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201232.180708:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559532160:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 101us (981us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201232.180716:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:0.0:1788201232.182204:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201232.182248:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201232.182291:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201232.182493:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559531904 00000100:00100000:2.0:1788201232.182503:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559531904 00000100:00100000:2.0:1788201232.182557:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 305 00000100:00100000:2.0:1788201232.182580:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559531904:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201232.182647:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559531904:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 69us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201232.182655:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 305 00000100:00100000:3.0:1788201232.182837:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559532288 00000100:00100000:3.0:1788201232.182841:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559532288 00000100:00100000:3.0:1788201232.182889:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 80 00000100:00100000:3.0:1788201232.182897:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559532288:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201232.182932:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559532288:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 37us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201232.182939:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 80 00000100:00100000:1.0:1788201232.183124:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559532032 00000100:00100000:1.0:1788201232.183130:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559532032 00000100:00100000:1.0:1788201232.183166:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 155 00000100:00100000:1.0:1788201232.183173:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559532032:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201232.183208:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559532032:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 36us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.183215:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 155 00000100:00080000:2.0:1788201232.183467:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201232.183473:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201233.142664:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201234.166660:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201234.487277:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201234.487284:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201234.487288:0:37:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201234.487296:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 361 00000100:00080000:0.0:1788201234.487302:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201234.487310:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788201234.487364:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624bfd2d880 x1875064570062336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201234.487452:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570062336:0@lo:8:kworker.0 00000100:00100000:0.0:1788201234.487532:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201234.487619:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570062464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201234.487650:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201234.487671:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201234.487676:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570062592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201234.487697:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201234.487732:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570062336 00000100:00100000:2.0:1788201234.487838:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570062208:0@lo:400:kworker.0 00000100:00100000:2.0:1788201234.487870:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.487892:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201234.487897:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570062080:0@lo:400:kworker.0 00000100:00100000:2.0:1788201234.487921:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.487979:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570062464 00000100:00100000:2.0:1788201234.487987:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570062464 00000100:00100000:2.0:1788201234.488041:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570062208 00000100:00100000:2.0:1788201234.488045:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570062208 00000100:00100000:2.0:1788201234.488066:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788201234.488075:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570062464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201234.488128:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570062464:12345-0@lo:400:kworker.0 Request processed in 54us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201234.488136:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788201234.488151:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788201234.488157:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570062208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201234.488185:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570062208:12345-0@lo:400:kworker.0 Request processed in 29us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201234.488191:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788201234.488222:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570062080 00000100:00100000:2.0:1788201234.488226:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570062080 00000100:00100000:2.0:1788201234.488247:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788201234.488253:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570062080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201234.488283:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570062080:12345-0@lo:400:kworker.0 Request processed in 30us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201234.488289:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788201234.488320:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570062592 00000100:00100000:2.0:1788201234.488323:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570062592 00000100:00100000:2.0:1788201234.488369:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788201234.488377:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570062592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201234.488407:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570062592:12345-0@lo:400:kworker.0 Request processed in 32us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201234.488414:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788201234.488429:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201234.488433:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788201234.488459:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248c9c7100 x1875064570062592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201234.488474:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570062592:0@lo:400:kworker.0 00000100:00100000:2.0:1788201234.488486:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570062464:0@lo:400:kworker.0 00000100:00100000:2.0:1788201234.488515:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570062080:0@lo:400:kworker.0 00000100:00100000:2.0:1788201234.488524:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570062208:0@lo:400:kworker.0 00000100:00100000:0.0:1788201234.488685:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570062336 00000100:00100000:0.0:1788201234.488719:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201234.488725:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570062336:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788201234.488811:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201234.528461:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570062336:12345-0@lo:8:kworker.0 Request processed in 39726us (40920us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201234.528476:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788201234.529730:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201234.529745:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201234.529749:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570062336:0@lo:8:kworker.0 00010000:00010000:0.0:1788201235.201018:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201236.219690:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201237.046659:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201237.046683:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570062720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201237.046766:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201237.047421:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570062720 00000100:00100000:0.0:1788201237.047431:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570062720 00000100:00100000:0.0:1788201237.047502:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201237.047514:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570062720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201237.047559:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201237.047644:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570062720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201237.047651:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1788201237.047717:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248c9c6a00 x1875064570062720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201237.047739:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570062720:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201237.048950:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201237.238589:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201237.298138:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201237.298405:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559532416 00000100:00100000:1.0:1788201237.298417:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559532416 00000100:00100000:1.0:1788201237.298496:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 307 00000100:00100000:1.0:1788201237.298525:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559532416:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201237.298613:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559532416:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 108us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201237.298620:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 307 00000100:00100000:3.0:1788201237.298985:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201237.299268:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201237.299294:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201237.299318:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559532800 00000100:00100000:3.0:1788201237.299323:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559532800 00000100:00100000:3.0:1788201237.299431:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559532672 00000100:00100000:3.0:1788201237.299436:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559532672 00000100:00100000:3.0:1788201237.299452:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 82 00000100:00100000:3.0:1788201237.299460:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559532800:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201237.299549:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559532800:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 90us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201237.299557:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 82 00000100:00100000:3.0:1788201237.299575:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 41 00000100:00100000:3.0:1788201237.299579:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559532672:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:3.0:1788201237.299629:0:6668:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201237.299670:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559532672:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 88us (374us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201237.299696:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 41 00000100:00080000:2.0:1788201237.300070:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201237.300559:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559532544 00000100:00100000:1.0:1788201237.300567:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559532544 00000100:00100000:1.0:1788201237.300642:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 158 00000100:00100000:1.0:1788201237.300651:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559532544:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201237.300738:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559532544:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 88us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201237.300759:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 158 00000100:00080000:2.0:1788201237.301362:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201238.262975:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201239.286546:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201239.606611:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201239.606618:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201239.606621:0:8:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201239.606630:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 366 00000100:00080000:0.0:1788201239.606649:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201239.606657:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788201239.606684:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96248c9c4700 x1875064570063104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201239.606914:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570062976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201239.606986:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201239.607055:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201239.607061:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570063232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201239.607082:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201239.607129:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570062976 00000100:00100000:1.0:1788201239.607137:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570062976 00000100:00100000:1.0:1788201239.607184:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570063232 00000100:00100000:1.0:1788201239.607187:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570063232 00000100:00100000:1.0:1788201239.607229:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788201239.607239:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570062976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201239.607294:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570062976:12345-0@lo:400:kworker.0 Request processed in 56us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201239.607300:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788201239.607315:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788201239.607320:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570063232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201239.607365:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570063232:12345-0@lo:400:kworker.0 Request processed in 45us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201239.607370:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788201239.607410:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570063232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201239.607420:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570062976:0@lo:400:kworker.0 00000100:00100000:3.0:1788201239.610663:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570063360:0@lo:400:kworker.0 00000100:00100000:3.0:1788201239.610765:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201239.610824:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201239.610831:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570062848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201239.610875:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201239.610931:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570063360 00000100:00100000:3.0:1788201239.610940:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570063360 00000100:00100000:3.0:1788201239.611000:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201239.611013:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570063360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201239.611075:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570063360:12345-0@lo:400:kworker.0 Request processed in 65us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201239.611082:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1788201239.611115:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248c9c5500 x1875064570063360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201239.611131:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570063360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201239.611381:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570063104:0@lo:8:kworker.0 00000100:00100000:2.0:1788201239.611418:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201239.611463:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201239.611467:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201239.611479:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570062848 00000100:00100000:2.0:1788201239.611483:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570062848 00000100:00100000:2.0:1788201239.611510:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788201239.611517:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064570062848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201239.611552:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064570062848:12345-0@lo:400:kworker.0 Request processed in 36us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201239.611559:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788201239.611590:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570062848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201239.613333:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570063104 00000100:00100000:3.0:1788201239.613377:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570063104 00000100:00100000:3.0:1788201239.613415:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201239.613422:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570063104:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788201239.613443:0:6670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201239.613528:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570063104:12345-0@lo:8:kworker.0 Request processed in 103us (2107us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201239.613536:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788201239.614063:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201239.614070:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201239.614073:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570063104:0@lo:8:kworker.0 00010000:00010000:2.0:1788201240.310738:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201241.334476:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201242.166515:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201242.166551:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570063488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201242.166635:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201242.167041:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570063488 00000100:00100000:0.0:1788201242.167053:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570063488 00000100:00080000:1.0:1788201242.167114:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201242.167129:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788201242.167140:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570063488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201242.167177:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201242.167240:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570063488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201242.167246:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1788201242.169938:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248c9c5500 x1875064570063488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201242.169970:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570063488:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201242.359482:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201242.427679:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201242.427723:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201242.427758:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201242.427787:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201242.427831:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559533184 00000100:00100000:0.0:1788201242.427841:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559533184 00000100:00100000:0.0:1788201242.427878:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559533312 00000100:00100000:0.0:1788201242.427881:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559533312 00000100:00100000:0.0:1788201242.427921:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:0.0:1788201242.427929:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559533184:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:0.0:1788201242.427952:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201242.428026:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559533184:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 96us (267us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201242.428035:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:0.0:1788201242.428051:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 44 00000100:00100000:0.0:1788201242.428058:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559533312:12345-192.168.201.56@tcp:9:kworker.0 00000020:00000080:0.0:1788201242.428108:0:8088:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cad2e 00000100:00080000:0.0:1788201242.428116:0:8088:0:(import.c:65:import_set_state_nolock()) ffff96248591f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201242.428178:0:8088:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788201242.428568:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+2:2340:x1875064559533312:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 508us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201242.428575:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 44 00000100:00080000:0.0:1788201242.428614:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201242.428628:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201242.428710:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559533056 00000100:00100000:1.0:1788201242.428716:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559533056 00000100:00100000:1.0:1788201242.428755:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 161 00000100:00100000:1.0:1788201242.428763:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559533056:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201242.428795:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559533056:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 33us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201242.428801:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 161 00000100:00100000:2.0:1788201242.429426:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559532928 00000100:00100000:2.0:1788201242.429432:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559532928 00000100:00100000:2.0:1788201242.429467:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 309 00000100:00100000:2.0:1788201242.429475:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559532928:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201242.429511:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559532928:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 37us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201242.429531:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 309 00000100:00080000:0.0:1788201242.430493:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201243.383507:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201244.408831:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201244.727505:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201244.727513:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201244.727517:0:8:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201244.727526:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 371 00000100:00080000:0.0:1788201244.727532:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788201244.727540:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788201244.727577:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96248c9c4e00 x1875064570063872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201244.727837:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570063616:0@lo:400:kworker.0 00000100:00100000:1.0:1788201244.727923:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201244.727993:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201244.727999:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570063744:0@lo:400:kworker.0 00000100:00100000:1.0:1788201244.728026:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201244.728054:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570063872:0@lo:8:kworker.0 00000100:00100000:1.0:1788201244.728079:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201244.728105:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570064000:0@lo:400:kworker.0 00000100:00100000:1.0:1788201244.728127:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201244.728145:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201244.728160:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570064128:0@lo:400:kworker.0 00000100:00100000:1.0:1788201244.728183:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201244.728224:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570063616 00000100:00100000:1.0:1788201244.728232:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570063616 00000100:00100000:1.0:1788201244.728278:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788201244.728287:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570063616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201244.728337:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570063616:12345-0@lo:400:kworker.0 Request processed in 52us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201244.728370:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788201244.728403:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570063744 00000100:00100000:1.0:1788201244.728407:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570063744 00000100:00100000:1.0:1788201244.728431:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570064000 00000100:00100000:1.0:1788201244.728434:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570064000 00000100:00100000:1.0:1788201244.728462:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788201244.728468:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570063744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201244.728500:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570063744:12345-0@lo:400:kworker.0 Request processed in 32us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201244.728505:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788201244.728516:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788201244.728521:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570064000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201244.728549:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570064000:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201244.728554:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788201244.728758:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570063872 00000100:00100000:1.0:1788201244.728762:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570063872 00000100:00100000:1.0:1788201244.729279:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570064128 00000100:00100000:1.0:1788201244.729283:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570064128 00000100:00100000:0.0:1788201244.731070:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788201244.731088:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570064128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201244.731176:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570064128:12345-0@lo:400:kworker.0 Request processed in 95us (2991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201244.731184:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788201244.731206:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788201244.731211:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570063872:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788201244.731227:0:6670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788201244.732824:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201244.732833:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201244.732905:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570063744:0@lo:400:kworker.0 00000100:00100000:2.0:1788201244.732920:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570063616:0@lo:400:kworker.0 00010000:00080000:2.0:1788201244.734605:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248c9c6d80 x1875064570064128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201244.734630:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570064128:0@lo:400:kworker.0 00000100:00100000:2.0:1788201244.734653:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570064000:0@lo:400:kworker.0 00000100:00080000:2.0:1788201244.756426:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201244.756437:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201244.756442:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570063872:0@lo:8:kworker.0 00000100:00100000:0.0:1788201244.757952:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570063872:12345-0@lo:8:kworker.0 Request processed in 25124us (28257us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201244.757966:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000001:00100000:1.0:1788201245.323834:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:1.0:1788201245.323850:0:7629:0:(genops.c:906:class_export_put()) final put ffff96248591d800/986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:2.0:1788201245.323938:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248591d800/986744c8-ee81-4a47-8d91-97f81ede1f3e for lustre-OST0001 00000020:00000080:2.0:1788201245.324007:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96248591f000 for lustre-OST0001 00010000:00010000:3.0:1788201245.431442:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201246.454669:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201246.598481:0:13886:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788201246.598487:0:13886:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788201246.598593:0:13886:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff962381a3a800 00000020:01000004:2.0:1788201246.598611:0:13886:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788201246.598624:0:13886:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788201246.598640:0:13886:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff962487eb0000) 00000020:00000080:2.0:1788201246.598663:0:13886:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788201246.646804:0:13886:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788201246.648992:0:13886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788201246.652456:0:13886:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788201246.654426:0:13886:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788201246.656389:0:13886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1788201246.658603:0:13886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 529: rc = 0 00100000:10000000:0.0:1788201246.658706:0:13886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:2.0:1788201246.659981:0:13886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 529: rc = 0 00100000:10000000:1.0:1788201246.677821:0:13886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 377: rc = 0 00100000:10000000:1.0:1788201246.697770:0:13886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 377: rc = 0 00100000:10000000:1.0:1788201246.700313:0:13886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 377: rc = 0 00100000:10000000:2.0:1788201246.707988:0:13886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 377: rc = 0 00100000:10000000:0.0:1788201246.719677:0:13886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 377: rc = 0 00100000:10000000:1.0:1788201246.739321:0:13886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 377: rc = 0 00000020:00000080:0.0:1788201246.762101:0:13886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788201246.762115:0:13886:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788201246.762127:0:13886:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3cae23 00000020:01000004:0.0:1788201246.762136:0:13886:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788201246.762160:0:13886:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.156@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788201246.762165:0:13886:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788201246.762171:0:13886:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788201246.762195:0:13886:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788201246.762200:0:13886:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788201246.785813:0:13886:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788201246.785957:0:13886:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.156@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788201246.785962:0:13886:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788201246.785964:0:13886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201246.785966:0:13886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201246.785967:0:13886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201246.785968:0:13886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201246.785970:0:13886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201246.785971:0:13886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201246.785972:0:13886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201246.785974:0:13886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201246.785977:0:13886:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788201246.785979:0:13886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201246.785980:0:13886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201246.785981:0:13886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201246.785983:0:13886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201246.785984:0:13886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201246.785985:0:13886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201246.785986:0:13886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201246.785987:0:13886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201246.785988:0:13886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201246.786117:0:13886:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788201246.786143:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570064256:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201246.786222:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201246.786372:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624bfd20180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201246.786493:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570064256 00000100:00100000:2.0:1788201246.786502:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570064256 00000100:00100000:2.0:1788201246.786777:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788201246.786787:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:13886:x1875064570064256:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201246.786821:0:5820:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788201246.786824:0:5820:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788201246.786828:0:5820:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788201246.796164:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:13886:x1875064570064256:12345-0@lo:253:mount.lustre.0 Request processed in 9369us (9931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201246.796179:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788201246.796265:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570064256:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201246.796280:0:13886:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788201246.796297:0:13886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201246.796299:0:13886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201246.796300:0:13886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201246.796301:0:13886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201246.796302:0:13886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201246.796304:0:13886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201246.796305:0:13886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201246.796307:0:13886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201246.796308:0:13886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788201246.796328:0:13886:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962381a3a800 from lustre-OST0000 10000000:01000000:2.0:1788201246.796838:0:13886:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788201246.796957:0:13886:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788201246.796968:0:13886:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962485b40000 local copy 00010000:00010000:2.0:1788201246.796978:0:13886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201246.797412:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570064384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201246.797463:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201246.797548:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c9e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201246.797736:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570064384 00000100:00100000:0.0:1788201246.797752:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570064384 00000100:00100000:0.0:1788201246.797841:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788201246.797859:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:13886:x1875064570064384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201246.798117:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:13886:x1875064570064384:12345-0@lo:501:mount.lustre.0 Request processed in 259us (653us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201246.798125:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788201246.798206:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570064384:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788201246.798221:0:13886:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788201246.798376:0:13886:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788201246.798384:0:13886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.798394:0:13886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201246.798419:0:13886:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962381a3a800 10000000:01000000:2.0:1788201246.798423:0:13886:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788201246.798435:0:13886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788201246.798437:0:13886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201246.798441:0:13886:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788201246.798444:0:13886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201246.798467:0:13886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.798475:0:13886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.798483:0:13886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201246.798497:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570064512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201246.798542:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201246.799312:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c9e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201246.799429:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570064512 00000100:00100000:1.0:1788201246.799436:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570064512 00000100:00100000:1.0:1788201246.799477:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788201246.799486:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:13886:x1875064570064512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201246.799498:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201246.799618:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962498ac3600/0xa81c4c9a2f3cae31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cae2a expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201246.799645:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962498ac3600/0xa81c4c9a2f3cae31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cae2a expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201246.799656:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962498ac3600/0xa81c4c9a2f3cae31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cae2a expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201246.799745:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac3600, rc 0) 00000100:00100000:1.0:1788201246.799963:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:13886:x1875064570064512:12345-0@lo:101:mount.lustre.0 Request processed in 478us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.799970:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788201246.800186:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570064512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201246.800201:0:13886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.800211:0:13886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201246.806541:0:13886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788201246.808510:0:13886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201246.809243:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788201246.809297:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788201246.809334:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788201246.809413:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788201246.809449:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788201246.809504:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788201246.810631:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788201246.810784:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788201246.810824:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788201246.811161:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788201246.811203:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788201246.811249:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788201246.811328:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788201246.811337:0:13886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788201246.811608:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570064640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201246.811759:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201246.811885:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624bfd48e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201246.812141:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570064640 00000100:00100000:0.0:1788201246.812148:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570064640 00000100:00100000:0.0:1788201246.812258:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788201246.812270:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:13886:x1875064570064640:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201246.812594:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:13886:x1875064570064640:12345-0@lo:501:mount.lustre.0 Request processed in 325us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.812602:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788201246.812709:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570064640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201246.812769:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570064768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201246.812811:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201246.814204:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624bfd48e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201246.814284:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570064768 00000100:00100000:3.0:1788201246.814292:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570064768 00000100:00100000:3.0:1788201246.814335:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788201246.814375:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:13886:x1875064570064768:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201246.814776:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:13886:x1875064570064768:12345-0@lo:503:mount.lustre.0 Request processed in 403us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201246.814783:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788201246.815257:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570064768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788201246.816211:0:13886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201246.816293:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570064896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201246.816387:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201246.816421:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624bfd48e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201246.816622:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570064896 00000100:00100000:3.0:1788201246.816629:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570064896 00000100:00100000:3.0:1788201246.816676:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788201246.816684:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:13886:x1875064570064896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201246.817210:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:13886:x1875064570064896:12345-0@lo:502:mount.lustre.0 Request processed in 525us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201246.817219:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788201246.817425:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570064896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201246.818271:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788201246.818333:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788201246.818402:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788201246.818454:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788201246.819802:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788201246.820254:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788201246.820595:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788201246.820638:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788201246.820971:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1788201246.821160:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1788201246.821195:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1788201246.821240:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1788201246.821290:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201246.821459:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201246.821613:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624bfd48e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201246.821730:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570065024 00000100:00100000:3.0:1788201246.821747:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570065024 00000100:00100000:3.0:1788201246.821853:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788201246.821864:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:13886:x1875064570065024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201246.822225:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:13886:x1875064570065024:12345-0@lo:502:mount.lustre.0 Request processed in 363us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201246.822233:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788201246.822319:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201246.822437:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1788201246.822448:0:13886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788201246.824786:0:13889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201246.824801:0:13889:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788201246.824809:0:13889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201246.824811:0:13889:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788201246.824824:0:13889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201246.824962:0:13889:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff962487fc19c0) 00000020:00000080:1.0:1788201246.824990:0:13889:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788201246.825114:0:13889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788201246.825185:0:13889:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962381a3a800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788201246.825193:0:13889:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201246.825200:0:13889:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3cae3f 00010000:00010000:0.0:1788201246.832219:0:13889:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00080000:0.0:1788201246.834834:0:13889:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 8589934594 srv lr: 8589934592 lx: 1875064570058880 gen 0 00000001:00080000:0.0:1788201246.835149:0:13889:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: 986744c8-ee81-4a47-8d91-97f81ede1f3e idx: 1 lr: 8589934593 srv lr: 8589934592 lx: 1875064559528576 gen 0 00000001:00000004:0.0:1788201246.835172:0:13889:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1788201246.841117:0:13889:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1788201246.843536:0:13889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788201246.843547:0:13889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201246.843554:0:13889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201246.843556:0:13889:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788201246.843559:0:13889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201246.843562:0:13889:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788201246.843564:0:13889:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201246.843566:0:13889:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201246.843567:0:13889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201246.843569:0:13889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201246.843571:0:13889:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201246.843573:0:13889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201246.843577:0:13889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201246.843578:0:13889:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201246.843581:0:13889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201246.843583:0:13889:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788201246.843585:0:13889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201246.843587:0:13889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201246.843596:0:13889:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788201246.843600:0:13889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201246.843602:0:13889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201246.843603:0:13889:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788201246.843606:0:13889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788201246.846181:0:13889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201246.846202:0:13889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201246.846205:0:13889:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788201246.846218:0:13889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788201246.850715:0:13886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788201246.850769:0:13886:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788201246.850795:0:13886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.850808:0:13886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201246.850817:0:13886:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff962381a3a800 from 1 10000000:01000000:2.0:1788201246.850820:0:13886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201246.851139:0:13886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.851151:0:13886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.851162:0:13886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201246.851188:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065152:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201246.851254:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201246.851305:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624bfd48b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201246.851405:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570065152 00000100:00100000:1.0:1788201246.851414:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570065152 00000100:00100000:1.0:1788201246.851457:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788201246.851466:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:13886:x1875064570065152:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201246.851481:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201246.851493:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962498ac3400/0xa81c4c9a2f3cae5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cae54 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201246.851518:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962498ac3400/0xa81c4c9a2f3cae5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cae54 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201246.851537:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962498ac3400/0xa81c4c9a2f3cae5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cae54 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201246.851545:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac3400, rc 0) 00000100:00100000:1.0:1788201246.851587:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:13886:x1875064570065152:12345-0@lo:101:mount.lustre.0 Request processed in 123us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.851594:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788201246.851857:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201246.851873:0:13886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.851908:0:13886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201246.856847:0:13886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000040:00080000:2.0:1788201246.857460:0:13886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201246.858007:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788201246.858164:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788201246.858216:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788201246.858252:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788201246.858290:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788201246.858635:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788201246.858645:0:13886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 6 count 7 00000100:00100000:2.0:1788201246.858868:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201246.859317:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201246.859430:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624bfd48b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201246.859756:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570065280 00000100:00100000:0.0:1788201246.859764:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570065280 00000100:00100000:0.0:1788201246.859862:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788201246.859873:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:13886:x1875064570065280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201246.860203:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:13886:x1875064570065280:12345-0@lo:501:mount.lustre.0 Request processed in 332us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.860211:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788201246.860289:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201246.860327:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065408:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201246.860415:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201246.860664:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570065408 00000100:00100000:1.0:1788201246.860669:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570065408 00000100:00100000:1.0:1788201246.860691:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788201246.860699:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:13886:x1875064570065408:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201246.860943:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:13886:x1875064570065408:12345-0@lo:503:mount.lustre.0 Request processed in 245us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.860955:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788201246.861305:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624bfd48b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201246.861324:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065408:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788201246.862298:0:13886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201246.862463:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201246.862617:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201246.862773:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624bfd48b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201246.863460:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570065536 00000100:00100000:1.0:1788201246.863468:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570065536 00000100:00100000:1.0:1788201246.863610:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788201246.863619:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:13886:x1875064570065536:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201246.864424:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:13886:x1875064570065536:12345-0@lo:502:mount.lustre.0 Request processed in 802us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201246.864580:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c843100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201246.864717:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000040:00080000:3.0:1788201246.864858:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788201246.864914:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788201246.864958:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788201246.864980:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788201246.864999:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000100:00100000:3.0:1788201246.865038:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201246.865102:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201246.865139:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c7e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201246.865148:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570065664 00000100:00100000:2.0:1788201246.865153:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570065664 00000100:00100000:2.0:1788201246.865232:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788201246.865241:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:13886:x1875064570065664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201246.865426:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:13886:x1875064570065664:12345-0@lo:502:mount.lustre.0 Request processed in 187us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201246.865433:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788201246.865690:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201246.865906:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788201246.865917:0:13886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1788201246.866992:0:13893:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201246.867183:0:13893:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201246.867188:0:13893:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788201246.867198:0:13893:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff962381a3a800 00000020:00000080:0.0:1788201246.867201:0:13893:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201246.867209:0:13893:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201246.867212:0:13893:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201246.867213:0:13893:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788201246.867215:0:13893:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201246.867218:0:13893:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201246.867219:0:13893:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788201246.867222:0:13893:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff962381a3a800 00000020:00000080:0.0:1788201246.867224:0:13893:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201246.867304:0:13893:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201246.867308:0:13893:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201246.867311:0:13893:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788201246.867315:0:13893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000020:01000000:3.0:1788201246.867784:0:13886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788201246.867810:0:13886:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201246.867828:0:13886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.867842:0:13886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201246.867894:0:13886:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201246.867897:0:13886:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962381a3a800 10000000:01000000:3.0:1788201246.867901:0:13886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962381a3a800 10000000:01000000:3.0:1788201246.867906:0:13886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201246.867912:0:13886:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff962381a3a800 from 1 10000000:01000000:3.0:1788201246.867914:0:13886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201246.867963:0:13886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.867972:0:13886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.867983:0:13886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201246.868018:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201246.869274:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201246.869322:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c7e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201246.869419:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570065792 00000100:00100000:1.0:1788201246.869427:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570065792 00000100:00100000:1.0:1788201246.869472:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788201246.869481:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:13886:x1875064570065792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201246.869497:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201246.869514:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962498ac3e00/0xa81c4c9a2f3cae69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cae62 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201246.869549:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962498ac3e00/0xa81c4c9a2f3cae69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cae62 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201246.869559:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962498ac3e00/0xa81c4c9a2f3cae69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cae62 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201246.869568:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac3e00, rc 0) 00000100:00100000:1.0:1788201246.869613:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:13886:x1875064570065792:12345-0@lo:101:mount.lustre.0 Request processed in 133us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.869620:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788201246.869986:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201246.871131:0:13886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.871150:0:13886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201246.886246:0:13886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:1.0:1788201246.887194:0:13886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201246.887607:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788201246.887651:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788201246.887778:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788201246.887826:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788201246.887861:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788201246.887993:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788201246.888154:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788201246.888188:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788201246.888233:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788201246.888268:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788201246.888300:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788201246.888419:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788201246.888460:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788201246.888794:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788201246.888848:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788201246.888959:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788201246.889115:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788201246.889176:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788201246.889212:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788201246.889246:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788201246.889294:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788201246.889420:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788201246.889459:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788201246.889509:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788201246.889612:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:1.0:1788201246.889647:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:1.0:1788201246.889785:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:1.0:1788201246.889823:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:1.0:1788201246.889857:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:1.0:1788201246.889975:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:1.0:1788201246.890140:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:1.0:1788201246.890179:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:1.0:1788201246.890226:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:1.0:1788201246.890275:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:1.0:1788201246.890312:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:1.0:1788201246.890431:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:1.0:1788201246.890470:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:1.0:1788201246.890587:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:1.0:1788201246.890643:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:1.0:1788201246.890770:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:1.0:1788201246.890942:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:1.0:1788201246.890952:0:13886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:1.0:1788201246.891183:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201246.891259:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201246.891374:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9df6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201246.891444:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570065920 00000100:00100000:2.0:1788201246.891451:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570065920 00000100:00100000:2.0:1788201246.891537:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788201246.891548:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:13886:x1875064570065920:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201246.891951:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:13886:x1875064570065920:12345-0@lo:501:mount.lustre.0 Request processed in 404us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201246.891959:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788201246.892050:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570065920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201246.892089:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570066048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201246.892128:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201246.892958:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c7e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201246.893114:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570066048 00000100:00100000:1.0:1788201246.893122:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570066048 00000100:00100000:1.0:1788201246.893160:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788201246.893167:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:13886:x1875064570066048:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201246.893491:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:13886:x1875064570066048:12345-0@lo:503:mount.lustre.0 Request processed in 324us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.893499:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788201246.893751:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570066048:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201246.900747:0:13886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201246.900911:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570066176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201246.901138:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201246.901200:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c7e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201246.901219:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570066176 00000100:00100000:1.0:1788201246.901226:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570066176 00000100:00100000:1.0:1788201246.901278:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788201246.901286:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:13886:x1875064570066176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201246.901616:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:13886:x1875064570066176:12345-0@lo:502:mount.lustre.0 Request processed in 329us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.901624:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788201246.901790:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570066176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201246.902235:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788201246.902288:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788201246.902322:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788201246.902402:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788201246.902428:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788201246.902454:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788201246.902472:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788201246.902488:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788201246.902542:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788201246.902601:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788201246.902634:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788201246.902665:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788201246.902683:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788201246.902699:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788201246.902723:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788201246.902759:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788201246.902793:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788201246.902840:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788201246.903102:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788201246.903145:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788201246.903195:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788201246.903230:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788201246.903269:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788201246.903318:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788201246.903440:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1788201246.903490:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1788201246.903610:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1788201246.903649:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1788201246.903685:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1788201246.903733:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1788201246.903785:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1788201246.903818:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1788201246.903844:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1788201246.903948:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1788201246.903972:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1788201246.903997:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1788201246.904094:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1788201246.904128:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1788201246.904157:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1788201246.904176:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1788201246.904215:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570066304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201246.904279:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201246.904327:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c7e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201246.904336:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570066304 00000100:00100000:0.0:1788201246.904374:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570066304 00000100:00100000:0.0:1788201246.904419:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788201246.904428:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:13886:x1875064570066304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201246.904856:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:13886:x1875064570066304:12345-0@lo:502:mount.lustre.0 Request processed in 427us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.904864:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788201246.904946:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570066304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201246.905013:0:13886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:3.0:1788201246.905085:0:13886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788201246.906480:0:13896:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788201246.906503:0:13896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96248729cd40) 00000020:00000080:0.0:1788201246.906622:0:13896:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788201246.906805:0:13896:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962381a3a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788201246.906810:0:13896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962381a3a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788201246.906812:0:13896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962381a3a800 3 00010000:00080000:0.0:1788201246.906917:0:13896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9624c1cec000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.156@tcp at head 00010000:00010000:0.0:1788201246.909462:0:13896:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1788201246.909771:0:13896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788201246.909808:0:13896:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788201246.909819:0:13896:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa81c4c9a2f3cae77 00000100:00080000:0.0:1788201246.909832:0:13896:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201246.909838:0:13896:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9624c1cec000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788201246.909952:0:13896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96248c9c5c00 x1875064570066432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201246.909979:0:13896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788201246.910262:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1788201246.910271:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570066432:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788201246.910272:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201246.910275:0:37:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201246.910279:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 376 00000100:00080000:1.0:1788201246.910283:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201246.910287:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201246.910313:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9623812a7480 x1875064570066688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201246.910376:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201246.910381:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570066560:0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.910386:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570066944:0@lo:400:kworker.0 00000100:00100000:2.0:1788201246.910432:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201246.910827:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570066816:0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.910943:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570066432 00000100:00100000:1.0:1788201246.910950:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570066432 00000100:00100000:1.0:1788201246.910988:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201246.911124:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875064570066432:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788201246.911154:0:5825:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 378 last 0 00000020:00000080:1.0:1788201246.911189:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa81c4c9a2f3cae7e 00000004:00100000:1.0:1788201246.911205:0:5825:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201246.911237:0:5825:0:(import.c:65:import_set_state_nolock()) ffff962485918800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201246.911292:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875064570066432:12345-0@lo:38:llog_process_th.0 Request processed in 296us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.911299:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000040:00080000:1.0:1788201246.911485:0:13896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000100:00100000:2.0:1788201246.913081:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1788201246.913087:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201246.913095:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788201246.913102:0:3281:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788201246.913107:0:3281:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788201246.913110:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9624c1cec000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788201246.913118:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570066432:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201246.913133:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570066816 00000100:00100000:1.0:1788201246.913138:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570066816 00000100:00100000:2.0:1788201246.913140:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570066688:0@lo:8:kworker.0 00000100:00100000:2.0:1788201246.913185:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201246.913186:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788201246.913195:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570066816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201246.913216:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570066688 00000100:00100000:2.0:1788201246.913219:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570066688 00000100:00100000:2.0:1788201246.913239:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201246.913244:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875064570066688:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788201246.913253:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570066816:12345-0@lo:400:kworker.0 Request processed in 60us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.913259:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1788201246.913277:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201246.913291:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875064570066688:12345-0@lo:8:kworker.0 Request processed in 46us (105us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201246.913297:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201246.913299:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570066816:0@lo:400:kworker.0 00000100:00080000:2.0:1788201246.913321:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201246.913325:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201246.913329:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570066688:0@lo:8:kworker.0 00000020:01000000:2.0:1788201246.913367:0:13886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788201246.913400:0:13886:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201246.913416:0:13886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.913427:0:13886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788201246.913477:0:13886:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788201246.913479:0:13886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201246.913480:0:13886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201246.913481:0:13886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201246.913481:0:13886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201246.913483:0:13886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201246.913484:0:13886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201246.913485:0:13886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201246.913486:0:13886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201246.913490:0:13886:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788201246.913491:0:13886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201246.913492:0:13886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201246.913493:0:13886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201246.913493:0:13886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201246.913494:0:13886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201246.913495:0:13886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201246.913495:0:13886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201246.913496:0:13886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201246.913497:0:13886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201246.913530:0:13886:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788201246.913545:0:13886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570067072:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201246.913582:0:13886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201246.913605:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570067072 00000100:00100000:2.0:1788201246.913609:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570067072 00000100:00100000:2.0:1788201246.913636:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788201246.913643:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:13886:x1875064570067072:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201246.913675:0:5818:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788201246.913687:0:5818:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788201246.914147:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.914218:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570066944 00000100:00100000:0.0:1788201246.914224:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570066944 00000100:00100000:0.0:1788201246.914265:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201246.914273:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570066944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201246.914318:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570066944:12345-0@lo:400:kworker.0 Request processed in 46us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.914324:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788201246.914385:0:13886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624bfd48d80 going to sleep for 11 seconds 00000100:00080000:1.0:1788201246.914625:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201246.914653:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9623812a4000 x1875064570066944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201246.914666:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570066944:0@lo:400:kworker.0 00000100:00100000:3.0:1788201246.914987:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201246.915186:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570066560 00000100:00100000:1.0:1788201246.915191:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570066560 00000100:00100000:1.0:1788201246.915221:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788201246.915229:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570066560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.915276:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570066560:12345-0@lo:400:kworker.0 Request processed in 48us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.915282:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788201246.915313:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570066560:0@lo:400:kworker.0 20000000:01000000:2.0:1788201246.934307:0:5818:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201246.934325:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788201246.934383:0:5841:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201246.934388:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201246.934410:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.934433:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3cad19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9991a expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.934442:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3cad27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cad20 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.934450:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.934489:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3cad27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3cad20 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.934808:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3cad27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cad20 expref: 19 pid: 5820 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201246.934845:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570067200:0@lo:104: 00000100:00100000:2.0:1788201246.934981:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201246.935041:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3cad19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd9991a expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.935052:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3cad19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd9991a expref: 9 pid: 5820 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201246.935062:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570067328:192.168.201.56@tcp:104: 00000100:00100000:0.0:1788201246.935171:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570067200 00000100:00100000:0.0:1788201246.935181:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570067200 00000100:00100000:0.0:1788201246.935234:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201246.935244:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570067200:12345-0@lo:104: 00010000:00010000:0.0:1788201246.935257:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cad27 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.935306:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201246.935312:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570067200:12345-0@lo:104: Request processed in 71us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.935328:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788201246.935370:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201246.935376:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cad27 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.935385:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5a00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:0.0:1788201246.935389:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3cad27 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.935398:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3cad27 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201246.935405:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3cad27 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201246.935411:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201246.935439:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cad27 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.935446:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201246.935466:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cad27 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.935473:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cad20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cad27 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.935489:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201246.935491:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201246.935493:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201246.935543:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570067456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201246.935579:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201246.935617:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570067456 00000100:00100000:0.0:1788201246.935622:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570067456 00010000:00010000:0.0:1788201246.935640:0:11284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3cad27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cad20 expref: 20 pid: 5820 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201246.935664:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201246.935671:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+20:3285:x1875064570067456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201246.935680:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201246.935685:0:11284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3cad27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cad20 expref: 20 pid: 5820 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.935694:0:11284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3cad27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cad20 expref: 20 pid: 5820 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201246.935710:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201246.935747:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+20:3285:x1875064570067456:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201246.935754:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201246.935788:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570067456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201246.936039:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624bfd48cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1788201246.936057:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962480031a00/0xa81c4c9a2f3cad27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3cad20 expref: 19 pid: 5820 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201246.936067:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570067200:0@lo:104: 00000100:00100000:0.0:1788201246.946293:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201246.946574:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559533440 00000100:00100000:3.0:1788201246.946584:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559533440 00010000:00010000:3.0:1788201246.946622:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3cad19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd9991a expref: 10 pid: 5820 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201246.946656:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00100000:3.0:1788201246.946667:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559533440:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201246.946681:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201246.946688:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3cad19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd9991a expref: 10 pid: 5820 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.946700:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3cad19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd9991a expref: 10 pid: 5820 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.946732:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.946750:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201246.946765:0:5811:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012377394s 00010000:00010000:3.0:1788201246.946770:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.946776:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.946780:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.946785:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.946788:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c4e00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:3.0:1788201246.946792:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.946797:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.946802:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201246.946810:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201246.946858:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559533440:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 193us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201246.946871:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00100000:3.0:1788201246.947678:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:13886:x1875064570067072:12345-0@lo:253:mount.lustre.0 Request processed in 34032us (34092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201246.947688:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788201246.947802:0:13886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:13886:1875064570067072:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788201246.947812:0:13886:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788201246.947815:0:13886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201246.947816:0:13886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201246.947817:0:13886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201246.947818:0:13886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201246.947819:0:13886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201246.947820:0:13886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201246.947826:0:13886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201246.947827:0:13886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201246.947828:0:13886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788201246.947843:0:13886:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788201246.949715:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962480031c00/0xa81c4c9a2f3cad19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd9991a expref: 9 pid: 5820 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201246.949746:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570067328:192.168.201.56@tcp:104: 00010000:00010000:2.0:1788201246.949771:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.949781:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.949787:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201246.949809:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624829c4e00/0xa81c4c9a2f3cae85 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788201246.954135:0:13886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201246.954300:0:13886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201246.954710:0:13886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201246.954852:0:13886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201246.955055:0:13886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201246.955254:0:13886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00080000:1.0:1788201246.956074:0:13886:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-OST0000, 2 recoverable clients, last_transno 8589934594 00010000:00080000:1.0:1788201246.957308:0:13901:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-OST0000: started recovery thread pid 13901 00010000:00080000:1.0:1788201246.957474:0:13901:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788201246.957479:0:13901:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1788201246.957723:0:13886:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788201246.957799:0:13886:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788201246.957815:0:13886:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788201246.957842:0:13886:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000100:00100000:3.0:1788201247.298228:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201247.298253:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570067584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201247.298323:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201247.298649:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570067584 00000100:00100000:0.0:1788201247.298658:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570067584 00000100:00100000:0.0:1788201247.298721:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788201247.298742:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570067584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201247.298782:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201247.298839:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570067584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201247.298849:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1788201247.301190:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248c9c6680 x1875064570067584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201247.301220:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570067584:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201247.479550:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201247.542214:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201247.542319:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559533696 00000100:00100000:1.0:1788201247.542330:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559533696 00000100:00100000:1.0:1788201247.542516:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 166 00000100:00100000:1.0:1788201247.542535:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559533696:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201247.542623:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559533696:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 91us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201247.542631:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 166 00000100:00080000:2.0:1788201247.543290:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201247.543957:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201247.544077:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201247.544250:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559533824 00000100:00100000:2.0:1788201247.544258:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559533824 00000100:00100000:2.0:1788201247.544300:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:2.0:1788201247.544308:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559533824:12345-192.168.201.56@tcp:8:kworker.0 00010000:00080000:2.0:1788201247.544372:0:6668:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '986744c8-ee81-4a47-8d91-97f81ede1f3e' at ffff9624bc8f5800, cookie 0xa81c4c9a2f3cae4d 00010000:00080000:2.0:1788201247.544379:0:6668:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp recovering/t0 exp ffff9624bc8f5800 cur 379 last 1788201246 00010000:02000400:2.0:1788201247.544389:0:6668:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:0.0:1788201247.547134:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559533568 00000100:00100000:0.0:1788201247.547148:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559533568 00000100:00100000:0.0:1788201247.547257:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 329 00000100:00100000:0.0:1788201247.547268:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:2342:x1875064559533568:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201247.547364:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:2342:x1875064559533568:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 98us (3411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201247.547371:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 329 00010000:00080000:2.0:1788201247.549997:0:6668:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:1.0:1788201247.550225:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff9624bc8f5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 1703936 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201247.550241:0:6668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00000100:00080000:1.0:1788201247.551218:0:6668:0:(import.c:65:import_set_state_nolock()) ffff9624a8a8b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201247.551358:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559533824:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 7031us (7262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201247.551369:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:3.0:1788201247.556693:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201247.556785:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559533952 00000100:00100000:1.0:1788201247.556794:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559533952 00000100:00100000:1.0:1788201247.556849:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 48 00000100:00100000:1.0:1788201247.556860:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559533952:12345-192.168.201.56@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1788201247.556875:0:8088:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff962492c24e00 x1875064559533952/t0(0) o101->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:368/0 lens 328/0 e 0 to 0 dl 1788201258 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201247.556889:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559533952:12345-192.168.201.56@tcp:101:ldlm_lock_repla.0 Request processed in 35us (205us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201247.556903:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 48 00010000:00080000:1.0:1788201247.556915:0:13901:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1788201248.502599:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788201248.504207:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201248.504215:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9624902af800 from 7 10000000:01000000:1.0:1788201248.504220:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201248.504276:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.504287:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.504297:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201248.504320:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570067712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201248.504442:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201248.504504:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570067712 00000100:00100000:3.0:1788201248.504513:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570067712 00000100:00100000:2.0:1788201248.504670:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487145d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201248.504692:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788201248.504703:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570067712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201248.504730:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201248.504744:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cae93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cae8c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.504768:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cae93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cae8c expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.504797:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cae93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cae8c expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.504806:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7d000, rc 0) 00000100:00100000:3.0:1788201248.504859:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570067712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201248.504867:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788201248.504948:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570067712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201248.504965:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.504974:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cae93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201248.505376:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570067840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201248.505404:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201248.505428:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485698300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201248.505451:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570067840 00000100:00100000:0.0:1788201248.505457:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570067840 00000100:00100000:0.0:1788201248.505590:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788201248.505599:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570067840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201248.505614:0:5820:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201248.505631:0:5820:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201248.505634:0:5820:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788201248.505886:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570067840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 285us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201248.505899:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788201248.505919:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570067840:0@lo:256:ll_cfg_requeue.0 00000100:00080000:2.0:1788201248.505963:0:5822:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff96249852b000 already not connected (conn 12, was 0): DISCONN 00010000:00080000:2.0:1788201248.505980:0:5822:0:(ldlm_lib.c:85:import_set_conn()) imp ffff96249852b000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.201.156@tcp, moved to head 00000100:00080000:2.0:1788201248.505986:0:5822:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201248.505992:0:5822:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:2.0:1788201248.506063:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624bfd2df80 x1875064570067968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:2.0:1788201248.506112:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201248.506121:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.506130:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201248.506139:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570067968:0@lo:8:ll_cfg_requeue.0 00000100:00100000:0.0:1788201248.506169:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201248.506247:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570067968 00000100:00100000:3.0:1788201248.506251:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570067968 00000100:00100000:3.0:1788201248.506297:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201248.506301:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875064570067968:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1788201248.506318:0:6671:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff9624bc8f7000, cookie 0xa81c4c9a2f3cae46 00010000:00080000:3.0:1788201248.506322:0:6671:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff9624bc8f7000 cur 380 last 1788201246 00002000:00100000:3.0:1788201248.506334:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9624bc8f7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788201248.506337:0:6671:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788201248.506366:0:6671:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1788201248.506451:0:6671:0:(import.c:65:import_set_state_nolock()) ffff962487d48000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1788201248.506492:0:13901:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1788201248.506498:0:13901:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 8589934595 00010000:00080000:2.0:1788201248.506502:0:13901:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 8589934595 00010000:00080000:2.0:1788201248.506505:0:13901:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 8589934595 00000100:00100000:3.0:1788201248.506505:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570067968:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 202us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201248.506512:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788201248.506617:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd2df80 x1875064570067968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201248.506626:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788201248.506633:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1788201248.506636:0:3281:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788201248.506637:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00080000:0.0:1788201248.506640:0:3281:0:(recover.c:53:ptlrpc_replay_next()) import ffff96249852b000 from lustre-OST0000_UUID committed 8589934594 last 0 00000100:00080000:0.0:1788201248.506643:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1788201248.507451:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570067968:0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1788201248.507502:0:13969:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1788201248.507505:0:13969:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:0.0:1788201248.507510:0:13969:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:0.0:1788201248.507552:0:13969:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1788201248.507611:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570068096:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788201248.507666:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201248.507766:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570068096 00000100:00100000:1.0:1788201248.507773:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570068096 00000100:00100000:1.0:1788201248.507811:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788201248.507820:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570068096:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788201248.507836:0:6668:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff9624bfd2df80 x1875064570068096/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:369/0 lens 224/0 e 0 to 0 dl 1788201259 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201248.507895:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570068096:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 77us (228us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201248.507902:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1788201248.508933:0:13901:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589934595 00010000:00080000:0.0:1788201248.508941:0:13901:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00010000:00080000:0.0:1788201248.508949:0:13901:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201248.508953:0:13901:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201248.508965:0:13901:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.201.56@tcp: req@ffff962492c24e00 x1875064559533952/t0(0) o101->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:368/0 lens 328/0 e 0 to 0 dl 1788201258 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201248.508987:0:13901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201248.509033:0:13901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7e6b5f0/0xa81c4c9a2f3cae9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99960 expref: -99 pid: 13901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201248.509087:0:13901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e6b5f0/0xa81c4c9a2f3cae9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 6 pid: 13901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201248.509108:0:13901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7e6b5f0/0xa81c4c9a2f3cae9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 6 pid: 13901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201248.509119:0:13901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4df200, rc 0) 00010000:00080000:0.0:1788201248.509192:0:13901:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00080000:0.0:1788201248.509216:0:13901:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1788201248.515588:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201248.515636:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559534080 00000100:00100000:2.0:1788201248.515718:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559534080 00000100:00100000:2.0:1788201248.515780:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 87 00000100:00100000:2.0:1788201248.515792:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559534080:12345-192.168.201.56@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1788201248.515814:0:8088:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff9623812a6680 x1875064559534080/t0(0) o400->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:369/0 lens 224/0 e 0 to 0 dl 1788201259 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201248.515852:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559534080:12345-192.168.201.56@tcp:400:ptlrpcd_rcv.0 Request processed in 62us (286us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201248.515860:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 87 00010000:00080000:0.0:1788201248.515914:0:13901:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788201248.516101:0:13901:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00100000:1.0:1788201248.637622:0:13974:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000001:00100000:1.0:1788201248.637642:0:13974:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1788201248.649606:0:13901:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:0.0:1788201248.649629:0:13901:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9624bfd2df80 x1875064570068096/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:369/0 lens 224/0 e 0 to 0 dl 1788201259 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788201248.649767:0:13901:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.201.56@tcp: req@ffff9623812a6680 x1875064559534080/t0(0) o400->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:369/0 lens 224/0 e 0 to 0 dl 1788201259 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201248.649824:0:13901:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788201248.655438:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788201248.655456:0:3281:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff96248c9c4000 x1875064570068096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201264 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201248.655468:0:3281:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff96248c9c4000 x1875064570068096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201264 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201248.655490:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1788201248.655502:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1788201248.655505:0:3281:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00002000:00080000:0.0:1788201248.667148:0:13901:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788201248.667160:0:13901:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00100000:1.0:1788201248.673587:0:6846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064570068352:0@lo:7:osp-pre-0-0.0 00000100:00100000:1.0:1788201248.673671:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201248.673741:0:6846:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624880a2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201248.673760:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201248.673774:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570068224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201248.673801:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201248.673833:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570068352 00000100:00100000:1.0:1788201248.673840:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570068352 00000100:00100000:1.0:1788201248.673891:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201248.673902:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6846:x1875064570068352:12345-0@lo:7:osp-pre-0-0.0 00000100:00100000:0.0:1788201248.674586:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570068224 00000100:00100000:0.0:1788201248.674593:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570068224 00000100:00100000:0.0:1788201248.674627:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788201248.674635:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875064570068224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201248.674649:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201248.674721:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875064570068224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201248.674736:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788201248.674789:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570068224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201248.695587:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570068096:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788201248.696411:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201248.696451:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201248.696483:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559531520 00000100:00100000:3.0:1788201248.697147:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559531648 00000100:00100000:3.0:1788201248.697157:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559531648 00000100:00100000:2.0:1788201248.697262:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559531520 00002000:00100000:2.0:1788201248.697304:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->28) req@ffff9624bfd2d880 x1875064559531520/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:369/0 lens 520/0 e 0 to 0 dl 1788201259 ref 1 fl New:/602/ffffffff rc 0/-1 job:'date.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201248.697315:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2d880 with x1875064559531520 ext(0->28) 00002000:00010000:2.0:1788201248.697328:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2d880 00000100:00100000:3.0:1788201248.697811:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:3.0:1788201248.697824:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2344:x1875064559531648:12345-192.168.201.56@tcp:16:kworker.0 00000100:00100000:2.0:1788201248.699093:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:2.0:1788201248.699108:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2344:x1875064559531520:12345-192.168.201.56@tcp:4:date.0 00002000:00080000:1.0:1788201248.700390:0:6670:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788201248.700400:0:6670:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x240000400:0x21:0x0] 00000100:00100000:1.0:1788201248.700487:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6846:x1875064570068352:12345-0@lo:7:osp-pre-0-0.0 Request processed in 26585us (26813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201248.700498:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201248.700551:0:6846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064570068352:0@lo:7:osp-pre-0-0.0 00000004:00080000:1.0:1788201248.700566:0:6846:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x240000400:0x21:0x0] 00000100:00100000:1.0:1788201248.709693:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2344:x1875064559531648:12345-192.168.201.56@tcp:16:kworker.0 Request processed in 11856us (13269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201248.709721:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:2.0:1788201248.719781:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559531520:12345-192.168.201.56@tcp:4:date.0 Request processed in 20665us (23316us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788201248.719795:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 2 00002000:00100000:2.0:1788201248.719812:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->28) req@ffff9624bfd2d880 x1875064559531520/t12884901889(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:369/0 lens 520/448 e 0 to 0 dl 1788201259 ref 1 fl Complete:/602/0 rc 0/0 job:'date.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201248.719822:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2d880 with x1875064559531520 ext(0->28) 00002000:00010000:2.0:1788201248.719836:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2d880 00000100:00100000:3.0:1788201248.882001:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201248.882040:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559534464 00000100:00100000:3.0:1788201248.882049:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559534464 00000100:00100000:3.0:1788201248.882102:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 332 00000100:00100000:3.0:1788201248.882113:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:10055:x1875064559534464:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201248.882131:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201248.882149:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3caea1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd99967 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.882178:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3caea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99967 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.882199:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3caea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99967 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.882208:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7de00, rc 0) 00000100:00100000:3.0:1788201248.882255:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559534464:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 145us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201248.882275:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 332 00000100:00100000:1.0:1788201248.890921:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201248.891027:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559534592 00000100:00100000:2.0:1788201248.891038:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559534592 00000100:00100000:2.0:1788201248.891104:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 333 00000100:00100000:2.0:1788201248.891114:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559534592:12345-192.168.201.56@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201248.891149:0:5820:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788201248.891164:0:5820:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201248.891167:0:5820:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788201248.897192:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559534592:12345-192.168.201.56@tcp:256:ll_cfg_requeue.0 Request processed in 6067us (6267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201248.897208:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 333 00010000:00010000:0.0:1788201249.528013:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201250.550754:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201251.574714:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201252.406812:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201252.406836:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570068480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201252.406903:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201252.407021:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570068480 00000100:00100000:2.0:1788201252.407031:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570068480 00000100:00100000:2.0:1788201252.407099:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201252.407109:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570068480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201252.407146:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201252.407192:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570068480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201252.407198:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788201252.407255:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788201252.407281:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c27b80 x1875064570068480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201252.407299:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570068480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201252.410599:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570068608:0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.410875:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201252.410919:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570069120:0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.410952:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201252.410983:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201252.410989:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570068992:0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.411012:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201252.411040:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570068736:0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.411063:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201252.411082:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201252.411088:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570068864:0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.411113:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201252.411143:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570068608 00000100:00100000:3.0:1788201252.411159:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570068608 00000100:00100000:3.0:1788201252.411200:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788201252.411207:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570068608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.411255:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570068608:12345-0@lo:400:kworker.0 Request processed in 48us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.411262:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788201252.411295:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570069120 00000100:00100000:3.0:1788201252.411298:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570069120 00000100:00100000:3.0:1788201252.411328:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570068992 00000100:00100000:3.0:1788201252.411330:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570068992 00000100:00100000:3.0:1788201252.411367:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570068736 00000100:00100000:3.0:1788201252.411370:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570068736 00000100:00100000:3.0:1788201252.411384:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788201252.411389:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570069120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.411418:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570069120:12345-0@lo:400:kworker.0 Request processed in 30us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.411438:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788201252.411450:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788201252.411455:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570068992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.411480:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570068992:12345-0@lo:400:kworker.0 Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.411485:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788201252.411496:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788201252.411501:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570068736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.411530:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570068736:12345-0@lo:400:kworker.0 Request processed in 29us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.411536:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788201252.411569:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570068864 00000100:00100000:3.0:1788201252.411573:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570068864 00000100:00100000:3.0:1788201252.411601:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788201252.411869:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570068864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.411901:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570068864:12345-0@lo:400:kworker.0 Request processed in 296us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.411907:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788201252.411946:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570068992:0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.411957:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570068608:0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.411967:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570069120:0@lo:400:kworker.0 00000100:00080000:3.0:1788201252.411993:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201252.411998:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201252.412016:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570068864:0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.412025:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570068736:0@lo:400:kworker.0 00010000:00010000:1.0:1788201252.599391:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201252.668712:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201252.668813:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201252.668846:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201252.668877:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559534848 00000100:00100000:3.0:1788201252.668888:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559534848 00000100:00100000:3.0:1788201252.670073:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 170 00000100:00100000:3.0:1788201252.670093:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559534848:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201252.670186:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559534848:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 101us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.670194:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 170 00000100:00080000:3.0:1788201252.670232:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201252.670787:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559534976 00000100:00100000:0.0:1788201252.670797:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559534976 00000100:00100000:0.0:1788201252.670868:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 89 00000100:00100000:0.0:1788201252.670877:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559534976:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201252.670924:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559534976:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 49us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.670931:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 89 00000100:00080000:3.0:1788201252.672054:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201252.673734:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559534720 00000100:00100000:1.0:1788201252.673748:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559534720 00000100:00100000:1.0:1788201252.673802:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 335 00000100:00100000:1.0:1788201252.673825:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559534720:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201252.673913:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559534720:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 90us (5211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201252.673919:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 335 00010000:00010000:0.0:1788201253.622905:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201253.802208:0:14243:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788201253.944007:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201253.944035:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570069248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201253.944113:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201253.945542:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570069248 00000100:00100000:2.0:1788201253.945555:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570069248 00000100:00100000:2.0:1788201253.945628:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788201253.945641:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570069248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201253.945683:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201253.945762:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570069248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201253.945770:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788201253.945829:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570069248:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788201254.048502:0:13974:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00010000:00010000:1.0:1788201254.646514:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201255.670811:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201256.695977:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201257.526878:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570069760:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.526965:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.527031:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201257.527038:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570069376:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.527067:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.527089:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570069888:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.527114:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.527139:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570069504:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.527162:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.527178:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570070016:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.527197:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.527212:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201257.527217:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570069632:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.527234:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.527267:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570069760 00000100:00100000:3.0:1788201257.527275:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570069760 00000100:00100000:3.0:1788201257.527336:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570069504 00000100:00100000:3.0:1788201257.527365:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570069504 00000100:00080000:2.0:1788201257.528082:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201257.528099:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570069888 00000100:00100000:2.0:1788201257.528104:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570069888 00000100:00100000:2.0:1788201257.528144:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570069632 00000100:00100000:2.0:1788201257.528148:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570069632 00000100:00100000:2.0:1788201257.528177:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788201257.528205:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570069888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.528233:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570070144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201257.528283:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201257.528283:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570069888:12345-0@lo:400:kworker.0 Request processed in 80us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201257.528294:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788201257.528315:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788201257.528325:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570069632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.528336:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570070144 00000100:00100000:1.0:1788201257.528357:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570070144 00000100:00100000:1.0:1788201257.528393:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788201257.528401:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570070144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201257.528430:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201257.528468:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570070144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201257.528474:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1788201257.528538:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9623812a5880 x1875064570070144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201257.528766:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570069632:12345-0@lo:400:kworker.0 Request processed in 60us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201257.528773:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1788201257.528795:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201257.528798:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201257.528817:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570070016 00000100:00100000:2.0:1788201257.528821:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570070016 00000100:00100000:3.0:1788201257.528972:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788201257.528984:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570069760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.529026:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570069760:12345-0@lo:400:kworker.0 Request processed in 46us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.529033:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788201257.529083:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788201257.529090:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570069504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201257.529125:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570069504:12345-0@lo:400:kworker.0 Request processed in 35us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201257.529131:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788201257.529144:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788201257.529150:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570070016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201257.529176:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570070016:12345-0@lo:400:kworker.0 Request processed in 27us (1979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201257.529182:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:2.0:1788201257.529209:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201257.537774:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570069376 00000100:00100000:0.0:1788201257.537791:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570069376 00000100:00100000:0.0:1788201257.537861:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788201257.537872:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570069376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201257.537973:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570069376:12345-0@lo:400:kworker.0 Request processed in 102us (10904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201257.537980:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788201257.538131:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570069632:0@lo:400:kworker.0 00000100:00100000:0.0:1788201257.538146:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570069504:0@lo:400:kworker.0 00000100:00100000:0.0:1788201257.538163:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570070016:0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.546673:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570070144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201257.555878:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570069376:0@lo:400:kworker.0 00010000:00080000:2.0:1788201257.555917:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c87c380 x1875064570069888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201257.555949:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570069888:0@lo:400:kworker.0 00000100:00100000:2.0:1788201257.555965:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570069760:0@lo:400:kworker.0 00010000:00010000:1.0:1788201257.718860:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201257.778249:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201257.779481:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201257.779524:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201257.779701:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559535232 00000100:00100000:0.0:1788201257.779711:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559535232 00000100:00100000:0.0:1788201257.779781:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 174 00000100:00100000:0.0:1788201257.779790:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559535232:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201257.779858:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559535232:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 69us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201257.779866:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 174 00000100:00080000:3.0:1788201257.780234:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201257.781518:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559535104 00000100:00100000:1.0:1788201257.781533:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559535104 00000100:00100000:1.0:1788201257.781621:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 337 00000100:00100000:1.0:1788201257.781630:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559535104:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201257.781712:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559535104:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 83us (3475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201257.781720:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 337 00000100:00100000:2.0:1788201257.782879:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559535360 00000100:00100000:2.0:1788201257.782890:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559535360 00000100:00100000:2.0:1788201257.782961:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 92 00000100:00100000:2.0:1788201257.782971:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559535360:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201257.783026:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559535360:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 56us (3550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201257.783034:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 92 00000100:00080000:0.0:1788201257.783153:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201258.324080:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201258.324169:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559535488 00000100:00100000:3.0:1788201258.324178:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559535488 00000100:00100000:3.0:1788201258.324238:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:3.0:1788201258.324247:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:12303:x1875064559535488:12345-192.168.201.56@tcp:41:lfs.0 00000004:00000024:3.0:1788201258.324289:0:5826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788201258.324400:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:12303:x1875064559535488:12345-192.168.201.56@tcp:41:lfs.0 Request processed in 153us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201258.324408:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:3.0:1788201258.328262:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201258.328373:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559535616 00000100:00100000:1.0:1788201258.328383:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559535616 00000100:00100000:1.0:1788201258.328448:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 92 00000100:00100000:1.0:1788201258.328458:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:12303:x1875064559535616:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:1.0:1788201258.328499:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 41353216 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201258.328599:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:12303:x1875064559535616:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 141us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201258.328607:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 92 00000100:00100000:1.0:1788201258.334051:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201258.334218:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559535744 00000100:00100000:0.0:1788201258.334229:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559535744 00000100:00100000:0.0:1788201258.334286:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 52 00000100:00100000:0.0:1788201258.334296:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875064559535744:12345-192.168.201.56@tcp:8:lfs.0 00010000:00080000:0.0:1788201258.334369:0:6671:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:0.0:1788201258.334404:0:6671:0:(genops.c:1406:class_connect()) connect: client 986744c8-ee81-4a47-8d91-97f81ede1f3e, cookie 0xa81c4c9a2f3caea8 00002000:00100000:0.0:1788201258.334419:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff9624c1ceb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201258.334432:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:0.0:1788201258.334688:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788201258.334719:0:6671:0:(import.c:65:import_set_state_nolock()) ffff9624c1ce9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201258.334797:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559535744:12345-192.168.201.56@tcp:8:lfs.0 Request processed in 500us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201258.334805:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 52 00000100:00100000:0.0:1788201258.339156:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201258.339475:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559535872 00000100:00100000:2.0:1788201258.339484:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559535872 00000100:00100000:2.0:1788201258.339555:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 93 00000100:00100000:2.0:1788201258.339566:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:12303:x1875064559535872:12345-192.168.201.56@tcp:13:lfs.0 00000100:00080000:0.0:1788201258.339592:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788201258.339595:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201258.339796:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:12303:x1875064559535872:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 231us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201258.339804:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 93 00010000:00010000:1.0:1788201258.743386:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201259.062599:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201259.062621:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570070272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201259.062684:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201259.064186:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570070272 00000100:00100000:3.0:1788201259.064198:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570070272 00000100:00080000:1.0:1788201259.064246:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201259.064253:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788201259.064262:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570070272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201259.064289:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 41353216 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201259.064398:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570070272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201259.064405:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788201259.064451:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570070272:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201259.766729:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201260.660121:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00010000:00010000:1.0:1788201260.790574:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201261.814671:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201262.650990:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570070400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201262.651084:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201262.651364:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570070400 00000100:00100000:0.0:1788201262.651373:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570070400 00000100:00100000:0.0:1788201262.651437:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788201262.651448:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570070400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201262.651561:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201262.651614:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570070400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201262.651621:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788201262.651907:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570070656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201262.651958:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201262.652020:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201262.652036:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570070528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201262.652064:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201262.652087:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570071040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201262.652109:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201262.652371:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570070784:0@lo:400:kworker.0 00000100:00100000:3.0:1788201262.652401:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201262.652422:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201262.652426:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570070912:0@lo:400:kworker.0 00000100:00100000:3.0:1788201262.652445:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201262.652488:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570070656 00000100:00100000:3.0:1788201262.652493:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570070656 00000100:00100000:3.0:1788201262.652533:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570071040 00000100:00100000:3.0:1788201262.652536:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570071040 00000100:00100000:3.0:1788201262.652559:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570070912 00000100:00100000:3.0:1788201262.652562:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570070912 00000100:00100000:3.0:1788201262.652576:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788201262.652584:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570070656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201262.652627:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570070656:12345-0@lo:400:kworker.0 Request processed in 44us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201262.652634:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788201262.652652:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788201262.652658:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570071040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201262.652685:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570071040:12345-0@lo:400:kworker.0 Request processed in 28us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201262.652691:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788201262.652702:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788201262.652707:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570070912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201262.652734:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570070912:12345-0@lo:400:kworker.0 Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201262.652740:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788201262.652771:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570070912:0@lo:400:kworker.0 00000100:00080000:2.0:1788201262.653491:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201262.653498:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201262.653524:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570070784 00000100:00100000:2.0:1788201262.653530:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570070784 00000100:00100000:2.0:1788201262.653587:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788201262.653603:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570070784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201262.653659:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570070784:12345-0@lo:400:kworker.0 Request processed in 57us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201262.653665:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788201262.653702:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570070784:0@lo:400:kworker.0 00010000:00080000:2.0:1788201262.653736:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c9c6a00 x1875064570070400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201262.653752:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570070400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201262.654589:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570071040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201262.654606:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570070656:0@lo:400:kworker.0 00000100:00100000:0.0:1788201262.654809:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570070528 00000100:00100000:0.0:1788201262.654816:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570070528 00000100:00100000:0.0:1788201262.654864:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788201262.654872:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570070528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201262.654931:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570070528:12345-0@lo:400:kworker.0 Request processed in 60us (2865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201262.654937:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00080000:3.0:1788201262.655690:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201262.656594:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570070528:0@lo:400:kworker.0 00010000:00010000:1.0:1788201262.838614:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201262.898220:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201262.898273:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201262.898307:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201262.898387:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201262.898432:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559536256 00000100:00100000:3.0:1788201262.898442:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559536256 00000100:00100000:3.0:1788201262.898514:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559536384 00000100:00100000:3.0:1788201262.898517:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559536384 00000100:00100000:1.0:1788201262.898525:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559536128 00000100:00100000:1.0:1788201262.898532:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559536128 00000100:00100000:3.0:1788201262.898562:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 94 00000100:00100000:3.0:1788201262.898574:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559536256:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201262.898583:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 178 00000100:00100000:1.0:1788201262.898594:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559536128:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201262.898650:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559536256:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 78us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201262.898658:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 94 00000100:00100000:2.0:1788201262.898671:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 95 00000100:00100000:2.0:1788201262.898682:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559536384:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201262.898781:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559536000 00000100:00100000:0.0:1788201262.898786:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559536000 00000100:00100000:0.0:1788201262.898815:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 339 00000100:00100000:0.0:1788201262.898821:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559536000:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201262.901157:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559536128:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 2556us (2839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201262.901172:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 178 00000100:00080000:1.0:1788201262.901265:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201262.901272:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201262.901274:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201262.901373:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559536384:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 2690us (2982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201262.901381:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 95 00000100:00100000:0.0:1788201262.904594:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559536000:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 5762us (6375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201262.904610:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 339 00010000:00010000:1.0:1788201263.862670:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201264.184108:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201264.184134:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570071168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201264.184206:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201264.184310:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570071168 00000100:00100000:1.0:1788201264.184318:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570071168 00000100:00100000:1.0:1788201264.184400:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788201264.184410:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570071168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201264.184455:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 41353216 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201264.184499:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570071168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201264.184505:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788201264.184526:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201264.184559:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570071168:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201264.893648:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201265.401936:0:14542:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00010000:00010000:1.0:1788201265.910664:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201266.934797:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201267.223418:0:14592:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1788201267.768254:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201267.768300:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570071296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201267.768442:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201267.768735:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570071296 00000100:00100000:0.0:1788201267.768747:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570071296 00000100:00100000:0.0:1788201267.768824:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788201267.768837:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570071296:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201267.769110:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1788201267.769188:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201267.769527:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201267.769546:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570071552:0@lo:400:kworker.0 00000100:00100000:1.0:1788201267.769772:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201267.769785:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570071424:0@lo:400:kworker.0 00010000:00080000:2.0:1788201267.769890:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c9c5180 x1875064570071296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.769917:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570071296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201267.770190:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201267.770198:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570071808:0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.782075:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201267.782295:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570071680:0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.782635:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201267.782716:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570071552 00000100:00100000:3.0:1788201267.782727:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570071552 00000100:00100000:3.0:1788201267.782917:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788201267.782930:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570071552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.783005:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570071552:12345-0@lo:400:kworker.0 Request processed in 77us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201267.783014:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788201267.783049:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570071680 00000100:00100000:3.0:1788201267.783053:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570071680 00000100:00100000:3.0:1788201267.783098:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788201267.783106:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570071680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.783221:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570071680:12345-0@lo:400:kworker.0 Request processed in 115us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201267.783228:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1788201267.783256:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201267.783294:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570071680:0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.783329:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570071552:0@lo:400:kworker.0 00000100:00100000:0.0:1788201267.788490:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570071296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 19639us (20031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201267.788511:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201267.792842:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201267.793059:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201267.793088:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570071936:0@lo:400:kworker.0 00000100:00100000:1.0:1788201267.793157:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201267.793200:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570071936 00000100:00100000:1.0:1788201267.793210:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570071936 00000100:00100000:1.0:1788201267.794062:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788201267.794076:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570071936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201267.794168:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570071936:12345-0@lo:400:kworker.0 Request processed in 95us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201267.794175:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788201267.794242:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570071936:0@lo:400:kworker.0 00000100:00100000:2.0:1788201267.794393:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201267.794901:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570071424 00000100:00100000:0.0:1788201267.794911:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570071424 00000100:00080000:3.0:1788201267.794936:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201267.794956:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788201267.794970:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570071424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201267.795100:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570071424:12345-0@lo:400:kworker.0 Request processed in 136us (2271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201267.795107:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788201267.795135:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570071808 00000100:00100000:1.0:1788201267.795142:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570071808 00000100:00100000:1.0:1788201267.795216:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788201267.795223:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570071808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201267.795267:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570071808:12345-0@lo:400:kworker.0 Request processed in 45us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201267.795273:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788201267.795592:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570071424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201267.795651:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570071808:0@lo:400:kworker.0 00000100:00080000:3.0:1788201267.795751:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788201267.958777:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201268.018094:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201268.018154:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201268.018277:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559536640 00000100:00100000:2.0:1788201268.018289:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559536640 00000100:00100000:2.0:1788201268.018446:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 182 00000100:00100000:2.0:1788201268.018470:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559536640:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201268.018571:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559536640:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 116us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201268.018579:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 182 00000100:00080000:3.0:1788201268.018838:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201268.019709:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201268.019754:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201268.020013:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559536512 00000100:00100000:1.0:1788201268.020025:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559536512 00000100:00100000:1.0:1788201268.020090:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 341 00000100:00100000:1.0:1788201268.020100:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559536512:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201268.020531:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559536512:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 431us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201268.020539:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 341 00000100:00100000:2.0:1788201268.024613:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559536896 00000100:00100000:2.0:1788201268.024635:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559536896 00000100:00100000:2.0:1788201268.024764:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559536768 00000100:00100000:2.0:1788201268.024768:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559536768 00000100:00100000:2.0:1788201268.024808:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 97 00000100:00100000:2.0:1788201268.024821:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559536896:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201268.024930:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559536896:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 111us (6774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201268.024940:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 97 00000100:00100000:2.0:1788201268.024961:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 98 00000100:00100000:2.0:1788201268.024968:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559536768:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201268.024994:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559536768:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 27us (5240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201268.024999:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 98 00000100:00080000:0.0:1788201268.028825:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201268.028842:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201268.984301:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201269.094427:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201269.094552:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559537024 00000100:00100000:1.0:1788201269.094585:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559537024 00000100:00100000:1.0:1788201269.094664:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 40 00000100:00100000:1.0:1788201269.094678:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:12768:x1875064559537024:12345-192.168.201.56@tcp:41:lfs.0 00000004:00000024:1.0:1788201269.094746:0:5825:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201269.094844:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:12768:x1875064559537024:12345-192.168.201.56@tcp:41:lfs.0 Request processed in 169us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201269.094852:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 40 00000100:00100000:3.0:1788201269.099815:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201269.100515:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559537152 00000100:00100000:1.0:1788201269.100529:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559537152 00000100:00100000:1.0:1788201269.100619:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 98 00000100:00100000:1.0:1788201269.100632:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:12768:x1875064559537152:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:1.0:1788201269.100706:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 41353216 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201269.100817:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:12768:x1875064559537152:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 187us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201269.100826:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 98 00000100:00100000:3.0:1788201269.104872:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201269.105449:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559537280 00000100:00100000:1.0:1788201269.105470:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559537280 00000100:00100000:1.0:1788201269.105558:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 99 00000100:00100000:1.0:1788201269.105572:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:12768:x1875064559537280:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:1.0:1788201269.105634:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201269.105733:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:12768:x1875064559537280:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 164us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201269.105743:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 99 00000100:00100000:3.0:1788201269.186498:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201269.186679:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559537536 00000100:00100000:2.0:1788201269.186693:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559537536 00000100:00100000:2.0:1788201269.186770:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 41 00000100:00100000:2.0:1788201269.186801:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:12787:x1875064559537536:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:2.0:1788201269.186881:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201269.186917:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cae00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99952 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.186944:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9624a8e9fc00) 00010000:00010000:2.0:1788201269.186957:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201269.186988:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3caeaf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.187004:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3caeaf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.187017:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3caeaf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.187036:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3caeb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.187044:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3caeb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.187051:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3caeb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.187876:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3caebd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.187890:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3caebd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.187899:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3caebd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201269.193824:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788201269.193843:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401266500249ns, next at 402266495902ns, rc = 0 00010000:00010000:2.0:1788201269.193980:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3caec4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.194000:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3caec4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.194014:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3caec4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.194023:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3caec4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.194029:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3caec4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.194035:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3caec4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195426:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201269.195481:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3caebd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195492:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3caebd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195500:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3caebd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195507:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5a00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201269.195526:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3caebd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195535:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3caebd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195553:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9624a84c1f00) 00010000:00010000:2.0:1788201269.195556:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201269.195562:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3caebd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195569:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3caebd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195595:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3caeaf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195601:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3caeaf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195607:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3caeaf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195613:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201269.195616:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3caeaf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195621:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3caeaf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195629:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201269.195631:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201269.195640:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3caeaf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201269.195647:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3caeaf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201269.195657:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d7dc6ac reply state 00000000da6154cd transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3caeb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201269.195667:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201269.195798:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:12787:x1875064559537536:12345-192.168.201.56@tcp:36:rm.0 Request processed in 8994us (9309us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788201269.195808:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 41 00010000:00010000:0.0:1788201269.198219:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3caeb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201269.198239:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3caeb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201269.198248:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3caeb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201269.198254:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c4e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201269.198259:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3caeb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201269.198266:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3caeb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201269.198533:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3509f068 (ffff9624a84c1800) 00010000:00010000:0.0:1788201269.198537:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201269.198543:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3caeb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201269.198551:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3caeb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3509f068 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.198750:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201269.198759:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3caec4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.198766:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5e00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:1.0:1788201269.198770:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3caec4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.198777:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3caec4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.198787:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9624a84c1f00) 00010000:00010000:1.0:1788201269.198790:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201269.198793:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3caec4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.198810:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3caec4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201269.198825:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201269.198826:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201269.198828:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201269.304920:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201269.304955:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570072064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201269.305052:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201269.305244:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570072064 00000100:00100000:1.0:1788201269.305255:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570072064 00000100:00100000:1.0:1788201269.305381:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201269.305395:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570072064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201269.305428:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 41353216 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201269.305537:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570072064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201269.305544:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1788201269.305846:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201269.311463:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570072064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201270.011457:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201271.030765:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201272.069720:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201272.886859:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570072192:0@lo:400:kworker.0 00000100:00100000:3.0:1788201272.886937:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201272.887002:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570072704:0@lo:400:kworker.0 00000100:00100000:3.0:1788201272.887030:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201272.887055:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201272.887061:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570072576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201272.887155:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201272.887190:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570072704 00000100:00100000:3.0:1788201272.887197:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570072704 00000100:00100000:3.0:1788201272.887255:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201272.887265:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570072704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201272.887387:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570072704:12345-0@lo:400:kworker.0 Request processed in 124us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.887394:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201272.887590:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570072576 00000100:00100000:3.0:1788201272.887595:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570072576 00000100:00100000:3.0:1788201272.887641:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788201272.887648:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570072576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201272.887683:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570072576:12345-0@lo:400:kworker.0 Request processed in 36us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.887688:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:3.0:1788201272.887705:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201272.887710:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201272.887743:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570072576:0@lo:400:kworker.0 00010000:00080000:3.0:1788201272.887755:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9c62a00 x1875064570072704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201272.887764:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570072704:0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.887860:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570072320:0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.887892:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201272.887920:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570072832:0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.887941:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201272.887961:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201272.887966:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570072448:0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.887987:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201272.888017:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570072320 00000100:00100000:2.0:1788201272.888020:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570072320 00000100:00100000:2.0:1788201272.888039:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570072832 00000100:00100000:2.0:1788201272.888041:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570072832 00000100:00100000:2.0:1788201272.888061:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788201272.888066:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570072320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.888213:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570072320:12345-0@lo:400:kworker.0 Request processed in 146us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201272.888220:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788201272.888241:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788201272.888247:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570072832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.888277:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570072832:12345-0@lo:400:kworker.0 Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201272.888282:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788201272.888311:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570072448 00000100:00100000:2.0:1788201272.888315:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570072448 00000100:00100000:2.0:1788201272.888339:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788201272.888367:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570072448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.888395:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570072448:12345-0@lo:400:kworker.0 Request processed in 30us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201272.888401:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201272.888838:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570072192 00000100:00100000:1.0:1788201272.888844:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570072192 00000100:00100000:1.0:1788201272.888874:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788201272.888881:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570072192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201272.888923:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570072192:12345-0@lo:400:kworker.0 Request processed in 43us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201272.888929:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788201272.888972:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570072192:0@lo:400:kworker.0 00000100:00100000:1.0:1788201272.889028:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570072448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201272.889051:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570072320:0@lo:400:kworker.0 00000100:00100000:1.0:1788201272.889063:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570072832:0@lo:400:kworker.0 00000100:00100000:0.0:1788201272.889604:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570072960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201272.889645:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201272.889686:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570072960 00000100:00100000:0.0:1788201272.889690:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570072960 00000100:00100000:0.0:1788201272.889720:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788201272.889726:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570072960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201272.889754:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201272.889789:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570072960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201272.889795:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1788201272.889824:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c9c5180 x1875064570072960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201272.889840:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570072960:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201272.890169:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201272.890173:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788201272.967372:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000004:00080000:0.0:1788201272.967481:0:5847:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1788201272.967735:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570073088:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201272.967810:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201272.967971:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570073088 00000100:00100000:0.0:1788201272.967979:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570073088 00000100:00100000:0.0:1788201272.968035:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201272.968046:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570073088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201272.968149:0:6668:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1788201272.968179:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 29, mtime: 0x6a95c90a, atime: 0x0, ctime: 0x6a95c90a, blocks: 0xb 00010000:00010000:0.0:1788201272.968187:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.968207:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7e6b5f0/0xa81c4c9a2f3cae9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 5 pid: 13901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.968215:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788201272.968220:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788201272.968225:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.968252:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7e6b5f0/0xa81c4c9a2f3cae9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 5 pid: 13901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.968266:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7e6b5f0/0xa81c4c9a2f3cae9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 5 pid: 13901 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201272.968279:0:6668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570073216:192.168.201.56@tcp:104: 00000100:00100000:0.0:1788201272.968389:0:6668:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9d78540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201272.971874:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201272.972061:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559537664 00000100:00100000:1.0:1788201272.972121:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559537664 00010000:00010000:1.0:1788201272.972175:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e6b5f0/0xa81c4c9a2f3cae9a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 6 pid: 13901 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201272.972214:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:1.0:1788201272.972223:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485694450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559537664:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201272.972237:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201272.972242:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7e6b5f0/0xa81c4c9a2f3cae9a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 6 pid: 13901 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.972257:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7e6b5f0/0xa81c4c9a2f3cae9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 6 pid: 13901 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.972294:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201272.972298:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201272.972305:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.972315:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.972335:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1788201272.972527:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201272.972567:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485694450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559537664:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 344us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201272.972575:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 36 00010000:00010000:0.0:1788201272.973385:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7e6b5f0/0xa81c4c9a2f3cae9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99960 expref: 5 pid: 13901 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201272.973428:0:6668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570073216:192.168.201.56@tcp:104: 00010000:00010000:0.0:1788201272.973450:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.973463:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.973470:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.973481:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.973489:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.973504:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201272.974025:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570073088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5980us (6214us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788201272.974035:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:2.0:1788201272.974324:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9624b9c61180/2, rc 0, transno 12884901890 00000100:00100000:2.0:1788201272.974331:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570073088:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788201272.974570:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201272.974578:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.974590:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4de200 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:1.0:1788201272.974594:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.974605:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.974623:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.974631:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3caecb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.974655:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201272.974657:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201272.974658:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201273.079103:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201273.139196:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201273.139259:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201273.139317:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559537920 00000100:00100000:1.0:1788201273.139325:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201273.139336:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559537920 00000100:00100000:1.0:1788201273.139430:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201273.139504:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559538176 00000100:00100000:1.0:1788201273.139512:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559538176 00000100:00100000:0.0:1788201273.139589:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559537792 00000100:00100000:3.0:1788201273.139589:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559538048 00000100:00100000:0.0:1788201273.139597:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559537792 00000100:00100000:3.0:1788201273.139597:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559538048 00000100:00100000:0.0:1788201273.139646:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 343 00000100:00100000:3.0:1788201273.139646:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 101 00000100:00100000:0.0:1788201273.139656:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559537792:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201273.139656:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559538048:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201273.139748:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 186 00000100:00100000:2.0:1788201273.139755:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2344:x1875064559537920:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201273.139825:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559537792:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 171us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201273.139833:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 343 00000100:00100000:1.0:1788201273.140011:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 102 00000100:00100000:1.0:1788201273.140022:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1d5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559538176:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201273.144174:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559538048:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 4508us (4732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201273.144257:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 101 00000100:00080000:3.0:1788201273.145653:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201273.145663:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201273.149233:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2344:x1875064559537920:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 9463us (10043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201273.149250:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 186 00000100:00100000:1.0:1788201273.165016:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1d5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559538176:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 24977us (25737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201273.165037:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 102 00010000:00010000:0.0:1788201274.105667:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201274.422732:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201274.422762:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570073344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201274.422835:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201274.423667:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570073344 00000100:00100000:2.0:1788201274.423677:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570073344 00000100:00080000:3.0:1788201274.429046:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201274.429102:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788201274.429116:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570073344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201274.429155:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 41353216 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201274.429250:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570073344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (6413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201274.429267:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201274.429495:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570073344:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788201274.491377:0:13974:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00010000:00010000:1.0:1788201275.134187:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201276.127733:0:14788:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 2: |x| 10 open(O_CREAT)s ======= 14:34:34 (1788201274) 00010000:00010000:1.0:1788201276.157117:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201276.174585:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201276.174673:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559538432 00000100:00100000:1.0:1788201276.174685:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559538432 00000100:00100000:1.0:1788201276.174804:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:1.0:1788201276.174815:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:13222:x1875064559538432:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:1.0:1788201276.174841:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201276.174875:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3caed2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd9996e expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.175217:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caed9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.175244:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caed9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.175256:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caed9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.175300:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3caee0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.175309:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3caee0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.175316:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3caee0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788201276.176302:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788201276.177493:0:6693:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788201276.182090:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3000/0xa81c4c9a2f3caee7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.182116:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3000/0xa81c4c9a2f3caee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.182129:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3000/0xa81c4c9a2f3caee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.182187:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caed9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.182195:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caed9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.182201:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caed9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.182206:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2800 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201276.182210:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caed9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.182244:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caed9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.182256:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201276.182259:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201276.182264:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caed9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.182269:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caed9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201276.182282:0:6693:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e84aed1c reply state 000000004fcef1e4 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3caee0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201276.182290:0:6693:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201276.183879:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3caed2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9996e expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.183921:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3000/0xa81c4c9a2f3caee7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9996e expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.183930:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962487f56b00) 00010000:00010000:1.0:1788201276.183932:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201276.183936:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac3000, rc 0) 00000100:00100000:0.0:1788201276.184250:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:13222:x1875064559538432:12345-192.168.201.56@tcp:101:bash.0 Request processed in 9434us (9673us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788201276.184259:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 42 00010000:00010000:3.0:1788201276.198898:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3caee0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.198919:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3caee0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.198926:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3caee0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.198933:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201276.198938:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3caee0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.198945:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3caee0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.198963:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x95f49252 (ffff962487f56700) 00010000:00010000:3.0:1788201276.198967:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201276.198972:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3caee0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.198978:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3caee0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201276.208722:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201276.212848:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559538560 00000100:00100000:3.0:1788201276.212865:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559538560 00000100:00100000:3.0:1788201276.212948:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00100000:3.0:1788201276.212960:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:13222:x1875064559538560:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1788201276.212979:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201276.213005:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3caef5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99975 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788201276.214121:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1788201276.214424:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201276.214453:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=408s v=(0 0) 00010000:00010000:1.0:1788201276.214458:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201276.214472:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3caef5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99975 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.214508:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3caef5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99975 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.214524:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7c000, rc 0) 00000100:00100000:1.0:1788201276.214598:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:13222:x1875064559538560:12345-192.168.201.56@tcp:101:bash.0 Request processed in 1640us (5887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201276.214606:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00100000:0.0:1788201276.221373:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201276.221469:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559538688 00000100:00100000:2.0:1788201276.221480:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559538688 00002000:00100000:2.0:1788201276.221530:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->5) req@ffff96248c9c4000 x1875064559538688/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/0 e 0 to 0 dl 1788201287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201276.221540:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4000 with x1875064559538688 ext(0->5) 00002000:00010000:2.0:1788201276.221546:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4000 00000100:00100000:2.0:1788201276.221582:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:2.0:1788201276.221592:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559538688:12345-192.168.201.56@tcp:4:bash.0 00000001:00080000:0.0:1788201276.303978:0:13974:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901891 is committed 00000100:00100000:0.0:1788201276.304126:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559538688:12345-192.168.201.56@tcp:4:bash.0 Request processed in 82528us (82781us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788201276.304149:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 3 00002000:00100000:0.0:1788201276.304164:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->5) req@ffff96248c9c4000 x1875064559538688/t12884901891(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/448 e 0 to 0 dl 1788201287 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201276.304175:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4000 with x1875064559538688 ext(0->5) 00002000:00010000:0.0:1788201276.304182:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4000 00000100:00100000:2.0:1788201276.319874:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201276.320113:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559538944 00000100:00100000:3.0:1788201276.320124:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559538944 00000100:00100000:3.0:1788201276.320242:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:3.0:1788201276.320254:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624afebcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:13222:x1875064559538944:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:3.0:1788201276.321181:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624afebcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:13222:x1875064559538944:12345-192.168.201.56@tcp:35:bash.0 Request processed in 925us (1313us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788201276.321191:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:0.0:1788201276.327457:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201276.327613:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559539200 00000100:00100000:3.0:1788201276.327623:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559539200 00000100:00100000:3.0:1788201276.327696:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:3.0:1788201276.327705:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:13222:x1875064559539200:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1788201276.328576:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201276.328601:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3caefc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd9997c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.328739:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3caf03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.328754:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3caf03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.328767:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3caf03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.328796:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3caf0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.328804:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3caf0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.328822:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3caf0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201276.329323:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788201276.329603:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3caf11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.329614:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3caf11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.329621:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3caf11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.329660:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3caf03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.329666:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3caf03 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.329672:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3caf03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.329678:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5c00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201276.329682:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3caf03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.329689:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3caf03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.329700:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201276.329703:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201276.329713:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3caf03 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.329719:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3caf03 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201276.329732:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2e96b53 reply state 0000000003360f27 transno 4294967315 ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3caf0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201276.329742:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201276.329780:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3caefc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9997c expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.329794:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3caf11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9997c expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.329801:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9624a84c1300) 00010000:00010000:2.0:1788201276.329804:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201276.329806:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5600, rc 0) 00000100:00100000:2.0:1788201276.329892:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:13222:x1875064559539200:12345-192.168.201.56@tcp:101:bash.0 Request processed in 2187us (2444us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788201276.329900:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 43 00010000:00010000:1.0:1788201276.333760:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3caf0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.333779:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3caf0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.333855:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3caf0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.333862:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5200 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201276.333868:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3caf0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.333877:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3caf0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.333894:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd2ef3d52 (ffff9624a84c1500) 00010000:00010000:1.0:1788201276.333897:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201276.333901:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3caf0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.333917:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3caf0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201276.355665:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201276.355708:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559539328 00000100:00100000:0.0:1788201276.355718:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559539328 00000100:00100000:0.0:1788201276.355778:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:0.0:1788201276.355800:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:13222:x1875064559539328:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1788201276.355820:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201276.355842:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9d61ab1/0xa81c4c9a2f3caf1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99983 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201276.357895:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201276.357927:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1788201276.357932:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201276.357947:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9d61ab1/0xa81c4c9a2f3caf1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99983 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.357968:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9d61ab1/0xa81c4c9a2f3caf1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99983 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.357983:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4df800, rc 0) 00000100:00100000:0.0:1788201276.358164:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:13222:x1875064559539328:12345-192.168.201.56@tcp:101:bash.0 Request processed in 2375us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201276.358173:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:0.0:1788201276.374515:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201276.375305:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559539584 00000100:00100000:1.0:1788201276.375316:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559539584 00000100:00100000:1.0:1788201276.376187:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:1.0:1788201276.376201:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:13222:x1875064559539584:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:1.0:1788201276.377784:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:13222:x1875064559539584:12345-192.168.201.56@tcp:35:bash.0 Request processed in 1575us (3268us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788201276.377799:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:1.0:1788201276.383588:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201276.384531:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559539840 00000100:00100000:3.0:1788201276.384543:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559539840 00000100:00100000:3.0:1788201276.384606:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 44 00000100:00100000:3.0:1788201276.384617:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:13222:x1875064559539840:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1788201276.384645:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201276.384685:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ca00/0xa81c4c9a2f3caf26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd9998a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.384835:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c200/0xa81c4c9a2f3caf2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.384851:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c200/0xa81c4c9a2f3caf2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.384864:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c200/0xa81c4c9a2f3caf2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.384894:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3caf34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.384902:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3caf34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.384909:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3caf34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201276.385950:0:5825:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788201276.386157:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3caf3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.386170:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3caf3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.386181:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3caf3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.386216:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c200/0xa81c4c9a2f3caf2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.386238:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c200/0xa81c4c9a2f3caf2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.386245:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c200/0xa81c4c9a2f3caf2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.386252:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7c200 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201276.386256:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c200/0xa81c4c9a2f3caf2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.386274:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c200/0xa81c4c9a2f3caf2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.386286:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:3.0:1788201276.386289:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201276.386293:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c200/0xa81c4c9a2f3caf2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.386299:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c200/0xa81c4c9a2f3caf2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201276.386314:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048b7d6d0 reply state 000000006c459575 transno 4294967317 ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3caf34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201276.386323:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201276.386390:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ca00/0xa81c4c9a2f3caf26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9998a expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.386416:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3caf3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9998a expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.386423:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff9624942a6700) 00010000:00010000:3.0:1788201276.386425:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201276.386427:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7dc00, rc 0) 00000100:00100000:3.0:1788201276.386508:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:13222:x1875064559539840:12345-192.168.201.56@tcp:101:bash.0 Request processed in 1892us (2930us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788201276.386516:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 44 00010000:00010000:3.0:1788201276.388673:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3caf34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.388705:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3caf34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.388713:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3caf34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.388720:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7d600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201276.388724:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3caf34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.388732:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3caf34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.388750:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8ac02452 (ffff9624942a6400) 00010000:00010000:3.0:1788201276.388753:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201276.388758:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3caf34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.388764:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d600/0xa81c4c9a2f3caf34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201276.390625:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201276.390704:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559539968 00000100:00100000:3.0:1788201276.390715:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559539968 00000100:00100000:3.0:1788201276.390817:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:3.0:1788201276.390827:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:13222:x1875064559539968:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1788201276.390847:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201276.390869:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3caf49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99991 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201276.394433:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201276.394474:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=408s v=(0 0) 00010000:00010000:1.0:1788201276.394480:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201276.394498:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3caf49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99991 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.394524:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3caf49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99991 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.394540:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7ce00, rc 0) 00000100:00100000:1.0:1788201276.394619:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:13222:x1875064559539968:12345-192.168.201.56@tcp:101:bash.0 Request processed in 3792us (4000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201276.394628:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:0.0:1788201276.398532:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201276.398642:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559540224 00000100:00100000:3.0:1788201276.398652:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559540224 00000100:00100000:3.0:1788201276.398720:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:3.0:1788201276.398730:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:13222:x1875064559540224:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:3.0:1788201276.399169:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:13222:x1875064559540224:12345-192.168.201.56@tcp:35:bash.0 Request processed in 438us (644us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788201276.399178:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:2.0:1788201276.410795:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201276.410945:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559540480 00000100:00100000:0.0:1788201276.410955:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559540480 00000100:00100000:0.0:1788201276.411029:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:0.0:1788201276.411054:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:13222:x1875064559540480:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1788201276.411082:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201276.411104:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3caf50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99998 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.411260:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3caf57 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.411277:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3caf57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.411289:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3caf57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.411382:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3caf5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.411391:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3caf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.411398:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3caf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201276.412268:0:5826:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7:0x0], index 0: 0 00010000:00010000:0.0:1788201276.412789:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3caf65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.412803:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3caf65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.412812:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3caf65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.412861:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3caf57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.412870:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3caf57 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.412878:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3caf57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.412885:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201276.412890:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3caf57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.412898:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3caf57 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.412911:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:0.0:1788201276.412914:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201276.412919:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3caf57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.412925:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3caf57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201276.412939:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b30c124b reply state 00000000e4de3c49 transno 4294967319 ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3caf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201276.412948:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201276.413118:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3caf50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99998 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.413146:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3caf65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99998 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.413153:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9624a8e9f700) 00010000:00010000:0.0:1788201276.413155:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201276.413158:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dec00, rc 0) 00000100:00100000:0.0:1788201276.413307:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:13222:x1875064559540480:12345-192.168.201.56@tcp:101:bash.0 Request processed in 2253us (2522us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788201276.413315:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:2.0:1788201276.422079:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201276.422156:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559540608 00000100:00100000:1.0:1788201276.422168:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559540608 00000100:00100000:1.0:1788201276.422245:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:1.0:1788201276.422257:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:13222:x1875064559540608:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:1.0:1788201276.422281:0:8088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201276.422309:0:8088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052260eb2/0xa81c4c9a2f3caf73 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd9999f expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.423976:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3caf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201276.424549:0:8088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201276.424587:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=408s v=(0 0) 00010000:00010000:2.0:1788201276.424594:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201276.424612:0:8088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052260eb2/0xa81c4c9a2f3caf73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9999f expref: 9 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.424655:0:8088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000052260eb2/0xa81c4c9a2f3caf73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9999f expref: 9 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.424670:0:8088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac3200, rc 0) 00000100:00100000:2.0:1788201276.424762:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:13222:x1875064559540608:12345-192.168.201.56@tcp:101:bash.0 Request processed in 2506us (2694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201276.424772:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 57 00010000:00010000:0.0:1788201276.425507:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3caf5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.425515:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3caf5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.425521:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4dea00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201276.425526:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3caf5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.425535:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3caf5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.425551:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x427acf52 (ffff9624a8e9f200) 00010000:00010000:0.0:1788201276.425554:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201276.425558:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3caf5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.425574:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3caf5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201276.431778:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201276.431812:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201276.432211:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559540736 00000100:00100000:0.0:1788201276.432232:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559540736 00002000:00100000:0.0:1788201276.432285:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->5) req@ffff9624b9c63480 x1875064559540736/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/0 e 0 to 0 dl 1788201287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201276.432297:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c63480 with x1875064559540736 ext(0->5) 00002000:00010000:0.0:1788201276.432303:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c63480 00000100:00100000:0.0:1788201276.432326:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559540864 00000100:00100000:0.0:1788201276.432330:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559540864 00002000:00100000:0.0:1788201276.432371:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->5) req@ffff9624b9c63800 x1875064559540864/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/0 e 0 to 0 dl 1788201287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201276.432379:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c63800 with x1875064559540864 ext(0->5) 00002000:00010000:0.0:1788201276.432382:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c63800 00000100:00100000:0.0:1788201276.432395:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:0.0:1788201276.432416:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559540736:12345-192.168.201.56@tcp:4:bash.0 00000100:00100000:0.0:1788201276.433566:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559540736:12345-192.168.201.56@tcp:4:bash.0 Request processed in 1147us (1791us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788201276.433576:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 4 00002000:00100000:0.0:1788201276.433585:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->5) req@ffff9624b9c63480 x1875064559540736/t12884901892(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/448 e 0 to 0 dl 1788201287 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201276.433594:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c63480 with x1875064559540736 ext(0->5) 00002000:00010000:0.0:1788201276.433598:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c63480 00000100:00100000:0.0:1788201276.433631:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:0.0:1788201276.433640:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:2342:x1875064559540864:12345-192.168.201.56@tcp:4:bash.0 00000100:00100000:1.0:1788201276.435622:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:2342:x1875064559540864:12345-192.168.201.56@tcp:4:bash.0 Request processed in 1973us (3797us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788201276.435637:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 5 00002000:00100000:1.0:1788201276.435649:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->5) req@ffff9624b9c63800 x1875064559540864/t12884901893(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/448 e 0 to 0 dl 1788201287 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201276.435660:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c63800 with x1875064559540864 ext(0->5) 00002000:00010000:1.0:1788201276.435665:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c63800 00000100:00100000:1.0:1788201276.446061:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201276.446173:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559541120 00000100:00100000:3.0:1788201276.446215:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559541120 00000100:00100000:3.0:1788201276.446322:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:3.0:1788201276.446336:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:13222:x1875064559541120:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:2.0:1788201276.446948:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:13222:x1875064559541120:12345-192.168.201.56@tcp:35:bash.0 Request processed in 608us (889us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788201276.446962:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:3.0:1788201276.454286:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201276.454446:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559541376 00000100:00100000:1.0:1788201276.454461:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559541376 00000100:00100000:1.0:1788201276.454544:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00100000:1.0:1788201276.454568:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:13222:x1875064559541376:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:1.0:1788201276.454597:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201276.454624:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2c00/0xa81c4c9a2f3caf7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999a6 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.454772:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3caf81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.454802:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3caf81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.454813:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3caf81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.454830:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2400/0xa81c4c9a2f3caf88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.454837:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2400/0xa81c4c9a2f3caf88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.454844:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2400/0xa81c4c9a2f3caf88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201276.455448:0:6693:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8:0x0], index 0: 0 00010000:00010000:1.0:1788201276.455622:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caf8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.455634:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caf8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.455641:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caf8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.455678:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3caf81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.455686:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3caf81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.455692:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3caf81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.455705:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3800 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201276.455710:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3caf81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.455717:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3caf81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.455730:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201276.455732:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201276.455737:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3caf81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.455743:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3caf81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201276.455756:0:6693:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e317d6df reply state 00000000e7d1b60b transno 4294967321 ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2400/0xa81c4c9a2f3caf88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201276.455764:0:6693:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201276.455799:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2c00/0xa81c4c9a2f3caf7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999a6 expref: 22 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.455814:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caf8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999a6 expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.455821:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962487f56000) 00010000:00010000:1.0:1788201276.455824:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201276.455826:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac2800, rc 0) 00000100:00100000:1.0:1788201276.455924:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:13222:x1875064559541376:12345-192.168.201.56@tcp:101:bash.0 Request processed in 1370us (1660us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788201276.455940:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 46 00010000:00010000:0.0:1788201276.458826:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2400/0xa81c4c9a2f3caf88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.458849:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2400/0xa81c4c9a2f3caf88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.458858:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2400/0xa81c4c9a2f3caf88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.458865:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201276.458871:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2400/0xa81c4c9a2f3caf88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.458880:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2400/0xa81c4c9a2f3caf88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.458903:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b739652 (ffff962487f56500) 00010000:00010000:0.0:1788201276.458907:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201276.458914:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2400/0xa81c4c9a2f3caf88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.458922:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2400/0xa81c4c9a2f3caf88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201276.463955:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201276.464248:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559541504 00000100:00100000:1.0:1788201276.464260:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559541504 00000100:00100000:1.0:1788201276.464365:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:1.0:1788201276.464378:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:13222:x1875064559541504:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:1.0:1788201276.464403:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201276.464435:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3caf9d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999ad expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201276.468720:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201276.468763:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=408s v=(0 0) 00010000:00010000:2.0:1788201276.468770:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201276.468785:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3caf9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999ad expref: 14 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.468809:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3caf9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999ad expref: 14 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.468823:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac2c00, rc 0) 00000100:00100000:2.0:1788201276.468920:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:13222:x1875064559541504:12345-192.168.201.56@tcp:101:bash.0 Request processed in 4544us (4979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201276.468929:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:3.0:1788201276.473786:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201276.474070:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559541760 00000100:00100000:0.0:1788201276.474084:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559541760 00000100:00100000:0.0:1788201276.474216:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:0.0:1788201276.474245:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:13222:x1875064559541760:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:0.0:1788201276.474898:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:13222:x1875064559541760:12345-192.168.201.56@tcp:35:bash.0 Request processed in 653us (1125us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788201276.474906:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:1.0:1788201276.478232:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201276.478329:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559542016 00000100:00100000:2.0:1788201276.478381:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559542016 00000100:00100000:2.0:1788201276.478465:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:2.0:1788201276.478476:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:13222:x1875064559542016:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1788201276.478521:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201276.478552:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3cafa4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999b4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.478736:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.478755:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.478768:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.478784:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cafb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.478793:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cafb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.478800:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cafb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201276.479497:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x9:0x0], index 0: 0 00010000:00010000:2.0:1788201276.479725:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cafb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.479738:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cafb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.479762:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cafb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.479814:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.479822:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.479830:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.479837:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5a00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201276.479842:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.479850:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.479865:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201276.479868:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201276.479873:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.479879:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201276.479897:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6fd0222 reply state 0000000046704e3b transno 4294967323 ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cafb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201276.479908:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201276.479963:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3cafa4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999b4 expref: 25 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.479978:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cafb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999b4 expref: 24 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.479986:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff9624a84c1a00) 00010000:00010000:2.0:1788201276.479989:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201276.479991:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5400, rc 0) 00000100:00100000:2.0:1788201276.480093:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:13222:x1875064559542016:12345-192.168.201.56@tcp:101:bash.0 Request processed in 1618us (1884us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788201276.480101:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 47 00010000:00010000:1.0:1788201276.484874:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cafb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.484903:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cafb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.484911:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cafb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.484919:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5200 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201276.484926:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cafb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.484935:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cafb2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.484958:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x532e4152 (ffff9624a84c1100) 00010000:00010000:1.0:1788201276.484961:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201276.484991:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cafb2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.484998:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cafb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201276.487826:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201276.487939:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559542144 00000100:00100000:0.0:1788201276.487952:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559542144 00000100:00100000:0.0:1788201276.488037:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:0.0:1788201276.488051:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:13222:x1875064559542144:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1788201276.488078:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201276.488112:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054eef2ef/0xa81c4c9a2f3cafc7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999bb expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201276.491635:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201276.491693:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1788201276.491700:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201276.491794:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054eef2ef/0xa81c4c9a2f3cafc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999bb expref: 15 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.491823:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054eef2ef/0xa81c4c9a2f3cafc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999bb expref: 15 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.491842:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dea00, rc 0) 00000100:00100000:0.0:1788201276.492014:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:13222:x1875064559542144:12345-192.168.201.56@tcp:101:bash.0 Request processed in 3955us (4193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201276.492025:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:3.0:1788201276.496699:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201276.496954:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559542400 00000100:00100000:2.0:1788201276.496967:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559542400 00000100:00100000:2.0:1788201276.497050:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:2.0:1788201276.497063:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:13222:x1875064559542400:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:2.0:1788201276.497935:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:13222:x1875064559542400:12345-192.168.201.56@tcp:35:bash.0 Request processed in 867us (1243us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788201276.497946:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:3.0:1788201276.502031:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201276.502193:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559542656 00000100:00100000:0.0:1788201276.502207:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559542656 00000100:00100000:0.0:1788201276.502338:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 48 00000100:00100000:0.0:1788201276.502383:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:13222:x1875064559542656:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1788201276.502417:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201276.502445:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cafce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999c2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.502646:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cafd5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.502664:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cafd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.502678:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cafd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.502695:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cafdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.502702:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cafdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.502709:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cafdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201276.503398:0:5825:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa:0x0], index 0: 0 00010000:00010000:0.0:1788201276.503607:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cafe3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.503619:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cafe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.503628:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cafe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.503686:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cafd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.503694:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cafd5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.503701:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cafd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.503709:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201276.503714:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cafd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.503722:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cafd5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.503736:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:0.0:1788201276.503739:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201276.503745:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cafd5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.503753:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cafd5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201276.503768:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ba3eabd reply state 00000000ecd61a21 transno 4294967325 ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cafdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201276.503777:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201276.503815:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cafce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999c2 expref: 28 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.503842:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cafe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999c2 expref: 27 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.503850:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9624a8e9fd00) 00010000:00010000:0.0:1788201276.503853:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201276.503855:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4df200, rc 0) 00000100:00100000:0.0:1788201276.503951:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:13222:x1875064559542656:12345-192.168.201.56@tcp:101:bash.0 Request processed in 1570us (1947us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788201276.503961:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 48 00010000:00010000:0.0:1788201276.507785:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cafdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.507811:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cafdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.507821:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cafdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.507828:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4de200 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201276.507834:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cafdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.507844:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cafdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.507869:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4bf9e852 (ffff9624a8e9f300) 00010000:00010000:0.0:1788201276.507872:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201276.507878:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cafdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.507908:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cafdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201276.515743:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201276.516313:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559542784 00000100:00100000:1.0:1788201276.516327:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559542784 00000100:00100000:1.0:1788201276.516436:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:1.0:1788201276.516449:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:13222:x1875064559542784:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:1.0:1788201276.516476:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201276.516516:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3caff1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999c9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201276.520043:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201276.520092:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1788201276.520100:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201276.520119:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3caff1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999c9 expref: 16 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.520146:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3caff1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999c9 expref: 16 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.520178:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac2600, rc 0) 00000100:00100000:3.0:1788201276.520390:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:13222:x1875064559542784:12345-192.168.201.56@tcp:101:bash.0 Request processed in 3940us (4667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201276.520402:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:1.0:1788201276.528977:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201276.529659:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559543040 00000100:00100000:0.0:1788201276.529675:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559543040 00000100:00100000:0.0:1788201276.529900:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:0.0:1788201276.529913:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624afebd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+27:13222:x1875064559543040:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:0.0:1788201276.530763:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624afebd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:13222:x1875064559543040:12345-192.168.201.56@tcp:35:bash.0 Request processed in 846us (1799us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788201276.530774:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:3.0:1788201276.534327:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201276.535117:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559543296 00000100:00100000:2.0:1788201276.535133:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559543296 00000100:00100000:2.0:1788201276.535370:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:2.0:1788201276.535384:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:13222:x1875064559543296:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1788201276.535424:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201276.535458:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3caff8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999d0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.535845:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.535866:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.535879:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.535897:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cb006 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.535905:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cb006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.535912:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cb006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201276.537326:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb:0x0], index 0: 0 00010000:00010000:2.0:1788201276.537859:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cb00d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.537878:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cb00d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.537892:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cb00d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.537942:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.537965:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.537972:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.537980:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5a00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201276.537985:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.537994:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.538170:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201276.538174:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201276.538263:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.538273:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5a00/0xa81c4c9a2f3cafff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201276.538294:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cc3c17f reply state 00000000d26b007f transno 4294967327 ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cb006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201276.538306:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201276.538591:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5c00/0xa81c4c9a2f3caff8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999d0 expref: 31 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.538610:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cb00d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999d0 expref: 30 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.538634:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9624a84c1100) 00010000:00010000:2.0:1788201276.538637:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201276.538640:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c4e00, rc 0) 00000100:00100000:2.0:1788201276.538753:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+31:13222:x1875064559543296:12345-192.168.201.56@tcp:101:bash.0 Request processed in 3372us (4441us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788201276.538763:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:2.0:1788201276.543655:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201276.543830:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559543424 00000100:00100000:3.0:1788201276.543844:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559543424 00000100:00100000:3.0:1788201276.543915:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:3.0:1788201276.543928:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:13222:x1875064559543424:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1788201276.543955:0:8088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201276.543984:0:8088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffbd6ff6/0xa81c4c9a2f3cb01b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999d7 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.544844:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cb006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.544856:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cb006 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.544864:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cb006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.544870:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201276.544876:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cb006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.544885:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cb006 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.544928:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x59102352 (ffff9624a84c1b00) 00010000:00010000:1.0:1788201276.544932:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201276.544938:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cb006 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.544946:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5e00/0xa81c4c9a2f3cb006 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201276.546572:0:8088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201276.546608:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1788201276.546614:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201276.546631:0:8088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbd6ff6/0xa81c4c9a2f3cb01b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999d7 expref: 17 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.546654:0:8088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffbd6ff6/0xa81c4c9a2f3cb01b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999d7 expref: 17 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.546669:0:8088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7ca00, rc 0) 00000100:00100000:3.0:1788201276.546886:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:13222:x1875064559543424:12345-192.168.201.56@tcp:101:bash.0 Request processed in 2958us (3243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201276.546904:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:1.0:1788201276.551889:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201276.551970:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201276.552201:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201276.552216:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559543552 00000100:00100000:0.0:1788201276.552238:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559543552 00002000:00100000:0.0:1788201276.552313:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x7:0x0] (0->5) req@ffff9624b9c62d80 x1875064559543552/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/0 e 0 to 0 dl 1788201287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201276.552327:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c62d80 with x1875064559543552 ext(0->5) 00002000:00010000:0.0:1788201276.552334:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c62d80 00000100:00100000:2.0:1788201276.552471:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559543680 00000100:00100000:2.0:1788201276.552476:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559543680 00002000:00100000:2.0:1788201276.552569:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x8:0x0] (0->5) req@ffff9624b9c61c00 x1875064559543680/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/0 e 0 to 0 dl 1788201287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201276.552580:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c61c00 with x1875064559543680 ext(0->5) 00002000:00010000:2.0:1788201276.552584:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c61c00 00000100:00100000:2.0:1788201276.552663:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:2.0:1788201276.552675:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559543552:12345-192.168.201.56@tcp:4:bash.0 00000100:00100000:1.0:1788201276.553646:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201276.553820:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559543552:12345-192.168.201.56@tcp:4:bash.0 Request processed in 1146us (1945us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788201276.553831:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 6 00002000:00100000:2.0:1788201276.553842:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7:0x0] (0->5) req@ffff9624b9c62d80 x1875064559543552/t12884901894(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/448 e 0 to 0 dl 1788201287 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201276.553852:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c62d80 with x1875064559543552 ext(0->5) 00002000:00010000:2.0:1788201276.553856:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c62d80 00000100:00100000:2.0:1788201276.553880:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559543936 00000100:00100000:2.0:1788201276.553894:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559543936 00002000:00100000:2.0:1788201276.553918:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa:0x0] (0->5) req@ffff9624b9c63100 x1875064559543936/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/0 e 0 to 0 dl 1788201287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201276.553927:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c63100 with x1875064559543936 ext(0->5) 00002000:00010000:2.0:1788201276.553930:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c63100 00000100:00100000:2.0:1788201276.553940:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559543808 00000100:00100000:2.0:1788201276.553943:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559543808 00002000:00100000:2.0:1788201276.553957:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (0->5) req@ffff9624b9c60a80 x1875064559543808/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/0 e 0 to 0 dl 1788201287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201276.553965:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c60a80 with x1875064559543808 ext(0->5) 00002000:00010000:2.0:1788201276.553968:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c60a80 00000100:00100000:2.0:1788201276.553978:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:2.0:1788201276.553986:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:2341:x1875064559543680:12345-192.168.201.56@tcp:4:bash.0 00000100:00100000:2.0:1788201276.559371:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+23:2341:x1875064559543680:12345-192.168.201.56@tcp:4:bash.0 Request processed in 5337us (7351us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788201276.559391:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 7 00002000:00100000:2.0:1788201276.559410:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x8:0x0] (0->5) req@ffff9624b9c61c00 x1875064559543680/t12884901895(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/448 e 0 to 0 dl 1788201287 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201276.559422:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c61c00 with x1875064559543680 ext(0->5) 00002000:00010000:2.0:1788201276.559429:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c61c00 00000100:00100000:2.0:1788201276.559477:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:2.0:1788201276.559506:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559543936:12345-192.168.201.56@tcp:4:bash.0 00000100:00100000:2.0:1788201276.560022:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559543936:12345-192.168.201.56@tcp:4:bash.0 Request processed in 523us (7818us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788201276.560038:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00002000:00100000:2.0:1788201276.560044:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa:0x0] (0->5) req@ffff9624b9c63100 x1875064559543936/t12884901896(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/448 e 0 to 0 dl 1788201287 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201276.560053:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c63100 with x1875064559543936 ext(0->5) 00002000:00010000:2.0:1788201276.560058:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c63100 00000100:00100000:2.0:1788201276.560073:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:2.0:1788201276.560082:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+23:2341:x1875064559543808:12345-192.168.201.56@tcp:4:bash.0 00000100:00100000:2.0:1788201276.561374:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:2341:x1875064559543808:12345-192.168.201.56@tcp:4:bash.0 Request processed in 1255us (7696us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788201276.561388:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00002000:00100000:2.0:1788201276.561400:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (0->5) req@ffff9624b9c60a80 x1875064559543808/t12884901897(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:397/0 lens 496/448 e 0 to 0 dl 1788201287 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201276.561411:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c60a80 with x1875064559543808 ext(0->5) 00002000:00010000:2.0:1788201276.561418:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c60a80 00000100:00100000:1.0:1788201276.561655:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201276.563630:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559544192 00000100:00100000:2.0:1788201276.563647:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559544192 00000100:00100000:2.0:1788201276.563818:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:2.0:1788201276.563832:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:13222:x1875064559544192:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:2.0:1788201276.564509:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+31:13222:x1875064559544192:12345-192.168.201.56@tcp:35:bash.0 Request processed in 676us (2852us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788201276.564520:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:3.0:1788201276.567756:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201276.567984:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559544448 00000100:00100000:1.0:1788201276.567998:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559544448 00000100:00100000:1.0:1788201276.568084:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 50 00000100:00100000:1.0:1788201276.568095:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+31:13222:x1875064559544448:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:1.0:1788201276.568131:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201276.568161:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb022 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999de expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.568564:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb029 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.568583:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb029 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.568597:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb029 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.568638:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb030 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.568647:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.568654:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201276.569986:0:5825:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc:0x0], index 0: 0 00010000:00010000:1.0:1788201276.570863:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3cb037 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.570886:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3cb037 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.570900:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3cb037 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.570946:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb029 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.570954:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb029 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.570962:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb029 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.570969:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201276.570974:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb029 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.570995:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb029 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.571073:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201276.571077:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201276.571084:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb029 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.571092:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb029 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201276.571110:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3bfebcb reply state 0000000087c90152 transno 4294967329 ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201276.571122:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201276.571176:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb022 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999de expref: 34 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.571270:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3cb037 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999de expref: 33 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.571278:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962487f56600) 00010000:00010000:1.0:1788201276.571281:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201276.571284:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac3800, rc 0) 00000100:00100000:1.0:1788201276.571517:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:13222:x1875064559544448:12345-192.168.201.56@tcp:101:bash.0 Request processed in 3422us (3776us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788201276.571527:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 50 00000100:00100000:1.0:1788201276.576105:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201276.577003:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559544576 00000100:00100000:2.0:1788201276.577028:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559544576 00000100:00100000:2.0:1788201276.577133:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:2.0:1788201276.577146:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:13222:x1875064559544576:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1788201276.577172:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201276.577217:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeb9d68a/0xa81c4c9a2f3cb045 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999e5 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.578279:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.578293:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb030 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.578301:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb030 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.578309:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3a00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201276.578314:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb030 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.578335:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb030 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.578370:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8d464a52 (ffff962487f56200) 00010000:00010000:0.0:1788201276.578374:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201276.578380:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb030 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.578388:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb030 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201276.579943:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201276.579983:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=408s v=(0 0) 00010000:00010000:2.0:1788201276.579989:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201276.580076:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb9d68a/0xa81c4c9a2f3cb045 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999e5 expref: 26 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.580107:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eeb9d68a/0xa81c4c9a2f3cb045 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999e5 expref: 26 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.580124:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5a00, rc 0) 00000100:00100000:2.0:1788201276.580408:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:13222:x1875064559544576:12345-192.168.201.56@tcp:101:bash.0 Request processed in 3261us (4314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201276.580419:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:1.0:1788201276.585329:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201276.585674:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559544832 00000100:00100000:0.0:1788201276.585688:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559544832 00000100:00100000:0.0:1788201276.585871:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:0.0:1788201276.585886:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+33:13222:x1875064559544832:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:0.0:1788201276.586834:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:13222:x1875064559544832:12345-192.168.201.56@tcp:35:bash.0 Request processed in 943us (1512us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788201276.586845:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:2.0:1788201276.590671:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201276.590820:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559545088 00000100:00100000:0.0:1788201276.590834:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559545088 00000100:00100000:0.0:1788201276.590929:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:0.0:1788201276.590940:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:13222:x1875064559545088:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1788201276.590973:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201276.590999:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb04c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999ec expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.591330:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb053 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.591408:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.591423:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.591443:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb05a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.591450:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.591456:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201276.592873:0:5826:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd:0x0], index 0: 0 00010000:00010000:0.0:1788201276.593811:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb061 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.593832:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb061 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.593845:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb061 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.593886:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.593894:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb053 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.593902:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.593921:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201276.593926:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.593935:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb053 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.593950:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:0.0:1788201276.593953:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201276.593958:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb053 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.593964:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb053 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201276.593981:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d18da777 reply state 000000009f143986 transno 4294967331 ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201276.593990:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201276.594572:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb04c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999ec expref: 37 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.594591:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb061 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999ec expref: 36 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201276.594599:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9624a8e9f600) 00010000:00010000:0.0:1788201276.594602:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201276.594604:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dfc00, rc 0) 00000100:00100000:0.0:1788201276.594707:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+37:13222:x1875064559545088:12345-192.168.201.56@tcp:101:bash.0 Request processed in 3761us (4044us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788201276.594726:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:1.0:1788201276.598577:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201276.598801:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559545216 00000100:00100000:0.0:1788201276.598816:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559545216 00000100:00100000:0.0:1788201276.598902:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:0.0:1788201276.598916:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:13222:x1875064559545216:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1788201276.598943:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201276.598974:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb06f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999f3 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.599394:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.599407:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb05a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.599416:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb05a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.599424:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201276.599430:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb05a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.599439:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb05a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.599462:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd049252 (ffff9624a8e9f300) 00010000:00010000:3.0:1788201276.599465:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201276.599472:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb05a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.599477:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb05a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201276.601789:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201276.601842:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1788201276.601849:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201276.601869:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb06f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999f3 expref: 27 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.601908:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb06f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999f3 expref: 27 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.601924:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dfa00, rc 0) 00000100:00100000:3.0:1788201276.602149:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+27:13222:x1875064559545216:12345-192.168.201.56@tcp:101:bash.0 Request processed in 3233us (3589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201276.602159:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:1.0:1788201276.606907:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201276.607079:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559545472 00000100:00100000:2.0:1788201276.607093:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559545472 00000100:00100000:2.0:1788201276.607205:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:2.0:1788201276.607245:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:13222:x1875064559545472:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:2.0:1788201276.607856:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+37:13222:x1875064559545472:12345-192.168.201.56@tcp:35:bash.0 Request processed in 636us (962us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788201276.607891:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00010000:00010000:1.0:1788201277.174651:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201278.007388:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570073472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201278.007508:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201278.007517:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570073856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201278.007564:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201278.007615:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570073984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201278.007621:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788201278.007630:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570073728:0@lo:400:kworker.0 00000100:00100000:1.0:1788201278.007652:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201278.007683:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201278.007688:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570073856 00000100:00100000:1.0:1788201278.007689:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570073600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201278.007699:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570073856 00000100:00100000:1.0:1788201278.007726:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201278.007758:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570074112:0@lo:400:kworker.0 00000100:00100000:1.0:1788201278.007783:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201278.007796:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570074112 00000100:00100000:3.0:1788201278.007801:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570074112 00000100:00100000:1.0:1788201278.007826:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570073472 00000100:00100000:1.0:1788201278.007833:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570073472 00000100:00100000:3.0:1788201278.007843:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201278.007856:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570073856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201278.007873:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788201278.007883:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570073984 00000100:00100000:1.0:1788201278.007883:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875064570073472:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201278.007888:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570073984 00002000:00000024:1.0:1788201278.007926:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201278.007926:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570073856:12345-0@lo:400:kworker.0 Request processed in 72us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201278.007929:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788201278.007941:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788201278.007945:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570073984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201278.007969:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875064570073472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201278.007975:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788201278.007981:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570073984:12345-0@lo:400:kworker.0 Request processed in 43us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201278.007987:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788201278.008010:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201278.008013:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570073600 00000100:00100000:1.0:1788201278.008017:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570073600 00000100:00100000:0.0:1788201278.008032:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570074240:0@lo:400:kworker.0 00000100:00100000:1.0:1788201278.008042:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788201278.008047:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570073600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201278.008055:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201278.008088:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000004:00080000:0.0:1788201278.008095:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9624b9c61180, transno 12884901890 00000100:00100000:0.0:1788201278.008111:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570073856:0@lo:400:kworker.0 00000100:00100000:0.0:1788201278.008140:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570073728 00000100:00100000:0.0:1788201278.008143:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570073728 00000100:00100000:0.0:1788201278.008165:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570074240 00000100:00100000:0.0:1788201278.008167:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570074240 00000100:00100000:0.0:1788201278.008233:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788201278.008239:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570073728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201278.008377:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201278.008387:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570074112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201278.011206:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570073600:12345-0@lo:400:kworker.0 Request processed in 3133us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201278.011250:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:2.0:1788201278.012559:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201278.012572:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201278.012575:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201278.014521:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788201278.014559:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570074240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201278.014732:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570074240:12345-0@lo:400:kworker.0 Request processed in 195us (6675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201278.014740:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788201278.014838:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570073600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201278.014862:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570073984:0@lo:400:kworker.0 00010000:00080000:2.0:1788201278.014883:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c9c4a80 x1875064570073472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.014908:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570073472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201278.018881:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570074240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201278.019024:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570073728:12345-0@lo:400:kworker.0 Request processed in 10779us (11007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201278.019039:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788201278.019368:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570073728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201278.020453:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570074112:12345-0@lo:400:kworker.0 Request processed in 12059us (12659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201278.020484:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:3.0:1788201278.020561:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba473100 x1875064570074112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201278.020576:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570074112:0@lo:400:kworker.0 00000001:00080000:0.0:1788201278.071376:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967331 is committed 00000001:00080000:0.0:1788201278.071427:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967332 is committed 00010000:00010000:1.0:1788201278.198779:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201278.261586:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201278.261643:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201278.261681:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201278.261727:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201278.261749:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559545856 00000100:00100000:3.0:1788201278.261767:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559545856 00000100:00100000:1.0:1788201278.261778:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559545728 00000100:00100000:2.0:1788201278.261783:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559545600 00000100:00100000:1.0:1788201278.261788:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559545728 00000100:00100000:2.0:1788201278.261794:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559545600 00000100:00100000:2.0:1788201278.261881:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 345 00000100:00100000:1.0:1788201278.261893:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 190 00000100:00100000:3.0:1788201278.261898:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559545984 00000100:00100000:2.0:1788201278.261903:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559545600:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201278.261907:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559545984 00000100:00100000:1.0:1788201278.261916:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2342:x1875064559545728:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201278.261949:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 105 00000100:00100000:3.0:1788201278.261961:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+27:2342:x1875064559545856:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201278.262007:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559545600:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 115us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201278.262010:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2342:x1875064559545728:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 99us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201278.262040:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 190 00000100:00100000:2.0:1788201278.262041:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 345 00000100:00100000:1.0:1788201278.262086:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 106 00000100:00080000:2.0:1788201278.262096:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201278.262115:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201278.262118:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201278.262237:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559545984:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201278.262273:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559545984:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 179us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201278.262281:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 106 00000100:00100000:3.0:1788201278.262423:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+27:2342:x1875064559545856:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 463us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201278.262431:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 105 00000020:01000004:2.0:1788201278.568387:0:14886:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788201278.569281:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201278.569299:0:14886:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201278.569306:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201278.569314:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201278.569369:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201278.569375:0:14886:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788201278.569408:0:14886:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1788201278.569513:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201278.569521:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.569529:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7d200 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201278.569532:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.569558:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201278.569565:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201278.569571:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201278.569574:0:5814:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788201278.569576:0:5814:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788201278.569612:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.569618:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201278.569699:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788201278.569721:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.569728:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d200/0xa81c4c9a2f3cae62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cae69 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.569741:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201278.569743:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201278.569745:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201278.570508:0:14886:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201278.570520:0:14886:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201278.570539:0:14886:0:(import.c:65:import_set_state_nolock()) ffff9624c1cec000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201278.570683:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570074496:0@lo:39:umount.0 00000100:00100000:1.0:1788201278.570753:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201278.571371:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570074496 00000100:00100000:2.0:1788201278.571380:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570074496 00000100:00100000:2.0:1788201278.571443:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201278.571453:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875064570074496:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201278.571480:0:6693:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cae7e 00000100:00080000:2.0:1788201278.571490:0:6693:0:(import.c:65:import_set_state_nolock()) ffff962485918800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201278.571555:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+1:3281:x1875064570074496:12345-0@lo:39:umount.0 Request processed in 103us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201278.571563:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000020:00000080:2.0:1788201278.571583:0:6693:0:(genops.c:906:class_export_put()) final put ffff96248591d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788201278.571705:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96248591d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788201278.571760:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff962485918800 for lustre-MDT0000 00010000:00010000:1.0:1788201278.571817:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201278.571848:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9624c1cec000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788201278.571867:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570074496:0@lo:39:umount.0 00000100:00080000:0.0:1788201278.571923:0:14886:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201278.571926:0:14886:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788201278.571930:0:14886:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788201278.573625:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201278.573643:0:14886:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201278.573651:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201278.573658:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201278.573711:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201278.573719:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201278.573742:0:14886:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201278.573747:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201278.573753:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201278.573828:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570074368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201278.573891:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201278.573948:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570074368 00000100:00100000:3.0:1788201278.573955:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570074368 00000100:00100000:3.0:1788201278.574013:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201278.574022:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba473100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570074368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201278.574036:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201278.574054:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962498ac3e00/0xa81c4c9a2f3cae69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cae62 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201278.574068:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201278.574115:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba473100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3284:x1875064570074368:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201278.574128:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201278.574172:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570074368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201278.580118:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201278.580152:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.580166:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5800 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201278.580170:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.580181:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201278.580199:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201278.580206:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201278.580214:0:5814:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788201278.580264:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.580271:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201278.580379:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788201278.580424:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.580432:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624829c5800/0xa81c4c9a2f3cae2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cae31 expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.580449:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201278.580452:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.580458:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c4800 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201278.580461:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.580474:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201278.580480:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201278.580486:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788201278.580488:0:5814:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788201278.580502:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.580508:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201278.580838:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201278.580860:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570074752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201278.580927:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201278.580994:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570074752 00000100:00100000:3.0:1788201278.581001:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570074752 00000100:00100000:3.0:1788201278.581053:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788201278.581062:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3282:x1875064570074752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201278.581086:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201278.581102:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962498ac3400/0xa81c4c9a2f3cae5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cae54 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201278.581116:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201278.581149:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3282:x1875064570074752:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201278.581156:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788201278.581219:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570074752:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201278.585726:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:0.0:1788201278.585741:0:14886:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788201278.585746:0:14886:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788201278.585749:0:14886:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788201278.585782:0:14886:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788201278.585786:0:14886:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:0.0:1788201278.585796:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788201278.585802:0:14886:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00000100:00100000:2.0:1788201278.586245:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570074624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201278.586324:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201278.588104:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570074624 00000100:00100000:2.0:1788201278.588116:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570074624 00000100:00100000:2.0:1788201278.588181:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201278.588203:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3283:x1875064570074624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201278.588219:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201278.588239:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962498ac3600/0xa81c4c9a2f3cae31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cae2a expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201278.588261:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201278.588324:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3283:x1875064570074624:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201278.588331:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201278.588387:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570074624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201278.588597:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.588607:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624829c4800/0xa81c4c9a2f3cae54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cae5b expref: -99 pid: 13886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.588622:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201278.588624:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000080:0.0:1788201278.591690:0:14886:0:(ofd_obd.c:1269:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:0.0:1788201278.591734:0:14886:0:(ofd_obd.c:1283:ofd_iocontrol()) syncing ost lustre-OST0000 00010000:00010000:3.0:1788201278.592063:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201278.595064:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201278.696072:0:13974:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00000001:00080000:0.0:1788201278.696115:0:13974:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901897 is committed 00000020:00000080:3.0:1788201278.757315:0:14886:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788201278.757334:0:14886:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9624bc8f5800 986744c8-ee81-4a47-8d91-97f81ede1f3e 192.168.201.56@tcp 14 (0 0 10) 0 0 0 0: 0000000000000000 12884901897 stale:0 00000020:00080000:3.0:1788201278.757357:0:14886:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9624bc8f7000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 12884901890 stale:0 00000020:00080000:3.0:1788201278.757362:0:14886:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff962487fc19c0) has exports, disconnecting them 00000020:00080000:3.0:1788201278.757368:0:14886:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.201.56@tcp (ffff9624bc8f5800), last request at 1788201278 00000020:00000080:3.0:1788201278.757389:0:14886:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cae4d 00000020:00010000:3.0:1788201278.757607:0:14886:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9624bc8f5800: total 0 00000100:00080000:3.0:1788201278.757612:0:14886:0:(import.c:65:import_set_state_nolock()) ffff9624a8a8b800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201278.757746:0:14886:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.56@tcp (ffff9624bc8f5800): rc 0 00000020:00080000:3.0:1788201278.757750:0:14886:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9624bc8f7000), last request at 1788201278 00000020:00000080:3.0:1788201278.757754:0:14886:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cae46 00000100:00080000:3.0:1788201278.757760:0:14886:0:(import.c:65:import_set_state_nolock()) ffff962487d48000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1788201278.760920:0:5813:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9624bc8f5800: total 0 00010000:00010000:1.0:1788201278.761159:0:5813:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9624bc8f5800, canceled 0 locks, left on hash table 10. 00002000:00010000:1.0:1788201278.761226:0:5813:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:1.0:1788201278.761230:0:5813:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761233:0:5813:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761235:0:5813:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788201278.761263:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3caef5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99975 expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.761329:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb06f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999f3 expref: 10 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201278.761630:0:5813:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:1.0:1788201278.761634:0:5813:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761637:0:5813:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761639:0:5813:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788201278.761651:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9d61ab1/0xa81c4c9a2f3caf1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99983 expref: 9 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201278.761670:0:5813:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:1.0:1788201278.761672:0:5813:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761674:0:5813:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761676:0:5813:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788201278.761683:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052260eb2/0xa81c4c9a2f3caf73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9999f expref: 8 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201278.761699:0:5813:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:1.0:1788201278.761702:0:5813:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761704:0:5813:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761706:0:5813:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788201278.761714:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3caf9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999ad expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201278.761728:0:5813:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:1.0:1788201278.761737:0:5813:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761739:0:5813:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761741:0:5813:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788201278.761750:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3caf49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99991 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201278.761765:0:5813:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:1.0:1788201278.761768:0:5813:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761770:0:5813:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761772:0:5813:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788201278.761779:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3caff1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999c9 expref: 5 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201278.761794:0:5813:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:1.0:1788201278.761797:0:5813:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761798:0:5813:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1788201276 00002000:00010000:1.0:1788201278.761800:0:5813:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788201278.761807:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054eef2ef/0xa81c4c9a2f3cafc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999bb expref: 4 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.761825:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffbd6ff6/0xa81c4c9a2f3cb01b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999d7 expref: 3 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.761845:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeb9d68a/0xa81c4c9a2f3cb045 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999e5 expref: 2 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201278.761859:0:5813:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9624bc8f5800, canceled 10 locks, left on hash table 0. 00000020:00080000:3.0:1788201278.764640:0:14886:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9624bc8f7000): rc 0 00000020:00000080:3.0:1788201278.764650:0:14886:0:(genops.c:906:class_export_put()) final put ffff9624bc8f7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201278.764699:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9624bc8f7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788201278.764774:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff962487d48000 for lustre-OST0000 00000020:00080000:3.0:1788201278.764824:0:14886:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff962487fc19c0) has no exports 00000020:00000080:1.0:1788201278.766437:0:5813:0:(genops.c:906:class_export_put()) final put ffff9624bc8f5800/986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:1.0:1788201278.766478:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9624bc8f5800/986744c8-ee81-4a47-8d91-97f81ede1f3e for lustre-OST0000 00000020:00000080:1.0:1788201278.767267:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9624a8a8b800 for lustre-OST0000 00010000:00010000:1.0:1788201278.767289:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201278.767292:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201278.767295:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201278.767608:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788201278.772782:0:14886:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96249856e960 - data ffff9624c06636c0/ffff9624c180c800 00000020:01000000:3.0:1788201278.772941:0:14886:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff962483383240 - data ffff962493aac0d8/ffff9624c1ce3800 00100000:10000000:1.0:1788201278.807243:0:14886:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788201278.846106:0:14886:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cae3f 00000020:00000080:3.0:1788201278.846117:0:14886:0:(genops.c:906:class_export_put()) final put ffff96248591e000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788201278.846135:0:14886:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962381a3a800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788201278.846139:0:14886:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962381a3a800 2 00000020:01000004:3.0:1788201278.846142:0:14886:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff962381a3a800 from lustre-OST0000 00000020:00000080:3.0:1788201278.846165:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201278.846176:0:14886:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788201278.846179:0:14886:0:(genops.c:906:class_export_put()) final put ffff96248591b800/lustre-OST0000_UUID 00000020:00000080:3.0:1788201278.846194:0:14886:0:(genops.c:865:class_export_destroy()) destroying export ffff96248591b800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788201278.846203:0:14886:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788201278.846248:0:14886:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788201278.846253:0:14886:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788201278.846257:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201278.846262:0:14886:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788201278.846270:0:14886:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9624c1cec800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201278.846276:0:14886:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff96248729cd40) has exports, disconnecting them 00000020:00080000:3.0:1788201278.846283:0:14886:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9624c1cec800), last request at 1788201246 00000020:00000080:3.0:1788201278.846304:0:14886:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cae77 00000020:00080000:3.0:1788201278.846315:0:14886:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9624c1cec800): rc 0 00000020:00000080:3.0:1788201278.846319:0:14886:0:(genops.c:906:class_export_put()) final put ffff9624c1cec800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788201278.846485:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248591e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788201278.846493:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9624c1cec800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788201278.849815:0:14886:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788201278.849824:0:14886:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201278.849828:0:14886:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788201278.849835:0:14886:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201278.849983:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201278.849994:0:14886:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788201278.850000:0:14886:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962381a3a800 1 00000020:00000080:2.0:1788201278.850007:0:14886:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cae23 00000020:00000080:2.0:1788201278.850015:0:14886:0:(genops.c:906:class_export_put()) final put ffff9624bc8f1000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788201278.850020:0:14886:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788201278.850025:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201278.850043:0:14886:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201278.850047:0:14886:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff962487eb0000) has no exports 00000020:00000080:1.0:1788201278.850728:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9624c1cec000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788201278.850736:0:8:0:(genops.c:906:class_export_put()) final put ffff962484f31000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788201278.850739:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff962484f31000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788201278.850747:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788201278.850830:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9624bc8f1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788201278.876692:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201278.876710:0:14886:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788201278.876716:0:14886:0:(genops.c:906:class_export_put()) final put ffff962381a3c000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788201278.876720:0:14886:0:(genops.c:865:class_export_destroy()) destroying export ffff962381a3c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788201278.876728:0:14886:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788201278.876879:0:14886:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff962381a3d000 00000020:02000400:1.0:1788201278.876943:0:14886:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788201279.229192:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201279.542560:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570074880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201279.542645:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201279.542762:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570074880 00000100:00100000:3.0:1788201279.542771:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570074880 00000100:00100000:3.0:1788201279.542820:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201279.542827:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3284:x1875064570074880:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:3.0:1788201279.542835:0:6673:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788201279.542877:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3284:x1875064570074880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (233us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201279.542884:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:02020000:3.0:1788201279.542926:0:3284:0:(client.c:1492:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788201279.547300:0:3284:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788201279.547310:0:3284:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201279.547315:0:3284:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1788201279.574770:0:3284:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1788201279.574780:0:3284:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201279.574790:0:3284:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 380 00000100:00080000:3.0:1788201279.574799:0:3284:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788201279.577176:0:3284:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96248c9c7800 x1875064570075008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201279.577318:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570075008:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:1.0:1788201279.577509:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201279.578065:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570075008 00000100:00100000:0.0:1788201279.578074:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570075008 00000100:00100000:0.0:1788201279.578121:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788201279.578129:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570075008:12345-0@lo:8:ptlrpcd_00_02.0 00010000:00020000:0.0:1788201279.578150:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201279.609551:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570075008:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 31413us (32033us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201279.609565:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788201279.609615:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201279.609621:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201279.609625:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570075008:0@lo:8:ptlrpcd_00_02.0 00010000:00010000:2.0:1788201280.246765:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201281.270772:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201281.332182:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201281.332229:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201281.332325:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559546112 00000100:00100000:0.0:1788201281.332336:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559546112 00000100:00100000:0.0:1788201281.332458:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:3.0:1788201281.332464:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559546240 00000100:00100000:0.0:1788201281.332471:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0+-99:2341:x1875064559546112:12345-192.168.201.56@tcp:4:bash.0 00000100:00100000:3.0:1788201281.332471:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559546240 00000020:00080000:0.0:1788201281.332482:0:6674:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.201.56@tcp 00000100:00100000:3.0:1788201281.332513:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 65 00000100:00100000:3.0:1788201281.332520:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1875064559546240:12345-192.168.201.56@tcp:16:kworker.0 00000020:00080000:3.0:1788201281.332527:0:6668:0:(tgt_handler.c:807:tgt_request_handle()) operation 16 on unconnected OST from 12345-192.168.201.56@tcp 00000100:00100000:0.0:1788201281.332558:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0+-99:2341:x1875064559546112:12345-192.168.201.56@tcp:4:bash.0 Request processed in 88us (326us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201281.332568:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:3.0:1788201281.332571:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1875064559546240:12345-192.168.201.56@tcp:16:kworker.0 Request processed in 47us (397us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201281.332579:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 65 00000100:00100000:1.0:1788201281.352521:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201281.353054:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559546368 00000100:00100000:2.0:1788201281.353066:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559546368 00000100:00100000:2.0:1788201281.353121:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 66 00000100:00100000:2.0:1788201281.353131:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875064559546368:12345-192.168.201.56@tcp:8:ptlrpcd_00_00.0 00010000:00020000:2.0:1788201281.353164:0:6671:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201281.353235:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875064559546368:12345-192.168.201.56@tcp:8:ptlrpcd_00_00.0 Request processed in 104us (725us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201281.353248:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 66 00010000:00010000:2.0:1788201282.304924:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201283.126636:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201283.126644:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:3.0:1788201283.126701:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570075136:0@lo:400:kworker.0 00000100:00100000:3.0:1788201283.126778:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201283.126917:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570075136 00000100:00100000:0.0:1788201283.126925:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570075136 00000100:00100000:3.0:1788201283.127117:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570075264:0@lo:400:kworker.0 00000100:00100000:3.0:1788201283.127150:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201283.127176:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201283.127182:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570075392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201283.127208:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201283.127236:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570075264 00000100:00100000:3.0:1788201283.127240:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570075264 00000100:00100000:3.0:1788201283.127272:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788201283.127281:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570075264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201283.127335:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570075264:12345-0@lo:400:kworker.0 Request processed in 55us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201283.127362:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788201283.127391:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570075392 00000100:00100000:3.0:1788201283.127396:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570075392 00000100:00100000:3.0:1788201283.127429:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788201283.127436:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570075392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201283.127465:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201283.127496:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570075392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201283.127503:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1788201283.127540:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248c9c7800 x1875064570075392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201283.127567:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570075392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201283.127583:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570075264:0@lo:400:kworker.0 00000100:00080000:3.0:1788201283.127628:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201283.128209:0:8:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788201283.128262:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788201283.128278:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570075136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201283.128331:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570075136:12345-0@lo:400:kworker.0 Request processed in 59us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201283.128338:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788201283.128398:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570075136:0@lo:400:kworker.0 00000100:00080000:1.0:1788201283.129337:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:1.0:1788201283.129359:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201283.129366:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201283.129843:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624bfd2df80 x1875064570075520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201283.129993:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570075520:0@lo:8:kworker.0 00000100:00100000:2.0:1788201283.130051:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201283.130240:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570075520 00000100:00100000:2.0:1788201283.130247:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570075520 00000100:00100000:2.0:1788201283.130284:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788201283.130290:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875064570075520:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788201283.130309:0:6668:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201283.130364:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875064570075520:12345-0@lo:8:kworker.0 Request processed in 71us (312us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201283.130370:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788201283.130570:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201283.130576:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201283.130580:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570075520:0@lo:8:kworker.0 00000100:00100000:2.0:1788201283.130757:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201283.130767:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570075648:0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.130801:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201283.130829:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570075648 00000100:00100000:2.0:1788201283.130833:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570075648 00000100:00100000:2.0:1788201283.130869:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788201283.130876:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570075648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.131100:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570075648:12345-0@lo:400:kworker.0 Request processed in 223us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201283.131115:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:2.0:1788201283.131136:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201283.131159:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570075648:0@lo:400:kworker.0 00010000:00010000:2.0:1788201283.318987:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201283.396310:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201283.396673:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559546752 00000100:00100000:0.0:1788201283.396683:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559546752 00000100:00100000:0.0:1788201283.396749:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 68 00000100:00100000:0.0:1788201283.396759:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559546752:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:0.0:1788201283.396796:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201283.396873:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559546752:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 115us (573us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201283.396880:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 68 00000100:00100000:3.0:1788201283.397055:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201283.397162:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201283.397236:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559546496 00000100:00100000:2.0:1788201283.397241:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559546496 00000100:00100000:2.0:1788201283.397278:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 347 00000100:00100000:2.0:1788201283.397284:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559546496:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201283.397325:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559546496:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 41us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201283.397331:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 347 00000100:00100000:0.0:1788201283.402591:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559546880 00000100:00100000:0.0:1788201283.402609:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559546880 00000100:00100000:0.0:1788201283.402694:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 107 00000100:00100000:0.0:1788201283.402705:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559546880:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201283.402799:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559546880:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 96us (5637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201283.402806:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 107 00000100:00080000:2.0:1788201283.403719:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201283.409308:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201283.409423:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559546624 00000100:00100000:3.0:1788201283.409432:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559546624 00000100:00100000:3.0:1788201283.409531:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 193 00000100:00100000:3.0:1788201283.409543:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2344:x1875064559546624:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201283.409654:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2344:x1875064559546624:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 114us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201283.409661:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 193 00000100:00080000:2.0:1788201283.409971:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201284.342603:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201285.366681:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201286.390630:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201287.414580:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201288.247258:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201288.247287:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570075776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201288.247397:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201288.247686:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201288.247690:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788201288.247694:0:36:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201288.247700:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 415 00000100:00080000:3.0:1788201288.247705:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201288.247711:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1788201288.247734:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96248517dc00 x1875064570076160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201288.247774:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570076032:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.247830:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.247857:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201288.247881:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570075904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.247925:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.247954:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570076160:0@lo:8:kworker.0 00000100:00100000:3.0:1788201288.247976:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.248004:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570076032 00000100:00100000:3.0:1788201288.248010:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570076032 00000100:00100000:3.0:1788201288.248088:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788201288.248097:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570076032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.248150:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570076032:12345-0@lo:400:kworker.0 Request processed in 54us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.248156:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788201288.248177:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201288.248184:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570076288:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.248216:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.248257:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570076032:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.248275:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570076288 00000100:00100000:3.0:1788201288.248277:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570076288 00000100:00100000:3.0:1788201288.248307:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788201288.248312:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570076288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.248364:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570076288:12345-0@lo:400:kworker.0 Request processed in 52us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.248370:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:3.0:1788201288.248384:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201288.248402:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570076288:0@lo:400:kworker.0 00000100:00100000:0.0:1788201288.248571:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570075904 00000100:00100000:0.0:1788201288.248576:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570075904 00000100:00100000:0.0:1788201288.248609:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788201288.248635:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3283:x1875064570075904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201288.248675:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3283:x1875064570075904:12345-0@lo:400:kworker.0 Request processed in 41us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201288.248681:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788201288.248708:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570076160 00000100:00100000:0.0:1788201288.248711:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570076160 00000100:00100000:0.0:1788201288.248731:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201288.248735:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570076160:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788201288.248759:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201288.248797:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570076160:12345-0@lo:8:kworker.0 Request processed in 60us (819us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201288.248802:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788201288.249259:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570075776 00000100:00100000:1.0:1788201288.249270:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570075776 00000100:00100000:1.0:1788201288.249323:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788201288.249332:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570075776:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201288.249338:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1788201288.249380:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201288.249433:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570075776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (2036us total) trans 0 rc 0/0 00000100:00080000:3.0:1788201288.249434:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201288.249439:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201288.249449:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570076160:0@lo:8:kworker.0 00000100:00100000:1.0:1788201288.249451:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788201288.249477:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570075904:0@lo:400:kworker.0 00010000:00080000:2.0:1788201288.249538:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248c9c4e00 x1875064570075776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201288.249555:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570075776:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201288.439777:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201288.507058:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201288.507102:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201288.507136:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201288.507171:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201288.507245:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559547136 00000100:00100000:1.0:1788201288.507257:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559547136 00000100:00100000:1.0:1788201288.507335:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 196 00000100:00100000:1.0:1788201288.507372:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2342:x1875064559547136:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201288.507443:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2342:x1875064559547136:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 74us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201288.507449:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 196 00000100:00080000:0.0:1788201288.507649:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201288.507712:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559547392 00000100:00100000:2.0:1788201288.507718:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559547392 00000100:00100000:2.0:1788201288.507769:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559547264 00000100:00100000:2.0:1788201288.507772:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559547264 00000100:00100000:2.0:1788201288.507791:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 108 00000100:00100000:2.0:1788201288.507812:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559547392:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201288.507843:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559547392:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 34us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201288.507850:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 108 00000100:00100000:2.0:1788201288.507862:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00100000:2.0:1788201288.507867:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875064559547264:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:2.0:1788201288.507886:0:6670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201288.507909:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875064559547264:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 40us (738us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201288.507915:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00080000:0.0:1788201288.508205:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201288.508308:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559547008 00000100:00100000:3.0:1788201288.508314:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559547008 00000100:00100000:3.0:1788201288.508377:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 349 00000100:00100000:3.0:1788201288.508385:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559547008:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201288.508429:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559547008:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 45us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.508437:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 349 00010000:00010000:2.0:1788201289.462664:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201290.486615:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201291.526319:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201292.541515:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201293.367874:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201293.367896:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570076416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201293.367984:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201293.368060:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570076416 00000100:00100000:3.0:1788201293.368069:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570076416 00000100:00100000:3.0:1788201293.368282:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201293.368295:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570076416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201293.368335:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201293.368538:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570076416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 246us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201293.368545:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1788201293.371336:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201293.371356:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201293.371360:0:8:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201293.371369:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:0.0:1788201293.371374:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788201293.371381:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788201293.371407:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624b9d60e00 x1875064570076800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201293.371455:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201293.371472:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570076544:0@lo:400:kworker.0 00000100:00100000:0.0:1788201293.371543:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201293.371596:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201293.371602:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570076672:0@lo:400:kworker.0 00000100:00100000:0.0:1788201293.371633:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201293.371664:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570076800:0@lo:8:kworker.0 00000100:00100000:0.0:1788201293.371688:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201293.371731:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570076544 00000100:00100000:0.0:1788201293.371747:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570076544 00000100:00100000:0.0:1788201293.371792:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788201293.371800:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570076544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201293.371849:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570076544:12345-0@lo:400:kworker.0 Request processed in 50us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201293.371855:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788201293.371884:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570076672 00000100:00100000:0.0:1788201293.371887:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570076672 00000100:00100000:0.0:1788201293.371911:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788201293.371917:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570076672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201293.371957:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570076672:12345-0@lo:400:kworker.0 Request processed in 41us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201293.371964:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788201293.371981:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570076800 00000100:00100000:0.0:1788201293.371984:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570076800 00000100:00100000:0.0:1788201293.372005:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201293.372010:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570076800:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788201293.372027:0:6670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201293.372058:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570076800:12345-0@lo:8:kworker.0 Request processed in 47us (369us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201293.372065:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201293.372106:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570076672:0@lo:400:kworker.0 00000100:00100000:0.0:1788201293.372117:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570076544:0@lo:400:kworker.0 00000100:00080000:0.0:1788201293.372337:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201293.372371:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201293.372375:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570076800:0@lo:8:kworker.0 00000100:00100000:0.0:1788201293.372412:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201293.372421:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570076928:0@lo:400:kworker.0 00000100:00100000:0.0:1788201293.372447:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201293.372478:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570076928 00000100:00100000:0.0:1788201293.372482:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570076928 00000100:00100000:0.0:1788201293.372519:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788201293.372526:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570076928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201293.372565:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570076928:12345-0@lo:400:kworker.0 Request processed in 40us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201293.372571:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1788201293.372586:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201293.372610:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570076928:0@lo:400:kworker.0 00010000:00080000:2.0:1788201293.377503:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624bfe6b800 x1875064570076416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201293.377539:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570076416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201293.559632:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201293.629772:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201293.629814:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201293.629839:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201293.629869:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201293.629909:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559547776 00000100:00100000:0.0:1788201293.629920:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559547776 00000100:00100000:0.0:1788201293.629971:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559547904 00000100:00100000:0.0:1788201293.629974:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559547904 00000100:00100000:0.0:1788201293.630011:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 72 00000100:00100000:0.0:1788201293.630020:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559547776:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:0.0:1788201293.630050:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201293.630120:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559547776:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 100us (359us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201293.630128:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 72 00000100:00100000:0.0:1788201293.630155:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 73 00000100:00100000:0.0:1788201293.630162:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559547904:12345-192.168.201.56@tcp:9:kworker.0 00000020:00000080:0.0:1788201293.630187:0:8088:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3caea8 00000100:00080000:0.0:1788201293.630195:0:8088:0:(import.c:65:import_set_state_nolock()) ffff9624c1ce9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201293.630227:0:8088:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788201293.630560:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+2:2340:x1875064559547904:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 397us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201293.630567:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 73 00000100:00100000:0.0:1788201293.630587:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559547648 00000100:00100000:0.0:1788201293.630590:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559547648 00000100:00100000:0.0:1788201293.630630:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 199 00000100:00100000:0.0:1788201293.630638:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2342:x1875064559547648:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201293.630666:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2342:x1875064559547648:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 30us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201293.630673:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 199 00000100:00100000:0.0:1788201293.630690:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559547520 00000100:00100000:0.0:1788201293.630694:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559547520 00000100:00100000:0.0:1788201293.630715:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 351 00000100:00100000:0.0:1788201293.630721:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559547520:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201293.630743:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559547520:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 22us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201293.630748:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 351 00000100:00080000:0.0:1788201293.630775:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201293.630778:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201293.630893:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201294.583588:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201295.613918:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201296.526202:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:1.0:1788201296.526273:0:7629:0:(genops.c:906:class_export_put()) final put ffff9624c1ceb000/986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:2.0:1788201296.526670:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9624c1ceb000/986744c8-ee81-4a47-8d91-97f81ede1f3e for lustre-OST0001 00000020:00000080:2.0:1788201296.526712:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9624c1ce9000 for lustre-OST0001 00010000:00010000:1.0:1788201296.630724:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201297.650701:0:15337:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201297.650706:0:15337:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788201297.650843:0:15337:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9624857c5000 00000020:01000004:3.0:1788201297.650868:0:15337:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788201297.650882:0:15337:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788201297.650901:0:15337:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9624909d99c0) 00000020:00000080:3.0:1788201297.650917:0:15337:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00010000:00010000:3.0:1788201297.655011:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788201297.706577:0:15337:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788201297.707778:0:15337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788201297.710624:0:15337:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788201297.712469:0:15337:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788201297.713560:0:15337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xc:0x0] (8/32) 00100000:10000000:3.0:1788201297.715111:0:15337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 529: rc = 0 00100000:10000000:3.0:1788201297.715806:0:15337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:3.0:1788201297.715920:0:15337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 529: rc = 0 00100000:10000000:2.0:1788201297.735131:0:15337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 377: rc = 0 00100000:10000000:2.0:1788201297.737790:0:15337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 377: rc = 0 00100000:10000000:3.0:1788201297.739033:0:15337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 377: rc = 0 00100000:10000000:3.0:1788201297.740694:0:15337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 377: rc = 0 00100000:10000000:2.0:1788201297.742987:0:15337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 377: rc = 0 00100000:10000000:2.0:1788201297.744257:0:15337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 377: rc = 0 00000020:00000080:0.0:1788201297.762111:0:15337:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788201297.762130:0:15337:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788201297.762146:0:15337:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3cb07d 00000020:01000004:0.0:1788201297.762154:0:15337:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788201297.762176:0:15337:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.156@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788201297.762180:0:15337:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788201297.762186:0:15337:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788201297.762210:0:15337:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788201297.762214:0:15337:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788201297.803129:0:15337:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788201297.803194:0:15337:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.156@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788201297.803199:0:15337:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788201297.803201:0:15337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201297.803203:0:15337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201297.803204:0:15337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201297.803205:0:15337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201297.803206:0:15337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201297.803208:0:15337:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201297.803210:0:15337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201297.803211:0:15337:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201297.803215:0:15337:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788201297.803217:0:15337:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201297.803219:0:15337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201297.803220:0:15337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201297.803221:0:15337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201297.803222:0:15337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201297.803223:0:15337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201297.803224:0:15337:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201297.803226:0:15337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201297.803227:0:15337:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201297.803257:0:15337:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788201297.803280:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077056:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201297.803700:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.803755:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9e72c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.803917:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570077056 00000100:00100000:0.0:1788201297.803927:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570077056 00000100:00100000:0.0:1788201297.803988:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788201297.803998:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:15337:x1875064570077056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201297.804035:0:5819:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788201297.804038:0:5819:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788201297.804042:0:5819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788201297.814546:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:15337:x1875064570077056:12345-0@lo:253:mount.lustre.0 Request processed in 10539us (10837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.814565:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788201297.814828:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077056:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201297.814848:0:15337:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788201297.814875:0:15337:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201297.814877:0:15337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201297.814878:0:15337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201297.814879:0:15337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201297.814880:0:15337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201297.814882:0:15337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201297.814883:0:15337:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201297.814885:0:15337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201297.814886:0:15337:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788201297.814908:0:15337:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9624857c5000 from lustre-OST0000 10000000:01000000:2.0:1788201297.814939:0:15337:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788201297.814942:0:15337:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788201297.814949:0:15337:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962485b40000 local copy 00010000:00010000:2.0:1788201297.814959:0:15337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201297.815402:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201297.815448:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.815478:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485952f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.815545:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570077184 00000100:00100000:0.0:1788201297.815552:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570077184 00000100:00100000:0.0:1788201297.815594:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788201297.815602:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:15337:x1875064570077184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201297.815978:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:15337:x1875064570077184:12345-0@lo:501:mount.lustre.0 Request processed in 374us (529us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201297.815985:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788201297.816112:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077184:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788201297.816127:0:15337:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788201297.816791:0:15337:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788201297.816801:0:15337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.816812:0:15337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201297.816836:0:15337:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9624857c5000 10000000:01000000:3.0:1788201297.816840:0:15337:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788201297.816845:0:15337:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788201297.816848:0:15337:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201297.816869:0:15337:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788201297.816879:0:15337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201297.816911:0:15337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.816919:0:15337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.816929:0:15337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.816948:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077312:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201297.817003:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.817032:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c9e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.818237:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570077312 00000100:00100000:0.0:1788201297.818249:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570077312 00000100:00100000:0.0:1788201297.818313:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788201297.818322:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:15337:x1875064570077312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201297.818384:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201297.818401:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624ba4de800/0xa81c4c9a2f3cb08b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb084 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.818426:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624ba4de800/0xa81c4c9a2f3cb08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb084 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.818436:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624ba4de800/0xa81c4c9a2f3cb08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb084 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.818445:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4de800, rc 0) 00000100:00100000:0.0:1788201297.818776:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:15337:x1875064570077312:12345-0@lo:101:mount.lustre.0 Request processed in 455us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.818784:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788201297.820030:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201297.820057:0:15337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.820069:0:15337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201297.832606:0:15337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:2.0:1788201297.835520:0:15337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201297.835929:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788201297.835984:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 128 off8544 00000040:00080000:2.0:1788201297.836022:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 112 off8656 00000040:00080000:2.0:1788201297.836072:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8880 00000040:00080000:2.0:1788201297.836111:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9104 00000040:00080000:2.0:1788201297.836146:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 80 off9184 00000040:00080000:2.0:1788201297.836198:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9408 00000040:00080000:2.0:1788201297.836237:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9632 00000040:00080000:2.0:1788201297.836272:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 80 off9712 00000040:00080000:2.0:1788201297.836319:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off9936 00000040:00080000:2.0:1788201297.836485:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10160 00000040:00080000:2.0:1788201297.836538:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 120 off10280 00000040:00080000:2.0:1788201297.836600:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 224 off10504 00000040:00080000:2.0:1788201297.836998:0:15337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:2.0:1788201297.837106:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96249058b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201297.837190:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.837292:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9e723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.837418:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570077440 00000100:00100000:0.0:1788201297.837428:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570077440 00000100:00100000:2.0:1788201297.837593:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788201297.837604:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:15337:x1875064570077440:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201297.837896:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:15337:x1875064570077440:12345-0@lo:501:mount.lustre.0 Request processed in 292us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.837904:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788201297.838003:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96249058b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201297.838048:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201297.838091:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.838604:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c9e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.838786:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570077568 00000100:00100000:0.0:1788201297.838793:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570077568 00000100:00100000:0.0:1788201297.838823:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788201297.838831:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:15337:x1875064570077568:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201297.839202:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:15337:x1875064570077568:12345-0@lo:503:mount.lustre.0 Request processed in 370us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.839210:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788201297.839313:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077568:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201297.839969:0:15337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201297.840047:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201297.840114:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.840141:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c9e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.842797:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570077696 00000100:00100000:0.0:1788201297.842814:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570077696 00000100:00100000:0.0:1788201297.842880:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788201297.842892:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:15337:x1875064570077696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201297.843248:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:15337:x1875064570077696:12345-0@lo:502:mount.lustre.0 Request processed in 357us (3133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.843263:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788201297.844285:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201297.844648:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788201297.844709:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 128 off8544 00000040:00080000:3.0:1788201297.844745:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 112 off8656 00000040:00080000:3.0:1788201297.844793:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8880 00000040:00080000:3.0:1788201297.844827:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9104 00000040:00080000:3.0:1788201297.844869:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 80 off9184 00000040:00080000:3.0:1788201297.844919:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9408 00000040:00080000:3.0:1788201297.844954:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9632 00000040:00080000:3.0:1788201297.844984:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 80 off9712 00000040:00080000:3.0:1788201297.845024:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off9936 00000040:00080000:3.0:1788201297.845056:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10160 00000040:00080000:3.0:1788201297.845103:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 120 off10280 00000100:00100000:3.0:1788201297.845147:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201297.845218:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.845256:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c9e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.845419:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570077824 00000100:00100000:0.0:1788201297.845425:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570077824 00000100:00100000:0.0:1788201297.845462:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788201297.845471:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:15337:x1875064570077824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201297.845673:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:15337:x1875064570077824:12345-0@lo:502:mount.lustre.0 Request processed in 202us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.845680:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788201297.845827:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201297.845916:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 224 off10504 00000040:00080000:3.0:1788201297.845927:0:15337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788201297.847879:0:15338:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201297.847890:0:15338:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788201297.847898:0:15338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.847900:0:15338:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788201297.847906:0:15338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201297.847923:0:15338:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9624909db380) 00000020:00000080:3.0:1788201297.847949:0:15338:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788201297.847956:0:15338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201297.848030:0:15338:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9624857c5000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788201297.848038:0:15338:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201297.848046:0:15338:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3cb099 00010000:00010000:3.0:1788201297.852170:0:15338:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00080000:3.0:1788201297.854066:0:15338:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 12884901890 srv lr: 12884901888 lx: 1875064570073088 gen 0 00000001:00080000:3.0:1788201297.854116:0:15338:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: 986744c8-ee81-4a47-8d91-97f81ede1f3e idx: 1 lr: 12884901897 srv lr: 12884901888 lx: 1875064559543808 gen 0 00000001:00000004:3.0:1788201297.854133:0:15338:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901897 00080000:10000000:3.0:1788201297.859994:0:15338:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00000020:00000080:0.0:1788201297.861877:0:15338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788201297.861889:0:15338:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201297.861895:0:15338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201297.861898:0:15338:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788201297.861901:0:15338:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788201297.861904:0:15338:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1788201297.861905:0:15338:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201297.861907:0:15338:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201297.861908:0:15338:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788201297.861911:0:15338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201297.861912:0:15338:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788201297.861914:0:15338:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201297.861918:0:15338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201297.861919:0:15338:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201297.861922:0:15338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201297.861924:0:15338:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788201297.861927:0:15338:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201297.861929:0:15338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201297.861930:0:15338:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788201297.861932:0:15338:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201297.861934:0:15338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201297.861936:0:15338:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788201297.861938:0:15338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788201297.862000:0:15338:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201297.862004:0:15338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201297.862005:0:15338:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788201297.862008:0:15338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 14 count 14 00000020:01000000:2.0:1788201297.862161:0:15337:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788201297.862191:0:15337:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788201297.862225:0:15337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.862238:0:15337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201297.862246:0:15337:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9624857c5000 from 1 10000000:01000000:2.0:1788201297.862249:0:15337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201297.862288:0:15337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.862296:0:15337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.862306:0:15337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201297.862331:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96249058b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201297.862444:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.862483:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9e72cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.862666:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570077952 00000100:00100000:1.0:1788201297.862674:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570077952 00000100:00100000:1.0:1788201297.862722:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788201297.862732:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:15337:x1875064570077952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201297.862747:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201297.862760:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962498ac2a00/0xa81c4c9a2f3cb0b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb0ae expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.862786:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962498ac2a00/0xa81c4c9a2f3cb0b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb0ae expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.862795:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962498ac2a00/0xa81c4c9a2f3cb0b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb0ae expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.862804:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac2a00, rc 0) 00000100:00100000:1.0:1788201297.862867:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:15337:x1875064570077952:12345-0@lo:101:mount.lustre.0 Request processed in 136us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.862874:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788201297.863024:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96249058b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570077952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201297.863053:0:15337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.863063:0:15337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201297.879905:0:15337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000040:00080000:1.0:1788201297.885987:0:15337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201297.886307:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:1.0:1788201297.886484:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 112 off8528 00000040:00080000:1.0:1788201297.886541:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 224 off8752 00000040:00080000:1.0:1788201297.886577:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8976 00000040:00080000:1.0:1788201297.886607:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 112 off9088 00000040:00080000:1.0:1788201297.886815:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 224 off9312 00000040:00080000:1.0:1788201297.886825:0:15337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 6 count 7 00000100:00100000:1.0:1788201297.886945:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201297.887020:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201297.887116:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624bfd48c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.887758:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570078080 00000100:00100000:0.0:1788201297.887767:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570078080 00000100:00100000:0.0:1788201297.887866:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788201297.887878:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:15337:x1875064570078080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201297.888153:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:15337:x1875064570078080:12345-0@lo:501:mount.lustre.0 Request processed in 277us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.888161:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788201297.888258:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201297.888300:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201297.888383:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.888577:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9e72000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.888648:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570078208 00000100:00100000:1.0:1788201297.888653:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570078208 00000100:00100000:1.0:1788201297.888677:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788201297.888684:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:15337:x1875064570078208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201297.889259:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:15337:x1875064570078208:12345-0@lo:503:mount.lustre.0 Request processed in 573us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.889267:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788201297.889549:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078208:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788201297.890273:0:15337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201297.890405:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201297.890455:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.890489:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9e72000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.890560:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570078336 00000100:00100000:0.0:1788201297.890567:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570078336 00000100:00100000:0.0:1788201297.890606:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788201297.890624:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:15337:x1875064570078336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201297.890809:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:15337:x1875064570078336:12345-0@lo:502:mount.lustre.0 Request processed in 196us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.890817:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788201297.891001:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201297.891210:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:2.0:1788201297.891260:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 112 off8528 00000040:00080000:2.0:1788201297.891311:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 224 off8752 00000040:00080000:2.0:1788201297.891389:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8976 00000040:00080000:2.0:1788201297.891429:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 112 off9088 00000100:00100000:2.0:1788201297.891459:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078464:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201297.891501:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.891530:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9e72000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.891827:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570078464 00000100:00100000:0.0:1788201297.891833:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570078464 00000100:00100000:0.0:1788201297.891883:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788201297.891898:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:15337:x1875064570078464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201297.892072:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:15337:x1875064570078464:12345-0@lo:502:mount.lustre.0 Request processed in 173us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.892079:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788201297.892169:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201297.892267:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 224 off9312 00000040:00080000:1.0:1788201297.892277:0:15337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1788201297.893982:0:15342:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201297.893995:0:15342:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201297.893998:0:15342:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788201297.894005:0:15342:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624857c5000 00000020:00000080:0.0:1788201297.894008:0:15342:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201297.894017:0:15342:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201297.894020:0:15342:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201297.894021:0:15342:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788201297.894024:0:15342:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201297.894026:0:15342:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201297.894027:0:15342:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788201297.894030:0:15342:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624857c5000 00000020:00000080:0.0:1788201297.894032:0:15342:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201297.894149:0:15342:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201297.894153:0:15342:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201297.894155:0:15342:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788201297.894158:0:15342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 7 count 7 00000020:01000000:1.0:1788201297.894306:0:15337:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1788201297.894330:0:15337:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201297.894371:0:15337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.894384:0:15337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201297.894430:0:15337:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788201297.894433:0:15337:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9624857c5000 10000000:01000000:1.0:1788201297.894437:0:15337:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9624857c5000 10000000:01000000:1.0:1788201297.894443:0:15337:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201297.894449:0:15337:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9624857c5000 from 1 10000000:01000000:1.0:1788201297.894451:0:15337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201297.894491:0:15337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.894499:0:15337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.894522:0:15337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201297.894546:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201297.894607:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201297.894665:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9df66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201297.894791:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570078592 00000100:00100000:2.0:1788201297.894798:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570078592 00000100:00100000:2.0:1788201297.894844:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788201297.894862:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:15337:x1875064570078592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201297.894875:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201297.894894:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cb0c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb0bc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.894917:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cb0c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb0bc expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.894928:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cb0c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb0bc expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.894937:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5e00, rc 0) 00000100:00100000:2.0:1788201297.894978:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:15337:x1875064570078592:12345-0@lo:101:mount.lustre.0 Request processed in 126us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.894985:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788201297.895122:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201297.895137:0:15337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.895146:0:15337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201297.910939:0:15337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000040:00080000:0.0:1788201297.911528:0:15337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201297.911829:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:0.0:1788201297.911888:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 120 off8536 00000040:00080000:0.0:1788201297.911923:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 168 off8704 00000040:00080000:0.0:1788201297.911969:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8928 00000040:00080000:0.0:1788201297.912023:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 224 off9152 00000040:00080000:0.0:1788201297.912072:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 120 off9272 00000040:00080000:0.0:1788201297.912105:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 168 off9440 00000040:00080000:0.0:1788201297.912137:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 224 off9664 00000040:00080000:0.0:1788201297.912184:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:0.0:1788201297.912236:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 120 off10008 00000040:00080000:0.0:1788201297.912272:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 224 off10232 00000040:00080000:0.0:1788201297.912321:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10456 00000040:00080000:0.0:1788201297.912388:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].13, 88 off10544 00000040:00080000:0.0:1788201297.912424:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].14, 128 off10672 00000040:00080000:0.0:1788201297.912472:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].15, 144 off10816 00000040:00080000:0.0:1788201297.912508:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].16, 160 off10976 00000040:00080000:0.0:1788201297.912541:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].17, 224 off11200 00000040:00080000:0.0:1788201297.912590:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].18, 224 off11424 00000040:00080000:0.0:1788201297.912627:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].19, 80 off11504 00000040:00080000:0.0:1788201297.912660:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].20, 224 off11728 00000040:00080000:0.0:1788201297.912729:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].21, 224 off11952 00000040:00080000:0.0:1788201297.912766:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].22, 88 off12040 00000040:00080000:0.0:1788201297.912800:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].23, 128 off12168 00000040:00080000:0.0:1788201297.912843:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].24, 144 off12312 00000040:00080000:0.0:1788201297.912895:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].25, 128 off12440 00000040:00080000:0.0:1788201297.912930:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].26, 224 off12664 00000040:00080000:0.0:1788201297.912981:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].27, 224 off12888 00000040:00080000:0.0:1788201297.913018:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].28, 80 off12968 00000040:00080000:0.0:1788201297.913052:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].29, 224 off13192 00000040:00080000:0.0:1788201297.913101:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].30, 224 off13416 00000040:00080000:0.0:1788201297.913139:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].31, 88 off13504 00000040:00080000:0.0:1788201297.913174:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].32, 128 off13632 00000040:00080000:0.0:1788201297.913209:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].33, 144 off13776 00000040:00080000:0.0:1788201297.913273:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].34, 128 off13904 00000040:00080000:0.0:1788201297.913314:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].35, 224 off14128 00000040:00080000:0.0:1788201297.913392:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].36, 224 off14352 00000040:00080000:0.0:1788201297.913449:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].37, 80 off14432 00000040:00080000:0.0:1788201297.913484:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].38, 224 off14656 00000040:00080000:0.0:1788201297.913534:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].39, 224 off14880 00000040:00080000:0.0:1788201297.913569:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].40, 120 off15000 00000040:00080000:0.0:1788201297.913665:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].41, 224 off15224 00000040:00080000:0.0:1788201297.913674:0:15337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 41 count 42 00000100:00100000:0.0:1788201297.913786:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201297.921450:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.921548:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9f62480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.921608:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570078720 00000100:00100000:1.0:1788201297.921617:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570078720 00000100:00100000:1.0:1788201297.921682:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788201297.921692:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:15337:x1875064570078720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201297.922135:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:15337:x1875064570078720:12345-0@lo:501:mount.lustre.0 Request processed in 443us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.922144:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788201297.922282:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201297.922331:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201297.922401:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.922418:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9f62480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.922470:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570078848 00000100:00100000:1.0:1788201297.922474:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570078848 00000100:00100000:1.0:1788201297.922507:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788201297.922514:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:15337:x1875064570078848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201297.922822:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:15337:x1875064570078848:12345-0@lo:503:mount.lustre.0 Request processed in 307us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.922839:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788201297.922919:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078848:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201297.923477:0:15337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201297.923539:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201297.923578:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.923600:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9f62480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.924408:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570078976 00000100:00100000:1.0:1788201297.924417:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570078976 00000100:00100000:1.0:1788201297.924459:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788201297.924469:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:15337:x1875064570078976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201297.924831:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:15337:x1875064570078976:12345-0@lo:502:mount.lustre.0 Request processed in 362us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.924839:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788201297.924967:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570078976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201297.925228:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:0.0:1788201297.925281:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 120 off8536 00000040:00080000:0.0:1788201297.925319:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 168 off8704 00000040:00080000:0.0:1788201297.925447:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8928 00000040:00080000:0.0:1788201297.925482:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 224 off9152 00000040:00080000:0.0:1788201297.925526:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 120 off9272 00000040:00080000:0.0:1788201297.925562:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 168 off9440 00000040:00080000:0.0:1788201297.925597:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 224 off9664 00000040:00080000:0.0:1788201297.926790:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:0.0:1788201297.926843:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 120 off10008 00000040:00080000:0.0:1788201297.926894:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 224 off10232 00000040:00080000:0.0:1788201297.926945:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10456 00000040:00080000:0.0:1788201297.926980:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].13, 88 off10544 00000040:00080000:0.0:1788201297.927011:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].14, 128 off10672 00000040:00080000:0.0:1788201297.927074:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].15, 144 off10816 00000040:00080000:0.0:1788201297.927112:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].16, 160 off10976 00000040:00080000:0.0:1788201297.927148:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].17, 224 off11200 00000040:00080000:0.0:1788201297.927197:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].18, 224 off11424 00000040:00080000:0.0:1788201297.927234:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].19, 80 off11504 00000040:00080000:0.0:1788201297.927264:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].20, 224 off11728 00000040:00080000:0.0:1788201297.927327:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].21, 224 off11952 00000040:00080000:0.0:1788201297.930064:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].22, 88 off12040 00000040:00080000:0.0:1788201297.930119:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].23, 128 off12168 00000040:00080000:0.0:1788201297.930192:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].24, 144 off12312 00000040:00080000:0.0:1788201297.930261:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].25, 128 off12440 00000040:00080000:0.0:1788201297.930300:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].26, 224 off12664 00000040:00080000:0.0:1788201297.935069:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].27, 224 off12888 00000040:00080000:0.0:1788201297.935185:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].28, 80 off12968 00000040:00080000:0.0:1788201297.935221:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].29, 224 off13192 00000040:00080000:0.0:1788201297.935277:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].30, 224 off13416 00000040:00080000:0.0:1788201297.935309:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].31, 88 off13504 00000040:00080000:0.0:1788201297.935334:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].32, 128 off13632 00000040:00080000:0.0:1788201297.935392:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].33, 144 off13776 00000040:00080000:0.0:1788201297.935433:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].34, 128 off13904 00000040:00080000:0.0:1788201297.935461:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].35, 224 off14128 00000040:00080000:0.0:1788201297.935497:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].36, 224 off14352 00000040:00080000:0.0:1788201297.935524:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].37, 80 off14432 00000040:00080000:0.0:1788201297.935549:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].38, 224 off14656 00000040:00080000:0.0:1788201297.935610:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].39, 224 off14880 00000040:00080000:0.0:1788201297.937539:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].40, 120 off15000 00000100:00100000:0.0:1788201297.937605:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570079104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201297.937772:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.938763:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9f62480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201297.942114:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570079104 00000100:00100000:2.0:1788201297.942130:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570079104 00000100:00100000:2.0:1788201297.942202:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788201297.942215:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:15337:x1875064570079104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201297.942566:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:15337:x1875064570079104:12345-0@lo:502:mount.lustre.0 Request processed in 353us (4794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.942575:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788201297.945008:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570079104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201297.945196:0:15337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].41, 224 off15224 00000040:00080000:0.0:1788201297.945221:0:15337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788201297.953982:0:15345:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788201297.954003:0:15345:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff962487eb3380) 00000020:00000080:2.0:1788201297.954026:0:15345:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788201297.954232:0:15345:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9624857c5000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788201297.954237:0:15345:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9624857c5000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788201297.954239:0:15345:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624857c5000 3 00010000:00080000:2.0:1788201297.954270:0:15345:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9624c1ceb000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.156@tcp at head 00010000:00010000:2.0:1788201297.959923:0:15345:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788201297.960053:0:15345:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788201297.960110:0:15345:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788201297.960127:0:15345:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa81c4c9a2f3cb0d1 00000100:00080000:2.0:1788201297.960141:0:15345:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201297.960147:0:15345:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9624c1ceb000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:2.0:1788201297.960195:0:15345:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962490589880 x1875064570079232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201297.960282:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570079232:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201297.960400:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201297.962754:0:15345:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788201297.963442:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201297.963448:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201297.963451:0:36:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201297.963459:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:1.0:1788201297.963463:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201297.963470:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201297.963494:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962492c6c700 x1875064570079488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201297.965734:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570079360:0@lo:400:kworker.0 00000100:00100000:3.0:1788201297.965809:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.965881:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570079232 00000100:00100000:3.0:1788201297.965890:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570079232 00000100:00100000:3.0:1788201297.965922:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570079360 00000100:00100000:3.0:1788201297.965925:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570079360 00000100:00100000:3.0:1788201297.966060:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788201297.966071:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570079360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201297.966142:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570079360:12345-0@lo:400:kworker.0 Request processed in 73us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.966149:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788201297.966170:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788201297.966175:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875064570079232:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788201297.966199:0:5827:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:3.0:1788201297.966239:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa81c4c9a2f3cb0d8 00000004:00100000:3.0:1788201297.966255:0:5827:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201297.966290:0:5827:0:(import.c:65:import_set_state_nolock()) ffff9624bfdef000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201297.966439:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570079488:0@lo:8:kworker.0 00000100:00100000:0.0:1788201297.966474:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.966717:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570079360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201297.967069:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570079744:0@lo:400:kworker.0 00000100:00100000:1.0:1788201297.967102:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201297.967123:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201297.967129:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570079616:0@lo:400:kworker.0 00000100:00100000:1.0:1788201297.967151:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201297.967169:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570079488 00000100:00100000:1.0:1788201297.967174:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570079488 00000100:00100000:1.0:1788201297.967195:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570079744 00000100:00100000:1.0:1788201297.967198:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570079744 00000100:00100000:1.0:1788201297.967245:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788201297.967253:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570079744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201297.967294:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570079744:12345-0@lo:400:kworker.0 Request processed in 43us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.967300:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788201297.967314:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201297.967430:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875064570079232:12345-0@lo:38:llog_process_th.0 Request processed in 1253us (7029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.967447:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788201297.967463:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570079616 00000100:00100000:3.0:1788201297.967466:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570079616 00000100:00100000:3.0:1788201297.967485:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788201297.967491:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570079616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201297.967522:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570079616:12345-0@lo:400:kworker.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.967529:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788201297.973974:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570079488:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788201297.974084:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570079488:12345-0@lo:8:kworker.0 Request processed in 122us (7608us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201297.974093:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788201297.974142:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201297.974148:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201297.974193:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570079616:0@lo:400:kworker.0 00010000:00080000:1.0:1788201297.974214:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248c87c000 x1875064570079744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201297.974224:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570079744:0@lo:400:kworker.0 00000040:00080000:1.0:1788201297.975046:0:15345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000020:01000000:3.0:1788201297.976445:0:15337:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788201297.976478:0:15337:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201297.976499:0:15337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.976512:0:15337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788201297.976559:0:15337:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788201297.976561:0:15337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201297.976563:0:15337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201297.976564:0:15337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201297.976565:0:15337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201297.976567:0:15337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201297.976568:0:15337:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201297.976570:0:15337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201297.976572:0:15337:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201297.976576:0:15337:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788201297.976578:0:15337:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201297.976580:0:15337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201297.976581:0:15337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201297.976582:0:15337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201297.976583:0:15337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201297.976584:0:15337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201297.976590:0:15337:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201297.976591:0:15337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201297.976592:0:15337:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201297.976724:0:15337:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788201297.976746:0:15337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570079872:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201297.976823:0:15337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.976880:0:15337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c9ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.977429:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570079872 00000100:00100000:1.0:1788201297.977436:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570079872 00000100:00100000:1.0:1788201297.977483:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788201297.977493:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:15337:x1875064570079872:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201297.977520:0:5818:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788201297.977532:0:5818:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788201297.978935:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201297.978950:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788201297.978958:0:3281:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788201297.978964:0:3281:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788201297.978968:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9624c1ceb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201297.978983:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570079232:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788201297.979051:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201297.979056:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788201297.979059:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570079488:0@lo:8:kworker.0 20000000:01000000:2.0:1788201298.015281:0:5818:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201298.015305:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788201298.015830:0:5841:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201298.015835:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201298.015866:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.015886:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cae93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cae8c expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.015896:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3caea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99967 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.015902:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.015956:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3caea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99967 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.015969:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3caea1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99967 expref: 9 pid: 5818 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.015983:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d62d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570080000:192.168.201.56@tcp:104: 00010000:00010000:0.0:1788201298.016874:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cae93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3cae8c expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.016888:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cae93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cae8c expref: 19 pid: 5818 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.016900:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba116680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570080128:0@lo:104: 00000100:00100000:0.0:1788201298.016957:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.016991:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9f62300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201298.017257:0:5809:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201298.017272:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570080128 00000100:00100000:3.0:1788201298.017279:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570080128 00000100:00100000:3.0:1788201298.017337:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201298.017366:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624886abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570080128:12345-0@lo:104: 00010000:00010000:3.0:1788201298.017383:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cae93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.017445:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201298.017453:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624886abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570080128:12345-0@lo:104: Request processed in 89us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.017459:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201298.017530:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba116680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570080128:0@lo:104: 00010000:00010000:1.0:1788201298.017600:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201298.017609:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cae93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.017651:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2200 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201298.017656:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3cae93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.017666:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3cae93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201298.017674:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3cae93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201298.017680:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201298.017718:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cae93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.017725:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201298.017748:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cae93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.017755:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962498ac2200/0xa81c4c9a2f3cae8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cae93 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.017772:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201298.017774:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201298.017776:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201298.017791:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570080256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201298.017823:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.017883:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570080256 00000100:00100000:1.0:1788201298.017888:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570080256 00010000:00010000:1.0:1788201298.017911:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cae93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cae8c expref: 20 pid: 5818 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201298.017942:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201298.017949:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+20:3284:x1875064570080256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201298.017964:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201298.017971:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cae93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cae8c expref: 20 pid: 5818 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.017979:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cae93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cae8c expref: 20 pid: 5818 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.017993:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624b9a7d000/0xa81c4c9a2f3cae93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3cae8c expref: 20 pid: 5818 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.018007:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201298.018034:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570080256:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.018041:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201298.018072:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570080256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201298.027475:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201298.027508:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559548032 00000100:00100000:3.0:1788201298.027516:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559548032 00010000:00010000:3.0:1788201298.027550:0:11284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3caea1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99967 expref: 10 pid: 5818 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201298.027584:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:3.0:1788201298.027594:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559548032:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201298.027622:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201298.027644:0:11284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3caea1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99967 expref: 10 pid: 5818 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.027657:0:11284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3caea1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99967 expref: 10 pid: 5818 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.027682:0:11284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.027691:0:11284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201298.027707:0:11284:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012377394s 00010000:00010000:3.0:1788201298.027712:0:11284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.027718:0:11284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.027725:0:11284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.027732:0:11284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.027737:0:11284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4de600 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:3.0:1788201298.027742:0:11284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.027751:0:11284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.027760:0:11284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.027775:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201298.027818:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559548032:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 226us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.027824:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 38 00010000:00010000:3.0:1788201298.027945:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3caea1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99967 expref: 9 pid: 5818 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201298.027961:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d62d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570080000:192.168.201.56@tcp:104: 00010000:00010000:3.0:1788201298.027987:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.027996:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.028002:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.028008:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb0df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201298.039452:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:15337:x1875064570079872:12345-0@lo:253:mount.lustre.0 Request processed in 61950us (62621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.039469:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788201298.039575:0:15337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:15337:1875064570079872:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201298.039593:0:15337:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788201298.039597:0:15337:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201298.039599:0:15337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201298.039600:0:15337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201298.039602:0:15337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201298.039603:0:15337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201298.039605:0:15337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201298.039606:0:15337:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201298.039760:0:15337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201298.039761:0:15337:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788201298.039777:0:15337:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788201298.044936:0:15337:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201298.045132:0:15337:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201298.045292:0:15337:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201298.045922:0:15337:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201298.046094:0:15337:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201298.046318:0:15337:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00080000:3.0:1788201298.047242:0:15337:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-OST0000, 2 recoverable clients, last_transno 12884901897 00010000:00080000:1.0:1788201298.048156:0:15349:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-OST0000: started recovery thread pid 15349 00010000:00080000:1.0:1788201298.048178:0:15349:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788201298.048182:0:15349:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1788201298.048326:0:15337:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788201298.048414:0:15337:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788201298.048429:0:15337:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788201298.048459:0:15337:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000100:00100000:0.0:1788201298.488069:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201298.488095:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570080384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201298.488173:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201298.488291:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570080384 00000100:00100000:2.0:1788201298.488301:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570080384 00000100:00100000:2.0:1788201298.488397:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788201298.488408:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570080384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201298.488454:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201298.488514:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570080384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.488521:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1788201298.488566:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624bfe6a680 x1875064570080384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201298.488590:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570080384:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201298.682022:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201298.741911:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201298.741959:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201298.742007:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201298.742042:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559548288 00000100:00100000:0.0:1788201298.742051:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559548288 00000100:00100000:0.0:1788201298.742118:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 202 00000100:00100000:0.0:1788201298.742130:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2342:x1875064559548288:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201298.742217:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2342:x1875064559548288:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 89us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201298.742224:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 202 00000100:00080000:0.0:1788201298.742246:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201298.742445:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559548160 00000100:00100000:1.0:1788201298.742450:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559548160 00000100:00100000:1.0:1788201298.742490:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 370 00000100:00100000:1.0:1788201298.742497:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:2342:x1875064559548160:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201298.742528:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:2342:x1875064559548160:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 32us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.742545:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 370 00000100:00100000:3.0:1788201298.743290:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559548416 00000100:00100000:3.0:1788201298.743298:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559548416 00000100:00100000:3.0:1788201298.743400:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00100000:3.0:1788201298.743407:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875064559548416:12345-192.168.201.56@tcp:8:kworker.0 00010000:00080000:3.0:1788201298.743435:0:6671:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '986744c8-ee81-4a47-8d91-97f81ede1f3e' at ffff96248ced2800, cookie 0xa81c4c9a2f3cb0a7 00010000:00080000:3.0:1788201298.743440:0:6671:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp recovering/t12884901892 exp ffff96248ced2800 cur 430 last 1788201297 00010000:02000400:3.0:1788201298.743448:0:6671:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1788201298.746435:0:6671:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:3.0:1788201298.746459:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff96248ced2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201298.746475:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00000100:00080000:3.0:1788201298.746648:0:6671:0:(import.c:65:import_set_state_nolock()) ffff96248cec2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201298.752898:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559548416:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 9473us (10977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.752925:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00100000:0.0:1788201298.760179:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201298.760220:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201298.760246:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201298.760276:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559548544 00000100:00100000:0.0:1788201298.760286:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559548544 00000100:00100000:0.0:1788201298.760378:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559548672 00000100:00100000:0.0:1788201298.760381:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559548672 00000100:00100000:0.0:1788201298.760391:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559548800 00000100:00100000:0.0:1788201298.760393:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559548800 00000100:00100000:0.0:1788201298.760404:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 76 00000100:00100000:0.0:1788201298.760414:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2340:x1875064559548544:12345-192.168.201.56@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788201298.760434:0:8088:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9624ba114a80 x1875064559548544/t0(0) o101->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:419/0 lens 328/0 e 0 to 0 dl 1788201309 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201298.760458:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2340:x1875064559548544:12345-192.168.201.56@tcp:101:ldlm_lock_repla.0 Request processed in 47us (291us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201298.760465:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 76 00000100:00100000:0.0:1788201298.760482:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 77 00000100:00100000:0.0:1788201298.760488:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2340:x1875064559548672:12345-192.168.201.56@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788201298.760495:0:8088:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9624ba117b80 x1875064559548672/t0(0) o101->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:419/0 lens 328/0 e 0 to 0 dl 1788201309 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201298.760505:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2340:x1875064559548672:12345-192.168.201.56@tcp:101:ldlm_lock_repla.0 Request processed in 17us (285us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201298.760525:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 77 00000100:00100000:0.0:1788201298.760533:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00100000:0.0:1788201298.760539:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2340:x1875064559548800:12345-192.168.201.56@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788201298.760546:0:8088:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9624ba115880 x1875064559548800/t0(0) o101->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:419/0 lens 328/0 e 0 to 0 dl 1788201309 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201298.760555:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2340:x1875064559548800:12345-192.168.201.56@tcp:101:ldlm_lock_repla.0 Request processed in 17us (309us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201298.760568:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 78 00010000:00080000:0.0:1788201298.760600:0:15349:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:3.0:1788201299.192457:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201299.192467:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9624902af800 from 8 10000000:01000000:3.0:1788201299.192472:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201299.192522:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201299.192535:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201299.192547:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201299.192575:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570080512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201299.192673:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201299.192740:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624870493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201299.192771:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570080512 00000100:00100000:3.0:1788201299.192780:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570080512 00000100:00100000:3.0:1788201299.192825:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788201299.192845:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570080512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201299.192862:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201299.192888:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3cb0ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb0e6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201299.192914:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3cb0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb0e6 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201299.192925:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3cb0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb0e6 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201299.192951:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7de00, rc 0) 00000100:00100000:3.0:1788201299.192993:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570080512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201299.193000:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788201299.193053:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570080512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201299.193065:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb0ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201299.193074:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb0ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201299.193125:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570080640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788201299.193170:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201299.193186:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624870493c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201299.202275:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570080640 00000100:00100000:1.0:1788201299.202288:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570080640 00000100:00100000:1.0:1788201299.202366:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788201299.202377:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570080640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201299.202403:0:5820:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788201299.202419:0:5820:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201299.202422:0:5820:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788201299.202547:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570080640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 172us (9375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201299.202556:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788201299.202628:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570080640:0@lo:256:ll_cfg_requeue.0 00000100:00080000:1.0:1788201299.202672:0:5822:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff96249852b000 already not connected (conn 18, was 0): DISCONN 00010000:00080000:1.0:1788201299.202683:0:5822:0:(ldlm_lib.c:85:import_set_conn()) imp ffff96249852b000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.201.156@tcp, moved to head 00000100:00080000:1.0:1788201299.202688:0:5822:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201299.202694:0:5822:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201299.202722:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962492c6f100 x1875064570080768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:1.0:1788201299.202769:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201299.202779:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb0ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201299.202789:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb0ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201299.202810:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570080768:0@lo:8:ll_cfg_requeue.0 00000100:00100000:1.0:1788201299.202860:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201299.202899:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570080768 00000100:00100000:1.0:1788201299.202903:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570080768 00000100:00100000:1.0:1788201299.202922:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201299.202926:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570080768:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:1.0:1788201299.202946:0:8088:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff96248ced7000, cookie 0xa81c4c9a2f3cb0a0 00010000:00080000:1.0:1788201299.202951:0:8088:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff96248ced7000 cur 431 last 1788201297 00002000:00100000:1.0:1788201299.202967:0:8088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96248ced7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788201299.202971:0:8088:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788201299.202973:0:8088:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1788201299.203080:0:8088:0:(import.c:65:import_set_state_nolock()) ffff96248591d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201299.203125:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570080768:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 196us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201299.203134:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1788201299.203169:0:15349:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788201299.203173:0:15349:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 12884901898 00010000:00080000:1.0:1788201299.203177:0:15349:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 12884901898 00010000:00080000:1.0:1788201299.203181:0:15349:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 12884901898 00010000:00080000:1.0:1788201299.203202:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962492c6f100 x1875064570080768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201299.203214:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 4 00000100:00080000:1.0:1788201299.203222:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1788201299.203225:0:3281:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788201299.203228:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00080000:1.0:1788201299.203231:0:3281:0:(recover.c:53:ptlrpc_replay_next()) import ffff96249852b000 from lustre-OST0000_UUID committed 12884901890 last 0 00000100:00080000:1.0:1788201299.203241:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1788201299.203376:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570080768:0@lo:8:ll_cfg_requeue.0 00010000:00080000:1.0:1788201299.203393:0:15411:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:1.0:1788201299.203397:0:15411:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:1.0:1788201299.203401:0:15411:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:1.0:1788201299.203435:0:15411:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1788201299.203458:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570080896:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788201299.203485:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201299.204249:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570080896 00000100:00100000:0.0:1788201299.204256:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570080896 00000100:00100000:0.0:1788201299.204302:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201299.204311:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570080896:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788201299.204325:0:6671:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff9624b9c40700 x1875064570080896/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:420/0 lens 224/0 e 0 to 0 dl 1788201310 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201299.204363:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570080896:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 54us (877us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201299.204368:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1788201299.204380:0:15349:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 12884901898 00010000:00080000:0.0:1788201299.204384:0:15349:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00010000:00080000:0.0:1788201299.204388:0:15349:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201299.204390:0:15349:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201299.204397:0:15349:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.201.56@tcp: req@ffff9624ba114a80 x1875064559548544/t0(0) o101->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:419/0 lens 328/0 e 0 to 0 dl 1788201309 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201299.204426:0:15349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201299.204450:0:15349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f37b5f0/0xa81c4c9a2f3cb0f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999f3 expref: -99 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201299.204476:0:15349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f37b5f0/0xa81c4c9a2f3cb0f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999f3 expref: 8 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201299.204494:0:15349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f37b5f0/0xa81c4c9a2f3cb0f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999f3 expref: 8 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201299.204505:0:15349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4de400, rc 0) 00010000:00080000:0.0:1788201299.204562:0:15349:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201299.204572:0:15349:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201299.204574:0:15349:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201299.204579:0:15349:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.201.56@tcp: req@ffff9624ba117b80 x1875064559548672/t0(0) o101->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:419/0 lens 328/0 e 0 to 0 dl 1788201309 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201299.204590:0:15349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201299.204600:0:15349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb0fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999e5 expref: -99 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201299.204628:0:15349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb0fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999e5 expref: 8 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201299.204639:0:15349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb0fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999e5 expref: 8 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201299.204660:0:15349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dee00, rc 0) 00010000:00080000:0.0:1788201299.204682:0:15349:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201299.204689:0:15349:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201299.204691:0:15349:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201299.204696:0:15349:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.201.56@tcp: req@ffff9624ba115880 x1875064559548800/t0(0) o101->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:419/0 lens 328/0 e 0 to 0 dl 1788201309 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201299.204705:0:15349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201299.204715:0:15349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d374bf7/0xa81c4c9a2f3cb102 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd999d7 expref: -99 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201299.204728:0:15349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d374bf7/0xa81c4c9a2f3cb102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999d7 expref: 8 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201299.204738:0:15349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009d374bf7/0xa81c4c9a2f3cb102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999d7 expref: 8 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201299.204746:0:15349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4de000, rc 0) 00010000:00080000:0.0:1788201299.204765:0:15349:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201299.204771:0:15349:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00000100:00100000:2.0:1788201299.208637:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201299.210411:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559548928 00000100:00100000:1.0:1788201299.210423:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559548928 00000100:00100000:1.0:1788201299.210482:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 111 00000100:00100000:1.0:1788201299.210493:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2340:x1875064559548928:12345-192.168.201.56@tcp:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1788201299.210511:0:8088:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff962490589880 x1875064559548928/t0(0) o400->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:420/0 lens 224/0 e 0 to 0 dl 1788201310 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201299.210530:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2340:x1875064559548928:12345-192.168.201.56@tcp:400:ptlrpcd_rcv.0 Request processed in 39us (1902us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201299.210536:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 111 00010000:00080000:1.0:1788201299.210600:0:15349:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788201299.210759:0:15349:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869184 00010000:00080000:1.0:1788201299.308257:0:15349:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:1.0:1788201299.308274:0:15349:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9624b9c40700 x1875064570080896/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:420/0 lens 224/0 e 0 to 0 dl 1788201310 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788201299.308571:0:15349:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.201.56@tcp: req@ffff962490589880 x1875064559548928/t0(0) o400->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:420/0 lens 224/0 e 0 to 0 dl 1788201310 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788201299.308648:0:15349:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 2 clients 2 recovered and 0 were evicted. 00002000:00080000:1.0:1788201299.314967:0:15349:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788201299.314977:0:15349:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00080000:1.0:1788201299.315757:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1788201299.315770:0:3281:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff962492c6f100 x1875064570080896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201315 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201299.315781:0:3281:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff962492c6f100 x1875064570080896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201315 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201299.315789:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:1.0:1788201299.315846:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:1.0:1788201299.315850:0:3281:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201299.317773:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570081024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201299.317869:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201299.317975:0:6846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe68a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064570081152:0@lo:7:osp-pre-0-0.0 00000100:00100000:3.0:1788201299.318003:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201299.318032:0:6846:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487049480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201299.318420:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570081152 00000100:00100000:0.0:1788201299.318429:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570081152 00000100:00100000:0.0:1788201299.318486:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788201299.318496:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6846:x1875064570081152:12345-0@lo:7:osp-pre-0-0.0 00000001:00100000:0.0:1788201299.325773:0:15417:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000001:00100000:0.0:1788201299.325785:0:15417:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:1.0:1788201299.328286:0:3281:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000664bc6c7): req@ffff9624ba471500 x1875064570074880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/224 e 0 to 0 dl 1788201295 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201299.328324:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570080896:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788201299.328608:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201299.329721:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570081024 00000100:00100000:1.0:1788201299.329731:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570081024 00000100:00100000:1.0:1788201299.329766:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570074880 00000100:00100000:1.0:1788201299.329769:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570074880 00000100:00100000:1.0:1788201299.329784:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788201299.329792:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875064570081024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201299.329821:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 46202880 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201299.329892:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875064570081024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (12022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201299.329899:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788201299.329916:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788201299.329935:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570074880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201299.329946:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 46202880 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201299.329980:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570074880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201299.329989:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788201299.330032:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570074880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201299.330268:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570081024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201299.341048:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201299.342621:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201299.342654:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559546240 00000100:00100000:1.0:1788201299.342664:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559546240 00000100:00100000:1.0:1788201299.342715:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 81 00000100:00100000:1.0:1788201299.342725:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559546240:12345-192.168.201.56@tcp:16:kworker.0 00000100:00100000:1.0:1788201299.344271:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559546112 00000100:00100000:1.0:1788201299.344284:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559546112 00002000:00100000:1.0:1788201299.344456:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xb:0x0] (0->5) req@ffff9624b9c43480 x1875064559546112/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:420/0 lens 496/0 e 0 to 0 dl 1788201310 ref 1 fl New:/602/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201299.344468:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c43480 with x1875064559546112 ext(0->5) 00002000:00010000:1.0:1788201299.344481:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c43480 00000100:00100000:1.0:1788201299.344547:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:1.0:1788201299.344557:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559546112:12345-192.168.201.56@tcp:4:bash.0 00002000:00080000:0.0:1788201299.349975:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788201299.349985:0:6671:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x240000400:0x21:0x0] 00000100:00100000:0.0:1788201299.350085:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6846:x1875064570081152:12345-0@lo:7:osp-pre-0-0.0 Request processed in 31585us (32075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201299.350096:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201299.350189:0:6846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe68a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064570081152:0@lo:7:osp-pre-0-0.0 00000004:00080000:3.0:1788201299.350204:0:6846:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x240000400:0x21:0x0] 00000100:00100000:1.0:1788201299.366864:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559546240:12345-192.168.201.56@tcp:16:kworker.0 Request processed in 24129us (24248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201299.366881:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 81 00000100:00100000:3.0:1788201299.367231:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559546112:12345-192.168.201.56@tcp:4:bash.0 Request processed in 22673us (26192us total) trans 17179869185 rc 0/0 00000100:00100000:3.0:1788201299.367244:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 11 00002000:00100000:3.0:1788201299.367256:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xb:0x0] (0->5) req@ffff9624b9c43480 x1875064559546112/t17179869185(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:420/0 lens 496/448 e 0 to 0 dl 1788201310 ref 1 fl Complete:/602/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201299.367278:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c43480 with x1875064559546112 ext(0->5) 00002000:00010000:3.0:1788201299.367304:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c43480 00000100:00100000:1.0:1788201299.372958:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201299.373009:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201299.373066:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559549440 00000100:00100000:1.0:1788201299.373076:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559549440 00000100:00100000:1.0:1788201299.373132:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 82 00000100:00100000:3.0:1788201299.373243:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559549312 00000100:00100000:3.0:1788201299.373248:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559549312 00002000:00100000:3.0:1788201299.373286:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc:0x0] (0->5) req@ffff9624b9c42680 x1875064559549312/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:420/0 lens 496/0 e 0 to 0 dl 1788201310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201299.373298:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c42680 with x1875064559549312 ext(0->5) 00002000:00010000:3.0:1788201299.373303:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c42680 00000100:00100000:3.0:1788201299.373331:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:3.0:1788201299.373366:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:2342:x1875064559549312:12345-192.168.201.56@tcp:4:bash.0 00000100:00100000:1.0:1788201299.374177:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:2342:x1875064559549440:12345-192.168.201.56@tcp:16:kworker.0 00000100:00100000:2.0:1788201299.382030:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:2342:x1875064559549312:12345-192.168.201.56@tcp:4:bash.0 Request processed in 8674us (9065us total) trans 17179869186 rc 0/0 00000100:00100000:2.0:1788201299.382047:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00002000:00100000:2.0:1788201299.382062:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc:0x0] (0->5) req@ffff9624b9c42680 x1875064559549312/t17179869186(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:420/0 lens 496/448 e 0 to 0 dl 1788201310 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201299.382073:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c42680 with x1875064559549312 ext(0->5) 00002000:00010000:2.0:1788201299.382079:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c42680 00000001:00080000:2.0:1788201299.474006:0:15417:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 17179869186 is committed 00000100:00100000:1.0:1788201299.474396:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559549440:12345-192.168.201.56@tcp:16:kworker.0 Request processed in 101249us (101379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201299.474409:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 82 00000100:00100000:1.0:1788201299.478963:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201299.479008:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201299.479476:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559549696 00000100:00100000:2.0:1788201299.479487:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559549696 00000100:00100000:2.0:1788201299.479554:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 83 00000100:00100000:2.0:1788201299.479583:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559549696:12345-192.168.201.56@tcp:16:kworker.0 00000100:00100000:3.0:1788201299.486300:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559549568 00000100:00100000:3.0:1788201299.486326:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559549568 00002000:00100000:2.0:1788201299.488075:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xd:0x0] (0->6) req@ffff9623812a7800 x1875064559549568/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:420/0 lens 496/0 e 0 to 0 dl 1788201310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201299.488091:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a7800 with x1875064559549568 ext(0->6) 00002000:00010000:2.0:1788201299.488098:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a7800 00000100:00100000:2.0:1788201299.488147:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:2.0:1788201299.488157:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559549568:12345-192.168.201.56@tcp:4:bash.0 00000100:00100000:0.0:1788201299.491405:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559549696:12345-192.168.201.56@tcp:16:kworker.0 Request processed in 11819us (12440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201299.491420:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 83 00000100:00100000:1.0:1788201299.494031:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559549568:12345-192.168.201.56@tcp:4:bash.0 Request processed in 5865us (15012us total) trans 17179869187 rc 0/0 00000100:00100000:1.0:1788201299.494044:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00002000:00100000:1.0:1788201299.494055:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xd:0x0] (0->6) req@ffff9623812a7800 x1875064559549568/t17179869187(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:420/0 lens 496/448 e 0 to 0 dl 1788201310 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201299.494066:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a7800 with x1875064559549568 ext(0->6) 00002000:00010000:1.0:1788201299.494073:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a7800 00000100:00100000:3.0:1788201299.633997:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201299.634127:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559549824 00000100:00100000:2.0:1788201299.634137:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559549824 00000100:00100000:2.0:1788201299.634195:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 373 00000100:00100000:2.0:1788201299.634206:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:10055:x1875064559549824:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201299.634239:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201299.634258:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3cb109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd999fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201299.634287:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3cb109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999fa expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201299.634299:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3cb109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999fa expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201299.634318:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5c00, rc 0) 00000100:00100000:2.0:1788201299.634397:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559549824:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 193us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201299.634405:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 373 00000100:00100000:0.0:1788201299.644844:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201299.645220:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559549952 00000100:00100000:3.0:1788201299.645231:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559549952 00000100:00100000:3.0:1788201299.645289:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 374 00000100:00100000:3.0:1788201299.645308:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559549952:12345-192.168.201.56@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788201299.645336:0:5818:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788201299.645383:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201299.645387:0:5818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788201299.653182:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559549952:12345-192.168.201.56@tcp:256:ll_cfg_requeue.0 Request processed in 5996us (6458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201299.653202:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 374 00010000:00010000:2.0:1788201299.704764:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201300.730210:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201301.750469:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201302.784229:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201303.094597:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570081408:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.094672:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201303.094738:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570081920:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.094776:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201303.094802:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201303.094808:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570081536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.094830:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201303.094862:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570081536 00000100:00100000:1.0:1788201303.094878:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570081536 00000100:00100000:1.0:1788201303.094936:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201303.094944:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570081536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.094991:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570081536:12345-0@lo:400:kworker.0 Request processed in 47us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.094998:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1788201303.095017:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201303.095059:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570081536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.095097:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570081280:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.095126:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201303.095156:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570081792:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.095177:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201303.095192:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201303.095197:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570081664:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.095215:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201303.095236:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570081280 00000100:00100000:1.0:1788201303.095239:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570081280 00000100:00100000:1.0:1788201303.095461:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788201303.095467:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570081280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.095500:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570081280:12345-0@lo:400:kworker.0 Request processed in 34us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.095506:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788201303.095533:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570081792 00000100:00100000:1.0:1788201303.095537:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570081792 00000100:00100000:1.0:1788201303.095562:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201303.095568:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570081792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.095610:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570081792:12345-0@lo:400:kworker.0 Request processed in 41us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.095616:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201303.095634:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570081408 00000100:00100000:1.0:1788201303.095637:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570081408 00000100:00100000:1.0:1788201303.095659:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570081920 00000100:00100000:1.0:1788201303.095662:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570081920 00000100:00100000:1.0:1788201303.095678:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570081664 00000100:00100000:1.0:1788201303.095680:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570081664 00000100:00100000:1.0:1788201303.095692:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788201303.095697:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570081408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.095733:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570081408:12345-0@lo:400:kworker.0 Request processed in 36us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.095739:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788201303.095752:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788201303.095804:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570081920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.095834:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570081920:12345-0@lo:400:kworker.0 Request processed in 77us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.095840:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788201303.095852:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788201303.095857:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570081664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.095879:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570081664:12345-0@lo:400:kworker.0 Request processed in 22us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.095885:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:1.0:1788201303.095906:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201303.095909:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201303.095928:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570081664:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.095943:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570081280:0@lo:400:kworker.0 00010000:00080000:1.0:1788201303.095955:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfe68700 x1875064570081792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201303.095965:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570081792:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.095990:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570081408:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.095999:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570081920:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.611664:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201303.611690:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570082048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201303.611774:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201303.611884:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570082048 00000100:00100000:3.0:1788201303.611894:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570082048 00000100:00100000:3.0:1788201303.611967:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788201303.611976:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570082048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201303.612012:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201303.612073:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570082048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201303.612080:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:1.0:1788201303.612190:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfe69500 x1875064570082048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201303.612210:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570082048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201303.799634:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201303.861846:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201303.861886:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201303.861924:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201303.861950:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559550336 00000100:00100000:1.0:1788201303.861960:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559550336 00000100:00100000:1.0:1788201303.862034:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:1.0:1788201303.862044:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559550336:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201303.862117:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559550336:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 74us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.862124:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:1.0:1788201303.862149:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559550208 00000100:00100000:1.0:1788201303.862152:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559550208 00000100:00100000:1.0:1788201303.862183:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 206 00000100:00100000:1.0:1788201303.862203:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2341:x1875064559550208:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201303.862233:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2341:x1875064559550208:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 31us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.862240:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 206 00000100:00100000:0.0:1788201303.862482:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559550080 00000100:00100000:0.0:1788201303.862486:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559550080 00000100:00100000:0.0:1788201303.862515:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 376 00000100:00100000:0.0:1788201303.862522:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559550080:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201303.862559:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559550080:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 38us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201303.862566:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 376 00000100:00080000:3.0:1788201303.863722:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201303.863730:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201304.640839:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96249058b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570082176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201304.640917:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201304.646762:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570082176 00000100:00100000:3.0:1788201304.646780:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570082176 00000100:00100000:3.0:1788201304.646840:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788201304.646851:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570082176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201304.646891:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49610752 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201304.646983:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570082176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (6065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201304.646990:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788201304.647060:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96249058b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570082176:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788201304.672883:0:15691:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:3.0:1788201304.693584:0:15417:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 17179869187 is committed 00010000:00010000:2.0:1788201304.833044:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201305.853386:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201306.880264:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201307.896244:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201308.215727:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570082560:0@lo:400:kworker.0 00000100:00100000:0.0:1788201308.215808:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201308.215867:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788201308.215873:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570082432:0@lo:400:kworker.0 00000100:00100000:0.0:1788201308.215899:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201308.215916:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570082944:0@lo:400:kworker.0 00000100:00100000:0.0:1788201308.215935:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201308.215965:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570082432 00000100:00100000:0.0:1788201308.215973:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570082432 00000100:00100000:0.0:1788201308.216026:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570082944 00000100:00100000:0.0:1788201308.216030:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570082944 00000100:00100000:0.0:1788201308.216057:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788201308.216064:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570082432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201308.216119:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570082432:12345-0@lo:400:kworker.0 Request processed in 55us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201308.216127:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788201308.216146:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788201308.216153:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570082944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201308.216179:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570082944:12345-0@lo:400:kworker.0 Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201308.216184:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788201308.216219:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570082432:0@lo:400:kworker.0 00000100:00100000:0.0:1788201308.216230:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570082944:0@lo:400:kworker.0 00000100:00100000:2.0:1788201308.216381:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570082304:0@lo:400:kworker.0 00000100:00100000:2.0:1788201308.216415:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201308.216447:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570082816:0@lo:400:kworker.0 00000100:00100000:2.0:1788201308.216473:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201308.216499:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201308.216504:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570082688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201308.216527:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201308.216894:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570082560 00000100:00100000:1.0:1788201308.216899:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570082560 00000100:00100000:1.0:1788201308.216929:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570082816 00000100:00100000:1.0:1788201308.216931:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570082816 00000100:00100000:1.0:1788201308.216950:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201308.216956:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1d5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570082560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201308.217000:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1d5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570082560:12345-0@lo:400:kworker.0 Request processed in 44us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201308.217006:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201308.217147:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788201308.217154:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570082816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201308.217188:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570082816:12345-0@lo:400:kworker.0 Request processed in 36us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201308.217194:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788201308.217211:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570082688 00000100:00100000:1.0:1788201308.217214:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570082688 00000100:00100000:1.0:1788201308.217232:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788201308.217237:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570082688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201308.217264:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570082688:12345-0@lo:400:kworker.0 Request processed in 27us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201308.217270:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788201308.217842:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570082688:0@lo:400:kworker.0 00010000:00080000:1.0:1788201308.217870:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba115500 x1875064570082816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201308.217882:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570082816:0@lo:400:kworker.0 00000100:00100000:1.0:1788201308.217913:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570082560:0@lo:400:kworker.0 00000100:00080000:3.0:1788201308.217993:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201308.217998:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201308.218001:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201308.218055:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570082304 00000100:00100000:0.0:1788201308.218060:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570082304 00000100:00100000:0.0:1788201308.218096:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788201308.218103:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570082304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201308.218157:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570082304:12345-0@lo:400:kworker.0 Request processed in 55us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201308.218164:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788201308.219105:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570082304:0@lo:400:kworker.0 00000100:00100000:0.0:1788201308.727469:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201308.727495:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570083072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201308.727571:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201308.728076:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570083072 00000100:00100000:3.0:1788201308.728084:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570083072 00000100:00100000:3.0:1788201308.728151:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788201308.728161:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570083072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201308.728196:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201308.728261:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570083072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.728268:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1788201308.730519:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfe6bb80 x1875064570083072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201308.730569:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570083072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201308.910764:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201308.911177:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559550464 00000100:00100000:1.0:1788201308.911188:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559550464 00000100:00100000:1.0:1788201308.911288:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00100000:1.0:1788201308.911301:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:13661:x1875064559550464:12345-192.168.201.56@tcp:41:lfs.0 00000004:00000024:1.0:1788201308.911381:0:5827:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201308.911464:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:13661:x1875064559550464:12345-192.168.201.56@tcp:41:lfs.0 Request processed in 166us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201308.911472:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00080000:3.0:1788201308.912336:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201308.915056:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201308.915227:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559550592 00000100:00100000:3.0:1788201308.915239:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559550592 00000100:00100000:3.0:1788201308.915331:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:3.0:1788201308.915383:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:13661:x1875064559550592:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:3.0:1788201308.915434:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47906816 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201308.915555:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:13661:x1875064559550592:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 214us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.915562:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00080000:0.0:1788201308.916626:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201308.929673:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201308.930886:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201308.931141:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559550720 00000100:00100000:1.0:1788201308.931155:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559550720 00000100:00100000:1.0:1788201308.931221:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 84 00000100:00100000:1.0:1788201308.931233:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559550720:12345-192.168.201.56@tcp:8:lfs.0 00010000:00080000:1.0:1788201308.931279:0:8088:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:1.0:1788201308.931319:0:8088:0:(genops.c:1406:class_connect()) connect: client 986744c8-ee81-4a47-8d91-97f81ede1f3e, cookie 0xa81c4c9a2f3cb110 00002000:00100000:1.0:1788201308.931335:0:8088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff96248591a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201308.931378:0:8088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:1.0:1788201308.931705:0:8088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788201308.931746:0:8088:0:(import.c:65:import_set_state_nolock()) ffff96248591b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201308.931854:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559550720:12345-192.168.201.56@tcp:8:lfs.0 Request processed in 621us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201308.931887:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 84 00000100:00100000:2.0:1788201308.938493:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201308.939474:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559550848 00000100:00100000:3.0:1788201308.939489:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559550848 00000100:00100000:3.0:1788201308.939592:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 115 00000100:00100000:3.0:1788201308.939605:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:13661:x1875064559550848:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:3.0:1788201308.939639:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201308.939759:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:13661:x1875064559550848:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 156us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.939768:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 115 00000100:00080000:0.0:1788201308.942131:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201308.984851:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201308.986473:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559550976 00000100:00100000:0.0:1788201308.986493:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559550976 00000100:00100000:0.0:1788201308.986579:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 378 00000100:00100000:0.0:1788201308.986594:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559550976:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201308.986735:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559550976:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 144us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201308.986744:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 378 00000100:00100000:1.0:1788201309.751384:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201309.751417:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570083200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201309.751511:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201309.751728:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570083200 00000100:00100000:2.0:1788201309.751739:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570083200 00000100:00100000:2.0:1788201309.751808:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788201309.751820:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570083200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201309.751852:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47906816 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201309.751930:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570083200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201309.751939:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788201309.752002:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570083200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201309.945881:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201310.967596:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788201311.886768:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00010000:00010000:3.0:1788201311.992487:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201313.014855:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201313.336257:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570083584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201313.336502:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570083456:0@lo:400:kworker.0 00000100:00100000:1.0:1788201313.336561:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201313.336893:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570083328:0@lo:400:kworker.0 00000100:00100000:3.0:1788201313.336984:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570083712:0@lo:400:kworker.0 00000100:00100000:0.0:1788201313.337074:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201313.337170:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570083584 00000100:00100000:0.0:1788201313.337179:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570083584 00000100:00100000:0.0:1788201313.337256:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201313.337270:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570083584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201313.337382:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570083584:12345-0@lo:400:kworker.0 Request processed in 114us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201313.337390:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1788201313.337422:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201313.337479:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570083584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201313.337528:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570083456 00000100:00100000:0.0:1788201313.337532:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570083456 00000100:00100000:0.0:1788201313.337564:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788201313.337571:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570083456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201313.337636:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570083456:12345-0@lo:400:kworker.0 Request processed in 66us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201313.337643:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788201313.341890:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201313.341974:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570083840:0@lo:400:kworker.0 00000100:00100000:2.0:1788201313.342033:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201313.342324:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570083328 00000100:00100000:0.0:1788201313.342336:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570083328 00000100:00100000:0.0:1788201313.342439:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788201313.342449:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570083328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201313.342526:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570083328:12345-0@lo:400:kworker.0 Request processed in 78us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201313.342534:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788201313.343182:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201313.343245:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570083712 00000100:00100000:3.0:1788201313.343250:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570083712 00000100:00100000:3.0:1788201313.343295:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788201313.343304:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570083712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201313.343371:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570083712:12345-0@lo:400:kworker.0 Request processed in 70us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201313.343379:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788201313.343407:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570083840 00000100:00100000:3.0:1788201313.343411:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570083840 00000100:00100000:3.0:1788201313.343440:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788201313.343447:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570083840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201313.343483:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570083840:12345-0@lo:400:kworker.0 Request processed in 37us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201313.343490:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788201313.343535:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570083712:0@lo:400:kworker.0 00000100:00080000:3.0:1788201313.343573:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201313.343597:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201313.343796:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570083328:0@lo:400:kworker.0 00010000:00080000:3.0:1788201313.343812:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba115500 x1875064570083840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201313.343824:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570083840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201313.345856:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570083456:0@lo:400:kworker.0 00000100:00100000:1.0:1788201313.345877:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570083968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201313.345943:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201313.346521:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570083968 00000100:00100000:3.0:1788201313.346531:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570083968 00000100:00100000:3.0:1788201313.346900:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788201313.346914:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570083968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201313.347023:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570083968:12345-0@lo:400:kworker.0 Request processed in 112us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201313.347031:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:1.0:1788201313.347394:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201313.347437:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570083968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201313.846843:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201313.846879:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570084096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201313.846988:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201313.847175:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570084096 00000100:00100000:2.0:1788201313.847187:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570084096 00000100:00100000:2.0:1788201313.847261:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788201313.847272:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570084096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201313.847320:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201313.847418:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570084096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201313.847446:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:3.0:1788201313.847731:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfe69500 x1875064570084096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201313.847755:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570084096:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201314.041897:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201314.108068:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201314.108125:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201314.108166:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201314.108202:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201314.108408:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559551104 00000100:00100000:1.0:1788201314.108421:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559551104 00000100:00100000:1.0:1788201314.108502:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 380 00000100:00100000:1.0:1788201314.108515:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559551104:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201314.108632:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559551104:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 119us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201314.108642:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 380 00000100:00100000:3.0:1788201314.109911:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559551232 00000100:00100000:3.0:1788201314.109923:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559551232 00000100:00100000:3.0:1788201314.110009:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 213 00000100:00100000:3.0:1788201314.110021:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2342:x1875064559551232:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201314.110118:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2342:x1875064559551232:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 99us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201314.110127:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 213 00000100:00100000:0.0:1788201314.111221:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559551360 00000100:00100000:0.0:1788201314.111237:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559551360 00000100:00100000:0.0:1788201314.111285:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559551488 00000100:00100000:0.0:1788201314.111289:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559551488 00000100:00100000:0.0:1788201314.111326:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 119 00000100:00100000:0.0:1788201314.111337:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559551360:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201314.111438:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559551360:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 103us (3311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201314.111446:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 119 00000100:00100000:0.0:1788201314.111467:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:0.0:1788201314.111474:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559551488:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201314.111502:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559551488:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 28us (3299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201314.111528:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00080000:1.0:1788201314.114517:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201314.114531:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201314.114535:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201314.870696:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201314.870728:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570084224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201314.870828:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201314.871081:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570084224 00000100:00100000:2.0:1788201314.871092:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570084224 00000100:00100000:2.0:1788201314.871170:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788201314.871182:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570084224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201314.871231:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47906816 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201314.871295:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570084224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201314.871303:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788201314.871397:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570084224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201315.063001:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201315.558652:0:15991:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00010000:00010000:3.0:1788201316.086541:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201317.089971:0:16041:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1788201317.113128:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201318.134757:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201318.456573:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570084736:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.456698:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.456790:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201318.456797:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570084352:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.456841:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.456881:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570084864:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.456909:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.456948:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570084736 00000100:00100000:1.0:1788201318.456957:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570084736 00000100:00100000:1.0:1788201318.457034:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788201318.457046:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570084736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.457114:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570084736:12345-0@lo:400:kworker.0 Request processed in 69us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.457123:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788201318.457148:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570084352 00000100:00100000:1.0:1788201318.457153:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570084352 00000100:00100000:1.0:1788201318.457596:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788201318.457607:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570084352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.457645:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570084352:12345-0@lo:400:kworker.0 Request processed in 42us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.457651:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788201318.457687:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570084864 00000100:00100000:1.0:1788201318.457691:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570084864 00000100:00100000:1.0:1788201318.457725:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788201318.457732:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570084864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.457764:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570084864:12345-0@lo:400:kworker.0 Request processed in 32us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.457790:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1788201318.457809:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201318.457814:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201318.457911:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570084608:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.457950:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.457975:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201318.457982:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570084480:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.458005:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.458032:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570084608 00000100:00100000:0.0:1788201318.458036:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570084608 00000100:00100000:0.0:1788201318.458073:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788201318.458080:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570084608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.458118:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570084608:12345-0@lo:400:kworker.0 Request processed in 38us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.458125:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1788201318.458141:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201318.458175:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570084608:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.458722:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570084992:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.458771:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.458826:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570084480 00000100:00100000:3.0:1788201318.458832:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570084480 00000100:00100000:3.0:1788201318.458862:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570084992 00000100:00100000:3.0:1788201318.458865:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570084992 00000100:00100000:3.0:1788201318.458976:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788201318.458982:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570084480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.459019:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570084480:12345-0@lo:400:kworker.0 Request processed in 38us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.459026:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788201318.459043:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788201318.459049:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570084992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.459076:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570084992:12345-0@lo:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.459081:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788201318.459484:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570084992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.460133:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570084352:0@lo:400:kworker.0 00010000:00080000:1.0:1788201318.460156:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba85b480 x1875064570084864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201318.460169:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570084864:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.460183:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570084736:0@lo:400:kworker.0 00000100:00080000:0.0:1788201318.460481:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201318.460530:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570084480:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.935653:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201318.935846:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559551616 00000100:00100000:3.0:1788201318.935861:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559551616 00000100:00100000:3.0:1788201318.935963:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:3.0:1788201318.935976:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:14126:x1875064559551616:12345-192.168.201.56@tcp:41:lfs.0 00000100:00080000:0.0:1788201318.936008:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788201318.936039:0:5827:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788201318.936205:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:14126:x1875064559551616:12345-192.168.201.56@tcp:41:lfs.0 Request processed in 231us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.936215:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:2.0:1788201318.945023:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201318.958121:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559551744 00000100:00100000:0.0:1788201318.958144:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559551744 00000100:00100000:0.0:1788201318.958283:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 119 00000100:00100000:0.0:1788201318.958296:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:14126:x1875064559551744:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:0.0:1788201318.958541:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47906816 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201318.958662:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:14126:x1875064559551744:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 367us (13656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.958689:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 119 00000100:00080000:2.0:1788201318.960901:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201318.960983:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201318.961542:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559551872 00000100:00100000:1.0:1788201318.961556:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559551872 00000100:00100000:1.0:1788201318.961651:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:1.0:1788201318.961663:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:14126:x1875064559551872:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:1.0:1788201318.961729:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201318.961822:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:14126:x1875064559551872:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 161us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.961830:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00080000:2.0:1788201318.961942:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201318.966591:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201318.966626:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570085120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201318.966748:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.967025:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570085120 00000100:00100000:1.0:1788201318.967037:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570085120 00000100:00100000:1.0:1788201318.967109:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788201318.967122:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570085120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201318.967171:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201318.967242:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570085120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.967275:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:2.0:1788201318.967700:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfe68a80 x1875064570085120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201318.967751:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570085120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201319.031734:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201319.031876:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559552128 00000100:00100000:2.0:1788201319.031889:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559552128 00000100:00100000:2.0:1788201319.031972:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:2.0:1788201319.031983:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:14144:x1875064559552128:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:2.0:1788201319.032017:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201319.032047:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4800/0xa81c4c9a2f3cb117 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a01 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.032180:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb11e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.032198:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb11e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.032215:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb11e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201319.032230:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 6 00010000:00010000:2.0:1788201319.034837:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4800/0xa81c4c9a2f3cb117 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a01 expref: 20 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.034874:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb11e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a01 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.034884:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962487f56b00) 00010000:00010000:2.0:1788201319.034887:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201319.034911:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5200, rc 0) 00000100:00100000:2.0:1788201319.035014:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:14144:x1875064559552128:12345-192.168.201.56@tcp:101:grep.0 Request processed in 3031us (3299us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788201319.035025:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:3.0:1788201319.049033:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.049212:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559552256 00000100:00100000:1.0:1788201319.049226:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559552256 00000100:00100000:1.0:1788201319.049308:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 85 00000100:00100000:1.0:1788201319.049320:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559552256:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:1.0:1788201319.049392:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201319.049427:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acc227d1/0xa81c4c9a2f3cb12c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a08 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201319.057673:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 6, mtime: 0x6a95c93c, atime: 0x0, ctime: 0x6a95c93c, blocks: 0xb 00010000:00010000:3.0:1788201319.057855:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788201319.057864:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201319.057887:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acc227d1/0xa81c4c9a2f3cb12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a08 expref: 9 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.058029:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000acc227d1/0xa81c4c9a2f3cb12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a08 expref: 9 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201319.058047:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:3.0:1788201319.058052:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac3400, rc 0) 00000100:00100000:3.0:1788201319.058159:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559552256:12345-192.168.201.56@tcp:101:grep.0 Request processed in 8839us (9144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201319.058171:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 85 00000100:00100000:3.0:1788201319.060662:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.060799:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559552512 00000100:00100000:0.0:1788201319.060812:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559552512 00002000:00100000:0.0:1788201319.060875:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9624bfe6aa00 x1875064559552512/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/0 e 0 to 0 dl 1788201330 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201319.060887:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe6aa00 with x1875064559552512 ext(0->4095) 00002000:00010000:0.0:1788201319.060894:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe6aa00 00000100:00100000:0.0:1788201319.060938:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:0.0:1788201319.060950:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559552512:12345-192.168.201.56@tcp:3:grep.0 00000100:00100000:0.0:1788201319.065181:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559552512:12345-192.168.201.56@tcp:3:grep.0 Request processed in 4219us (4521us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788201319.065194:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 14 00002000:00100000:0.0:1788201319.065205:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9624bfe6aa00 x1875064559552512/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/4536 e 0 to 0 dl 1788201330 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201319.065216:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe6aa00 with x1875064559552512 ext(0->4095) 00002000:00010000:0.0:1788201319.065222:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe6aa00 00000100:00100000:2.0:1788201319.067475:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559552384 00000100:00100000:2.0:1788201319.067508:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559552384 00000100:00100000:2.0:1788201319.067615:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:2.0:1788201319.067630:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:2344:x1875064559552384:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201319.067654:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201319.067689:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb11e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a01 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.067713:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962487f56b00) 00010000:00010000:2.0:1788201319.067730:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201319.068449:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559552384:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 820us (10401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201319.068460:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:3.0:1788201319.075259:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201319.075508:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559552768 00000100:00100000:2.0:1788201319.075521:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559552768 00000100:00100000:2.0:1788201319.075589:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:2.0:1788201319.075602:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:14144:x1875064559552768:12345-192.168.201.56@tcp:35:grep.0 00000100:00100000:2.0:1788201319.076089:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:14144:x1875064559552768:12345-192.168.201.56@tcp:35:grep.0 Request processed in 488us (842us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788201319.076098:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:0.0:1788201319.086780:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.086921:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559553024 00000100:00100000:1.0:1788201319.086937:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559553024 00000100:00100000:1.0:1788201319.087028:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:1.0:1788201319.087042:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:14148:x1875064559553024:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:1.0:1788201319.087081:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201319.087113:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2c00/0xa81c4c9a2f3cb133 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a0f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.087600:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb13a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.087994:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb13a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.088010:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb13a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201319.088059:0:6693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 6 00010000:00010000:1.0:1788201319.088262:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2c00/0xa81c4c9a2f3cb133 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a0f expref: 22 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.088287:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb13a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a0f expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.088297:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9624a84c1300) 00010000:00010000:1.0:1788201319.088299:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201319.088303:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac3200, rc 0) 00000100:00100000:1.0:1788201319.091075:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:14148:x1875064559553024:12345-192.168.201.56@tcp:101:grep.0 Request processed in 4021us (4295us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788201319.091093:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:1.0:1788201319.098869:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.098934:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201319.098965:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559553152 00000100:00100000:3.0:1788201319.098985:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559553152 00000100:00100000:3.0:1788201319.099076:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 86 00000100:00100000:3.0:1788201319.099089:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559553152:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:3.0:1788201319.099116:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201319.099160:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cb148 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a16 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201319.099445:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559553280 00000100:00100000:0.0:1788201319.099458:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559553280 00000100:00100000:0.0:1788201319.099834:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:0.0:1788201319.099847:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485694c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:2342:x1875064559553280:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201319.099866:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201319.099897:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb13a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a0f expref: 21 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.099945:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9624a84c1300) 00010000:00010000:0.0:1788201319.099951:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201319.100037:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485694c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559553280:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 193us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201319.100050:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00002000:00010000:3.0:1788201319.106675:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 6, mtime: 0x6a95c93c, atime: 0x0, ctime: 0x6a95c93c, blocks: 0xb 00010000:00010000:3.0:1788201319.106738:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1788201319.106745:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201319.106772:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cb148 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a16 expref: 10 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.106810:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cb148 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a16 expref: 10 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.106852:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7cc00, rc 0) 00000100:00100000:3.0:1788201319.107139:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559553152:12345-192.168.201.56@tcp:101:grep.0 Request processed in 7873us (8104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201319.107153:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 86 00000100:00100000:1.0:1788201319.112712:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201319.112903:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559553408 00000100:00100000:3.0:1788201319.112915:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559553408 00002000:00100000:3.0:1788201319.112973:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->4095) req@ffff9624b9c62a00 x1875064559553408/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/0 e 0 to 0 dl 1788201330 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201319.112985:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c62a00 with x1875064559553408 ext(0->4095) 00002000:00010000:3.0:1788201319.112991:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c62a00 00000100:00100000:3.0:1788201319.113025:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:3.0:1788201319.113036:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559553408:12345-192.168.201.56@tcp:3:grep.0 00000100:00100000:2.0:1788201319.115090:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559553408:12345-192.168.201.56@tcp:3:grep.0 Request processed in 2044us (2379us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788201319.115119:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00002000:00100000:2.0:1788201319.115132:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->4095) req@ffff9624b9c62a00 x1875064559553408/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/4536 e 0 to 0 dl 1788201330 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201319.115142:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c62a00 with x1875064559553408 ext(0->4095) 00002000:00010000:2.0:1788201319.115148:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c62a00 00000100:00100000:2.0:1788201319.119890:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.120207:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559553664 00000100:00100000:1.0:1788201319.120218:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559553664 00000100:00100000:1.0:1788201319.120290:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:1.0:1788201319.120302:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:14148:x1875064559553664:12345-192.168.201.56@tcp:35:grep.0 00000100:00100000:1.0:1788201319.120940:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:14148:x1875064559553664:12345-192.168.201.56@tcp:35:grep.0 Request processed in 638us (1058us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788201319.120952:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:0.0:1788201319.138404:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201319.139221:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559553920 00000100:00100000:2.0:1788201319.139237:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559553920 00000100:00100000:2.0:1788201319.139384:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:2.0:1788201319.139399:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:14152:x1875064559553920:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:2.0:1788201319.139443:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201319.139476:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4800/0xa81c4c9a2f3cb14f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a1d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.139647:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb156 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.139665:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb156 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.139683:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb156 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201319.139697:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x5:0x0]: returning size 6 00010000:00010000:2.0:1788201319.139878:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4800/0xa81c4c9a2f3cb14f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a1d expref: 24 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.139902:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb156 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a1d expref: 23 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.139933:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff9624942a6700) 00010000:00010000:2.0:1788201319.139937:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201319.139942:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5200, rc 0) 00000100:00100000:2.0:1788201319.141276:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+23:14152:x1875064559553920:12345-192.168.201.56@tcp:101:grep.0 Request processed in 1858us (2912us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788201319.141292:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:3.0:1788201319.156476:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.156931:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559554048 00000100:00100000:0.0:1788201319.156947:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559554048 00000100:00100000:0.0:1788201319.157045:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 87 00000100:00100000:0.0:1788201319.157058:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559554048:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:0.0:1788201319.157084:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201319.157114:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fffbf27/0xa81c4c9a2f3cb164 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a24 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.159169:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201319.164418:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 6, mtime: 0x6a95c93c, atime: 0x0, ctime: 0x6a95c93c, blocks: 0xb 00010000:00010000:1.0:1788201319.164462:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788201319.164497:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201319.164527:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fffbf27/0xa81c4c9a2f3cb164 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a24 expref: 11 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.164578:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009fffbf27/0xa81c4c9a2f3cb164 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a24 expref: 11 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.164598:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4df000, rc 0) 00000100:00100000:1.0:1788201319.164714:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:2344:x1875064559554048:12345-192.168.201.56@tcp:101:grep.0 Request processed in 7657us (8254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.164726:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 87 00000100:00100000:3.0:1788201319.165293:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.165586:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559554176 00000100:00100000:1.0:1788201319.165597:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559554176 00000100:00100000:1.0:1788201319.165659:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:1.0:1788201319.165670:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+23:2341:x1875064559554176:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201319.165833:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201319.165865:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb156 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a1d expref: 23 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.165887:0:11284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff9624942a6700) 00010000:00010000:1.0:1788201319.165893:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201319.165938:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559554176:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 270us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.165945:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:3.0:1788201319.168311:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.172989:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559554304 00000100:00100000:1.0:1788201319.173012:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559554304 00002000:00100000:1.0:1788201319.173093:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9624bfe6b800 x1875064559554304/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/0 e 0 to 0 dl 1788201330 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201319.173123:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe6b800 with x1875064559554304 ext(0->4095) 00002000:00010000:1.0:1788201319.173132:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe6b800 00000100:00100000:1.0:1788201319.173452:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:1.0:1788201319.173465:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:2343:x1875064559554304:12345-192.168.201.56@tcp:3:grep.0 00000100:00100000:1.0:1788201319.178613:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:2343:x1875064559554304:12345-192.168.201.56@tcp:3:grep.0 Request processed in 5134us (10304us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788201319.178630:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00002000:00100000:1.0:1788201319.178643:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9624bfe6b800 x1875064559554304/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/4536 e 0 to 0 dl 1788201330 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201319.178655:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe6b800 with x1875064559554304 ext(0->4095) 00002000:00010000:1.0:1788201319.178663:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe6b800 00000100:00100000:3.0:1788201319.193417:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.193698:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559554560 00000100:00100000:0.0:1788201319.193712:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559554560 00000100:00100000:0.0:1788201319.193795:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:0.0:1788201319.193807:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624afebd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:14152:x1875064559554560:12345-192.168.201.56@tcp:35:grep.0 00000100:00100000:0.0:1788201319.194323:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624afebd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+23:14152:x1875064559554560:12345-192.168.201.56@tcp:35:grep.0 Request processed in 515us (920us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788201319.194332:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:3.0:1788201319.216751:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.218716:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559554816 00000100:00100000:0.0:1788201319.218740:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559554816 00000100:00100000:0.0:1788201319.218830:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:0.0:1788201319.218843:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+23:14156:x1875064559554816:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:0.0:1788201319.218908:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201319.218936:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb16b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a2b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.219075:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb172 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.219093:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.219112:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201319.219127:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x6:0x0]: returning size 6 00010000:00010000:0.0:1788201319.219582:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb16b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a2b expref: 26 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.219607:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb172 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a2b expref: 25 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.219616:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9624a8e9f700) 00010000:00010000:0.0:1788201319.219619:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201319.219623:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4de200, rc 0) 00000100:00100000:0.0:1788201319.219711:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:14156:x1875064559554816:12345-192.168.201.56@tcp:101:grep.0 Request processed in 871us (2977us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1788201319.219720:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:3.0:1788201319.222542:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201319.222623:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559554944 00000100:00100000:2.0:1788201319.222638:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559554944 00000100:00100000:2.0:1788201319.222717:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 382 00000100:00100000:2.0:1788201319.222731:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559554944:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201319.222842:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559554944:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 114us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201319.222851:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 382 00000100:00100000:3.0:1788201319.229519:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.229665:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559555072 00000100:00100000:1.0:1788201319.229682:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559555072 00000100:00100000:1.0:1788201319.229774:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 123 00000100:00100000:1.0:1788201319.229786:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559555072:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201319.229918:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559555072:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 134us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.229928:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 123 00000100:00100000:0.0:1788201319.236758:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201319.238512:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559555456 00000100:00100000:2.0:1788201319.238540:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559555456 00000100:00100000:2.0:1788201319.238658:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:2.0:1788201319.238673:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:2343:x1875064559555456:12345-192.168.201.56@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201319.238742:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201319.238775:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3cb180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a39 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.238862:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb187 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.238880:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb187 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.238915:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb187 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.239282:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb18e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.239309:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb18e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.239324:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb18e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.239804:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb187 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.239814:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb187 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.239821:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb187 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.239828:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5200 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.239832:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb187 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.239840:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb187 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.239855:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201319.239858:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201319.239863:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb187 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.239877:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5200/0xa81c4c9a2f3cb187 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.239890:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb18e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.239895:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb18e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.239900:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb18e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.240085:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962481513c00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.240089:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb18e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.240095:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb18e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.240105:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9f9252 (ffff9624a84c1f00) 00010000:00010000:2.0:1788201319.240107:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201319.240111:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb18e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.240116:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb18e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.240162:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3cb180 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a39 expref: 26 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.240184:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201319.240186:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201319.240190:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5800/0xa81c4c9a2f3cb180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a39 expref: 26 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.240200:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624829c5800, rc -2) 00000100:00100000:2.0:1788201319.240406:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:2343:x1875064559555456:12345-192.168.201.56@tcp:63:ll_sa.0 Request processed in 1726us (3651us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201319.240417:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:3.0:1788201319.245684:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201319.246809:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201319.246840:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201319.246865:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.246867:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559555328 00000100:00100000:0.0:1788201319.246880:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559555328 00000100:00100000:3.0:1788201319.246900:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.246941:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559555584 00000100:00100000:0.0:1788201319.246946:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559555584 00000100:00100000:3.0:1788201319.246950:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559555840 00000100:00100000:3.0:1788201319.246956:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559555840 00000100:00100000:0.0:1788201319.246963:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559555712 00000100:00100000:0.0:1788201319.246967:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559555712 00000100:00100000:3.0:1788201319.246991:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 88 00000100:00100000:1.0:1788201319.247209:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559555200 00000100:00100000:1.0:1788201319.247214:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559555200 00000100:00100000:3.0:1788201319.247247:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2341:x1875064559555328:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:3.0:1788201319.247268:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201319.247289:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb195 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a32 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201319.253496:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 89 00000100:00100000:0.0:1788201319.254797:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2341:x1875064559555584:12345-192.168.201.56@tcp:101:ll_agl.0 00010000:00010000:0.0:1788201319.254836:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201319.254862:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb19c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a47 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201319.255151:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:0.0:1788201319.255162:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:2341:x1875064559555200:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201319.255177:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201319.255203:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb172 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a2b expref: 25 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.255222:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9624a8e9f700) 00010000:00010000:0.0:1788201319.255228:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201319.255298:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559555200:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 138us (9632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201319.255305:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 18 00002000:00010000:1.0:1788201319.268285:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 6, mtime: 0x6a95c93c, atime: 0x0, ctime: 0x6a95c93c, blocks: 0xb 00010000:00010000:1.0:1788201319.268320:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788201319.268325:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201319.268377:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb19c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a47 expref: 15 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.268430:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb19c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a47 expref: 15 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.268446:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4df600, rc 0) 00000100:00100000:1.0:1788201319.268535:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2341:x1875064559555584:12345-192.168.201.56@tcp:101:ll_agl.0 Request processed in 15024us (21693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.268546:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 89 00000100:00100000:1.0:1788201319.268582:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 90 00000100:00100000:1.0:1788201319.268594:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559555840:12345-192.168.201.56@tcp:101:ll_agl.0 00010000:00010000:1.0:1788201319.268610:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201319.268629:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3cb1a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a55 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201319.269776:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 6, mtime: 0x6a95c93c, atime: 0x0, ctime: 0x6a95c93c, blocks: 0xb 00010000:00010000:0.0:1788201319.269801:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788201319.269806:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201319.269817:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb195 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a32 expref: 15 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.269849:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb195 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a32 expref: 15 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.269860:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7d400, rc 0) 00000100:00100000:0.0:1788201319.269914:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2341:x1875064559555328:12345-192.168.201.56@tcp:101:grep.0 Request processed in 22913us (23110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201319.269921:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 88 00000100:00100000:0.0:1788201319.269947:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 91 00000100:00100000:0.0:1788201319.269957:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559555712:12345-192.168.201.56@tcp:101:ll_sa.0 00010000:00010000:0.0:1788201319.269967:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201319.269981:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3cb1aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a4e expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201319.272557:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 6, mtime: 0x6a95c93c, atime: 0x0, ctime: 0x6a95c93c, blocks: 0xb 00010000:00010000:0.0:1788201319.272587:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788201319.272592:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201319.272608:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3cb1aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a4e expref: 15 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.272629:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3cb1aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a4e expref: 15 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.272642:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4de200, rc 0) 00000100:00100000:0.0:1788201319.272727:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2343:x1875064559555712:12345-192.168.201.56@tcp:101:ll_sa.0 Request processed in 2771us (25825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201319.272735:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 91 00000100:00100000:3.0:1788201319.273125:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.273664:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559555968 00000100:00100000:0.0:1788201319.273676:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559555968 00002000:00100000:0.0:1788201319.273825:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7:0x0] (0->4095) req@ffff962490589880 x1875064559555968/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/0 e 0 to 0 dl 1788201330 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201319.273836:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962490589880 with x1875064559555968 ext(0->4095) 00002000:00010000:0.0:1788201319.273842:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962490589880 00000100:00100000:0.0:1788201319.273873:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:0.0:1788201319.273883:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2342:x1875064559555968:12345-192.168.201.56@tcp:3:grep.0 00002000:00010000:2.0:1788201319.274223:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 6, mtime: 0x6a95c93c, atime: 0x0, ctime: 0x6a95c93c, blocks: 0xb 00010000:00010000:2.0:1788201319.274243:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1788201319.274248:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201319.274258:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3cb1a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a55 expref: 16 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.274285:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3cb1a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a55 expref: 16 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.274297:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac2c00, rc 0) 00000100:00100000:2.0:1788201319.274381:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559555840:12345-192.168.201.56@tcp:101:ll_agl.0 Request processed in 5790us (27514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201319.274388:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 90 00000100:00100000:0.0:1788201319.275997:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2342:x1875064559555968:12345-192.168.201.56@tcp:3:grep.0 Request processed in 2106us (2864us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788201319.276009:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 17 00002000:00100000:0.0:1788201319.276018:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x7:0x0] (0->4095) req@ffff962490589880 x1875064559555968/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/4536 e 0 to 0 dl 1788201330 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201319.276028:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962490589880 with x1875064559555968 ext(0->4095) 00002000:00010000:0.0:1788201319.276033:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962490589880 00000100:00100000:2.0:1788201319.291184:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.291299:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559556224 00000100:00100000:0.0:1788201319.291309:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559556224 00000100:00100000:0.0:1788201319.291393:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:0.0:1788201319.291529:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:14156:x1875064559556224:12345-192.168.201.56@tcp:35:grep.0 00000100:00100000:0.0:1788201319.292136:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:14156:x1875064559556224:12345-192.168.201.56@tcp:35:grep.0 Request processed in 610us (961us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788201319.292145:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:3.0:1788201319.312650:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.313583:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559556608 00000100:00100000:1.0:1788201319.313607:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559556608 00000100:00100000:2.0:1788201319.313628:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.313708:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:1.0:1788201319.313722:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96249058b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:2344:x1875064559556608:12345-192.168.201.56@tcp:63:ll_sa.0 00010000:00010000:1.0:1788201319.313807:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201319.313833:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2200/0xa81c4c9a2f3cb1b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.313906:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb1b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.313921:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.313943:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.313961:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3cb1bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbacd9252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.313968:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3cb1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.313975:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3cb1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.314276:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.314286:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb1b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.314293:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb1b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.314299:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3200 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201319.314303:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb1b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.314310:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb1b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.314323:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201319.314327:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201319.314332:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb1b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.314394:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb1b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201319.314637:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559556480 00000100:00100000:0.0:1788201319.314645:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559556480 00000100:00100000:0.0:1788201319.314699:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:0.0:1788201319.314710:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+27:14159:x1875064559556480:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:0.0:1788201319.314723:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201319.314735:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb1c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a5c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.314813:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb1cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.314823:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb1cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.314832:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb1cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201319.314843:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 6 00010000:00010000:0.0:1788201319.314972:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb1c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a5c expref: 30 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.314991:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb1cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a5c expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.314999:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962487f56000) 00010000:00010000:0.0:1788201319.315001:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201319.315004:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dfa00, rc 0) 00000100:00100000:0.0:1788201319.315080:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+29:14159:x1875064559556480:12345-192.168.201.56@tcp:101:grep.0 Request processed in 373us (1461us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788201319.315100:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 60 00010000:00010000:1.0:1788201319.315566:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3cb1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.315573:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3cb1bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.315580:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3cb1bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.315586:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201319.315590:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3cb1bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.315597:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3cb1bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.315611:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbacd9252 (ffff9624a8490d00) 00010000:00010000:1.0:1788201319.315614:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201319.315618:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3cb1bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.315624:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2600/0xa81c4c9a2f3cb1bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbacd9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.315655:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2200/0xa81c4c9a2f3cb1b1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a63 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.315679:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201319.315681:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201319.315685:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2200/0xa81c4c9a2f3cb1b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a63 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.315694:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac2200, rc -2) 00000100:00100000:1.0:1788201319.315752:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96249058b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+27:2344:x1875064559556608:12345-192.168.201.56@tcp:63:ll_sa.0 Request processed in 2035us (3119us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201319.315760:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:3.0:1788201319.319048:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.319170:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559556736 00000100:00100000:1.0:1788201319.319183:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559556736 00000100:00100000:1.0:1788201319.319260:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:1.0:1788201319.319272:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+27:2341:x1875064559556736:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201319.319291:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201319.319318:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb1cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a5c expref: 27 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.319338:0:11284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962487f56000) 00010000:00010000:1.0:1788201319.319375:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201319.319560:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559556736:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 291us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.319568:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:2.0:1788201319.330799:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201319.334886:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559556864 00000100:00100000:2.0:1788201319.334906:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559556864 00002000:00100000:2.0:1788201319.334976:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x8:0x0] (0->4095) req@ffff9624ba859880 x1875064559556864/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/0 e 0 to 0 dl 1788201330 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201319.334988:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba859880 with x1875064559556864 ext(0->4095) 00002000:00010000:2.0:1788201319.334994:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba859880 00000100:00100000:2.0:1788201319.335039:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:2.0:1788201319.335050:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2341:x1875064559556864:12345-192.168.201.56@tcp:3:grep.0 00000100:00100000:2.0:1788201319.336140:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2341:x1875064559556864:12345-192.168.201.56@tcp:3:grep.0 Request processed in 1084us (5351us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788201319.336153:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 18 00002000:00100000:2.0:1788201319.336161:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x8:0x0] (0->4095) req@ffff9624ba859880 x1875064559556864/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/4536 e 0 to 0 dl 1788201330 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201319.336172:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba859880 with x1875064559556864 ext(0->4095) 00002000:00010000:2.0:1788201319.336178:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba859880 00000100:00100000:1.0:1788201319.345975:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201319.350976:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559557120 00000100:00100000:2.0:1788201319.350997:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559557120 00000100:00100000:2.0:1788201319.351137:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:2.0:1788201319.351150:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:14159:x1875064559557120:12345-192.168.201.56@tcp:35:grep.0 00000100:00100000:2.0:1788201319.351607:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+27:14159:x1875064559557120:12345-192.168.201.56@tcp:35:grep.0 Request processed in 457us (5639us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788201319.351615:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:3.0:1788201319.391934:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.393413:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559557376 00000100:00100000:0.0:1788201319.393429:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559557376 00000100:00100000:0.0:1788201319.393513:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:0.0:1788201319.393525:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+27:14160:x1875064559557376:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:0.0:1788201319.393553:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201319.393577:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb1db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a6a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.393686:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb1e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.393701:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.393712:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201319.393723:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 6 00010000:00010000:0.0:1788201319.393859:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb1db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a6a expref: 30 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.393880:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a6a expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.393888:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff9624a84c1a00) 00010000:00010000:0.0:1788201319.393891:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201319.393894:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4df800, rc 0) 00000100:00100000:0.0:1788201319.393987:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+29:14160:x1875064559557376:12345-192.168.201.56@tcp:101:grep.0 Request processed in 464us (2064us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788201319.393995:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:3.0:1788201319.397929:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.398081:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559557504 00000100:00100000:0.0:1788201319.398095:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559557504 00002000:00100000:0.0:1788201319.398152:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (0->4095) req@ffff9624b9d60e00 x1875064559557504/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/0 e 0 to 0 dl 1788201330 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201319.398163:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d60e00 with x1875064559557504 ext(0->4095) 00002000:00010000:0.0:1788201319.398169:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d60e00 00000100:00100000:0.0:1788201319.398205:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:0.0:1788201319.398216:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2341:x1875064559557504:12345-192.168.201.56@tcp:3:grep.0 00000100:00100000:3.0:1788201319.399171:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.399708:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559557632 00000100:00100000:0.0:1788201319.399728:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559557632 00000100:00100000:0.0:1788201319.399784:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:0.0:1788201319.399795:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+29:2342:x1875064559557632:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201319.399809:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201319.399836:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb1e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a6a expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.399855:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff9624a84c1a00) 00010000:00010000:0.0:1788201319.399859:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201319.399924:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559557632:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 130us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201319.399931:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:0.0:1788201319.401955:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2341:x1875064559557504:12345-192.168.201.56@tcp:3:grep.0 Request processed in 3725us (4026us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788201319.401990:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00002000:00100000:0.0:1788201319.402002:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (0->4095) req@ffff9624b9d60e00 x1875064559557504/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/4536 e 0 to 0 dl 1788201330 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201319.402013:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d60e00 with x1875064559557504 ext(0->4095) 00002000:00010000:0.0:1788201319.402018:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d60e00 00000100:00100000:3.0:1788201319.413812:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.414109:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559557888 00000100:00100000:0.0:1788201319.414121:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559557888 00000100:00100000:0.0:1788201319.414183:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:0.0:1788201319.414194:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:14160:x1875064559557888:12345-192.168.201.56@tcp:35:grep.0 00000100:00100000:0.0:1788201319.414628:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+29:14160:x1875064559557888:12345-192.168.201.56@tcp:35:grep.0 Request processed in 434us (824us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788201319.414635:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:3.0:1788201319.431593:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201319.431823:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559558144 00000100:00100000:2.0:1788201319.431834:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559558144 00000100:00100000:2.0:1788201319.431895:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:2.0:1788201319.431929:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+29:14161:x1875064559558144:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:2.0:1788201319.431956:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201319.431979:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962481512000/0xa81c4c9a2f3cb1f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a71 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.432091:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb1f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.432105:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.432116:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201319.432127:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 6 00010000:00010000:2.0:1788201319.432560:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962481512000/0xa81c4c9a2f3cb1f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a71 expref: 32 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.432586:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a71 expref: 31 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.432595:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9624a8e9fd00) 00010000:00010000:2.0:1788201319.432598:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201319.432601:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962481512e00, rc 0) 00000100:00100000:2.0:1788201319.432667:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+31:14161:x1875064559558144:12345-192.168.201.56@tcp:101:grep.0 Request processed in 739us (1087us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788201319.432675:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:1.0:1788201319.435713:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201319.435793:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559558272 00000100:00100000:2.0:1788201319.435804:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559558272 00002000:00100000:2.0:1788201319.435869:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa:0x0] (0->4095) req@ffff9624b9c60000 x1875064559558272/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/0 e 0 to 0 dl 1788201330 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201319.435880:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c60000 with x1875064559558272 ext(0->4095) 00002000:00010000:2.0:1788201319.435886:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c60000 00000100:00100000:2.0:1788201319.435920:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:2.0:1788201319.435930:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2342:x1875064559558272:12345-192.168.201.56@tcp:3:grep.0 00000100:00100000:3.0:1788201319.437871:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.438116:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559558400 00000100:00100000:0.0:1788201319.438126:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559558400 00000100:00100000:0.0:1788201319.438192:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:0.0:1788201319.438203:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+31:2341:x1875064559558400:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201319.438219:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201319.438244:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb1f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a71 expref: 31 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.438277:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9624a8e9fd00) 00010000:00010000:0.0:1788201319.438282:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201319.438377:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2341:x1875064559558400:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 175us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201319.438385:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:2.0:1788201319.439309:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2342:x1875064559558272:12345-192.168.201.56@tcp:3:grep.0 Request processed in 3377us (3602us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788201319.439320:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 20 00002000:00100000:2.0:1788201319.439330:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa:0x0] (0->4095) req@ffff9624b9c60000 x1875064559558272/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:440/0 lens 488/4536 e 0 to 0 dl 1788201330 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201319.439375:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c60000 with x1875064559558272 ext(0->4095) 00002000:00010000:2.0:1788201319.439382:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c60000 00000100:00100000:3.0:1788201319.445865:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.445936:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559558656 00000100:00100000:0.0:1788201319.445947:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559558656 00000100:00100000:0.0:1788201319.446017:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:0.0:1788201319.446028:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:14161:x1875064559558656:12345-192.168.201.56@tcp:35:grep.0 00000100:00100000:0.0:1788201319.446940:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+31:14161:x1875064559558656:12345-192.168.201.56@tcp:35:grep.0 Request processed in 907us (1078us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788201319.446951:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:3.0:1788201319.471929:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.472197:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559558912 00000100:00100000:0.0:1788201319.472208:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559558912 00000100:00100000:0.0:1788201319.472310:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:0.0:1788201319.472322:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+31:14162:x1875064559558912:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:0.0:1788201319.472381:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201319.472403:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb205 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a78 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.472524:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb20c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.472541:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb20c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.472553:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb20c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201319.472577:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 6 00010000:00010000:0.0:1788201319.472734:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb205 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a78 expref: 34 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.472755:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb20c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a78 expref: 33 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.472780:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9624a84c1100) 00010000:00010000:0.0:1788201319.472783:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201319.472786:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dea00, rc 0) 00000100:00100000:0.0:1788201319.472856:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+33:14162:x1875064559558912:12345-192.168.201.56@tcp:101:grep.0 Request processed in 536us (939us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788201319.472863:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:3.0:1788201319.481718:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201319.481766:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201319.481874:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559559296 00000100:00100000:2.0:1788201319.481884:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559559296 00000100:00100000:2.0:1788201319.481950:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00100000:2.0:1788201319.481961:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+33:14162:x1875064559559296:12345-192.168.201.56@tcp:35:grep.0 00000100:00100000:2.0:1788201319.482249:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:14162:x1875064559559296:12345-192.168.201.56@tcp:35:grep.0 Request processed in 289us (480us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788201319.482258:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00100000:1.0:1788201319.482550:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559559040 00000100:00100000:1.0:1788201319.482723:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559559040 00000100:00100000:1.0:1788201319.482775:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:1.0:1788201319.482783:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559559040:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201319.482796:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201319.482824:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb20c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a78 expref: 34 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.482851:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9624a84c1100) 00010000:00010000:1.0:1788201319.482856:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201319.482891:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+33:2341:x1875064559559040:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 108us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.482897:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:3.0:1788201319.500099:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.500233:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559559552 00000100:00100000:0.0:1788201319.500253:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559559552 00000100:00100000:0.0:1788201319.500386:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 64 00000100:00100000:0.0:1788201319.500399:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+33:14163:x1875064559559552:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:0.0:1788201319.500435:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201319.500464:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb21a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.500613:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb221 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.500628:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb221 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.500639:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb221 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201319.500650:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 6 00010000:00010000:0.0:1788201319.500786:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb21a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a7f expref: 36 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.500823:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb221 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a7f expref: 35 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.500832:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962487f56600) 00010000:00010000:0.0:1788201319.500835:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201319.500838:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4de600, rc 0) 00000100:00100000:0.0:1788201319.500910:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+35:14163:x1875064559559552:12345-192.168.201.56@tcp:101:grep.0 Request processed in 514us (829us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788201319.500917:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 64 00000100:00100000:3.0:1788201319.503121:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.503227:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559559680 00000100:00100000:1.0:1788201319.503244:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559559680 00000100:00100000:1.0:1788201319.503323:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:1.0:1788201319.503333:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485695050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+35:2343:x1875064559559680:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201319.503382:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201319.503407:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb221 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a7f expref: 35 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.503433:0:11284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962487f56600) 00010000:00010000:1.0:1788201319.503440:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201319.503529:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485695050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559559680:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 196us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.503537:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:2.0:1788201319.507520:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.509786:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559559936 00000100:00100000:1.0:1788201319.509808:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559559936 00000100:00100000:1.0:1788201319.509939:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:1.0:1788201319.509953:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624afebfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:14163:x1875064559559936:12345-192.168.201.56@tcp:35:grep.0 00000100:00100000:1.0:1788201319.510808:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624afebfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+35:14163:x1875064559559936:12345-192.168.201.56@tcp:35:grep.0 Request processed in 851us (3299us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788201319.510819:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:2.0:1788201319.518693:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.518878:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559560192 00000100:00100000:1.0:1788201319.518893:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559560192 00000100:00100000:0.0:1788201319.519048:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 65 00000100:00100000:0.0:1788201319.519063:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+35:14164:x1875064559560192:12345-192.168.201.56@tcp:101:grep.0 00010000:00010000:0.0:1788201319.519099:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201319.519129:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb22f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a86 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.527013:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb236 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.527040:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.527056:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201319.527083:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xc:0x0]: returning size 7 00010000:00010000:0.0:1788201319.527284:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb22f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a86 expref: 38 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.530175:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb236 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a86 expref: 37 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.530186:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9624a8e9f600) 00010000:00010000:0.0:1788201319.530189:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201319.530193:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4de600, rc 0) 00000100:00100000:0.0:1788201319.530280:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+37:14164:x1875064559560192:12345-192.168.201.56@tcp:101:grep.0 Request processed in 11220us (11605us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788201319.530289:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 65 00000100:00100000:0.0:1788201319.537487:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.537694:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559560320 00000100:00100000:1.0:1788201319.537709:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559560320 00000100:00100000:1.0:1788201319.537798:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:1.0:1788201319.537812:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba116300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+37:2344:x1875064559560320:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201319.537834:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201319.537869:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb236 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a86 expref: 37 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.537894:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9624a8e9f600) 00010000:00010000:1.0:1788201319.537901:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201319.537992:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba116300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559560320:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 184us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201319.538003:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:1.0:1788201319.550405:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.550490:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201319.550741:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559560576 00000100:00100000:3.0:1788201319.550757:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559560576 00000100:00100000:3.0:1788201319.550832:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:3.0:1788201319.550846:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:14164:x1875064559560576:12345-192.168.201.56@tcp:35:grep.0 00000100:00100000:3.0:1788201319.551253:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+37:14164:x1875064559560576:12345-192.168.201.56@tcp:35:grep.0 Request processed in 409us (864us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788201319.551275:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:0.0:1788201319.552298:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559560704 00000100:00100000:0.0:1788201319.552312:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559560704 00000100:00100000:0.0:1788201319.552380:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:0.0:1788201319.552390:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+37:2342:x1875064559560704:12345-192.168.201.56@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201319.552440:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201319.552484:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb244 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99a8d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.552688:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb24b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.552707:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb24b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.552723:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb24b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.552758:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb252 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.552766:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.552773:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201319.556572:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201319.556739:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559560960 00000100:00100000:2.0:1788201319.556752:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559560960 00000100:00100000:2.0:1788201319.556844:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 66 00000100:00100000:2.0:1788201319.556880:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+39:13222:x1875064559560960:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1788201319.556919:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201319.556964:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb259 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99ac5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201319.557168:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788201319.557686:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb259 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ac5 expref: 41 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.557709:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624942a6000) 00010000:00010000:2.0:1788201319.557713:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201319.557718:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb259 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ac5 expref: 41 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.557738:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962481513c00, rc 0) 00000100:00100000:2.0:1788201319.557825:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:13222:x1875064559560960:12345-192.168.201.56@tcp:101:bash.0 Request processed in 948us (1279us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1788201319.557834:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 66 00000100:00100000:2.0:1788201319.560930:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201319.561330:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559561088 00000100:00100000:3.0:1788201319.561388:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559561088 00000100:00100000:3.0:1788201319.561460:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 67 00000100:00100000:3.0:1788201319.561481:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:13222:x1875064559561088:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1788201319.561516:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201319.561547:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb267 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99acc expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.561810:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb26e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.561831:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb26e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.561843:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb26e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201319.561929:0:6693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788201319.561933:0:6693:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 10 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201319.561974:0:6693:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb26e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.562853:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb24b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.562866:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb24b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.562886:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb24b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.562893:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df800 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201319.562898:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb24b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.562907:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb24b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.562925:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201319.562928:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201319.562934:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb24b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.562940:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb24b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.563098:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99acc expref: 42 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.563124:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb26e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99acc expref: 41 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.563140:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:3.0:1788201319.563143:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201319.563146:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7d800, rc 0) 00000100:00100000:3.0:1788201319.563380:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+41:13222:x1875064559561088:12345-192.168.201.56@tcp:101:bash.0 Request processed in 1908us (2462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201319.563389:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 67 00010000:00010000:1.0:1788201319.563487:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.563496:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb252 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.563503:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb252 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.563509:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4dfa00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201319.563512:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb252 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.563530:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb252 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.563540:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9f9252 (ffff962482424300) 00010000:00010000:1.0:1788201319.563543:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201319.563547:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb252 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.563553:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb252 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9f9252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.563607:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb244 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a8d expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.563618:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201319.563620:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201319.563624:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb244 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a8d expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.563632:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4df400, rc -2) 00000100:00100000:1.0:1788201319.569772:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+39:2342:x1875064559560704:12345-192.168.201.56@tcp:63:ll_sa.0 Request processed in 17356us (19268us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201319.569795:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:2.0:1788201319.582625:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.582731:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559561216 00000100:00100000:1.0:1788201319.582746:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559561216 00000100:00100000:1.0:1788201319.582828:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:1.0:1788201319.582842:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+39:13222:x1875064559561216:12345-192.168.201.56@tcp:37:bash.0 00000100:00100000:3.0:1788201319.590111:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+39:13222:x1875064559561216:12345-192.168.201.56@tcp:37:bash.0 Request processed in 7251us (7483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201319.590130:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:2.0:1788201319.602768:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.602899:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559561472 00000100:00100000:1.0:1788201319.602913:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559561472 00000100:00100000:1.0:1788201319.603012:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:1.0:1788201319.603028:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+39:13222:x1875064559561472:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:1.0:1788201319.603836:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:13222:x1875064559561472:12345-192.168.201.56@tcp:35:bash.0 Request processed in 808us (1079us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788201319.603851:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:2.0:1788201319.626516:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.626701:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559561728 00000100:00100000:0.0:1788201319.626719:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559561728 00000100:00100000:0.0:1788201319.626805:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 68 00000100:00100000:0.0:1788201319.626819:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559561728:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:0.0:1788201319.626908:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788201319.626947:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3000/0xa81c4c9a2f3caee7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9996e expref: 40 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.626985:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff962487f56b00) 00010000:00010000:0.0:1788201319.627008:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb26e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99acc expref: 39 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.627020:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:0.0:1788201319.627024:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201319.627053:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb275 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.627070:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb275 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.627099:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb275 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.627119:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb27c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.627127:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb27c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.627134:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb27c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.628605:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb283 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.628626:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb283 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.628638:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb283 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201319.634768:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788201319.634792:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 451707449620ns, next at 452707443642ns, rc = 0 00010000:00010000:2.0:1788201319.634915:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb28a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.634941:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb28a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636122:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb28a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636136:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb28a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636144:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb28a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636152:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb28a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636257:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201319.636290:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb283 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636296:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb283 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636304:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb283 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636311:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3200 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.636316:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb283 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636326:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb283 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636371:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9624a8490d00) 00010000:00010000:2.0:1788201319.636375:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201319.636393:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb283 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636400:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb283 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636428:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb275 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636434:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb275 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636440:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb275 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636446:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4dea00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.636448:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb275 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636454:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb275 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636462:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201319.636465:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201319.636468:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb275 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.636485:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb275 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201319.636497:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007272968d reply state 00000000b2deba33 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb27c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201319.636519:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201319.636651:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559561728:12345-192.168.201.56@tcp:36:rm.0 Request processed in 9827us (10144us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788201319.636662:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 68 00010000:00010000:3.0:1788201319.646068:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201319.646091:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb28a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.646108:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962481512a00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:3.0:1788201319.646114:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb28a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.646126:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb28a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.646151:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9624a8490d00) 00010000:00010000:3.0:1788201319.646155:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201319.646162:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb28a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.646169:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb28a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.646727:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201319.646732:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201319.646735:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201319.647389:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201319.647443:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559561984 00000100:00100000:3.0:1788201319.647457:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559561984 00000100:00100000:3.0:1788201319.651424:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 69 00000100:00100000:3.0:1788201319.651538:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559561984:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:3.0:1788201319.651689:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201319.651731:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb061 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999ec expref: 40 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.651760:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9624a8e9f600) 00010000:00010000:3.0:1788201319.651812:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201319.651848:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb291 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.651866:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb291 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.651878:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb291 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.651899:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb298 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.651906:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.651913:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.652852:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb29f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.652864:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb29f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.652872:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb29f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201319.654735:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00010000:00010000:3.0:1788201319.654852:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb2a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.654871:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb2a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.654884:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb2a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.654893:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb2a6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.654900:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb2a6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.654907:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb2a6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655045:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201319.655084:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb29f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655108:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb29f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655115:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb29f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655123:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7da00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201319.655128:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb29f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655137:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb29f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655152:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9624942a6b00) 00010000:00010000:3.0:1788201319.655156:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201319.655162:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb29f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655168:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb29f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655194:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb291 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655199:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb291 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655205:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb291 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655210:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7c400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201319.655219:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb291 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655226:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb291 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655234:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:3.0:1788201319.655237:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201319.655240:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb291 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.655246:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb291 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.655483:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb27c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.655492:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb27c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.655505:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb27c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.655511:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.655515:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb27c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.655521:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb27c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.655531:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x95f49252 (ffff962482424700) 00010000:00010000:2.0:1788201319.655533:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201319.655537:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb27c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.655543:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb27c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x95f49252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201319.655830:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b5efe4f reply state 00000000b3ebac0a transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201319.655842:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201319.656119:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559561984:12345-192.168.201.56@tcp:36:rm.0 Request processed in 4650us (8732us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788201319.656129:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 69 00010000:00010000:0.0:1788201319.660859:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201319.660879:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb2a6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.660893:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7d800 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:0.0:1788201319.660899:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb2a6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.660911:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb2a6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.660938:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9624942a6b00) 00010000:00010000:0.0:1788201319.660941:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201319.660947:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb2a6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.660953:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d800/0xa81c4c9a2f3cb2a6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.661089:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201319.661091:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201319.661093:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201319.662110:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201319.662409:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559562240 00000100:00100000:2.0:1788201319.662423:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559562240 00000100:00100000:2.0:1788201319.662524:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00100000:2.0:1788201319.662537:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559562240:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:2.0:1788201319.662649:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201319.662684:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5600/0xa81c4c9a2f3caf11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9997c expref: 40 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.662705:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9624a84c1300) 00010000:00010000:2.0:1788201319.662717:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201319.662749:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.662765:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.662777:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.662796:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512000/0xa81c4c9a2f3cb2b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.662802:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962481512000/0xa81c4c9a2f3cb2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.662808:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962481512000/0xa81c4c9a2f3cb2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.662969:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2bb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.662995:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.663018:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201319.663855:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 64 off8576 00010000:00010000:2.0:1788201319.663937:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.663950:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.663962:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.663971:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2c2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.663978:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2c2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.663985:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664010:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201319.664036:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664042:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2bb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664060:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664067:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962481512e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.664072:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664081:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2bb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664094:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9624a84c1e00) 00010000:00010000:2.0:1788201319.664098:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201319.664102:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2bb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664109:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2bb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664134:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664140:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664146:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664152:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962481513c00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.664155:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664172:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664181:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201319.664184:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201319.664187:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.664193:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201319.664206:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8abb258 reply state 000000000b9b192c transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff962481512000/0xa81c4c9a2f3cb2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201319.664216:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201319.664400:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+41:14167:x1875064559562240:12345-192.168.201.56@tcp:36:rm.0 Request processed in 1860us (2295us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788201319.664412:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 70 00010000:00010000:1.0:1788201319.665059:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201319.665069:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2c2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.665079:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962481512a00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:1.0:1788201319.665083:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2c2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.665091:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.665107:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9624a84c1e00) 00010000:00010000:1.0:1788201319.665110:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201319.665127:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2c2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.665134:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2c2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.665156:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201319.665158:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201319.665160:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201319.666138:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.666154:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb298 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.666162:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.666168:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7c600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201319.666174:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.666197:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb298 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.666214:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd049252 (ffff9624942a6d00) 00010000:00010000:3.0:1788201319.666217:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201319.666221:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb298 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.666228:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb298 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd049252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201319.672231:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201319.672542:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559562496 00000100:00100000:3.0:1788201319.672758:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559562496 00000100:00100000:3.0:1788201319.672853:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 71 00000100:00100000:3.0:1788201319.672865:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559562496:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:3.0:1788201319.672954:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201319.672994:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3caf3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd9998a expref: 40 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.673022:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff9624942a6700) 00010000:00010000:3.0:1788201319.673039:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201319.673074:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb2c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.673093:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb2c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.673105:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb2c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.673150:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb2d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.673158:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb2d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.673165:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb2d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.673388:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb2d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.673399:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb2d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.673408:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb2d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.675731:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512000/0xa81c4c9a2f3cb2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.675750:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962481512000/0xa81c4c9a2f3cb2b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.675759:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962481512000/0xa81c4c9a2f3cb2b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.675766:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962481512000 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201319.675771:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481512000/0xa81c4c9a2f3cb2b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.675779:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481512000/0xa81c4c9a2f3cb2b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.675801:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd2ef3d52 (ffff9624a84c1f00) 00010000:00010000:0.0:1788201319.675804:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201319.675810:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962481512000/0xa81c4c9a2f3cb2b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.675816:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962481512000/0xa81c4c9a2f3cb2b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd2ef3d52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201319.676024:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8640 00010000:00010000:3.0:1788201319.676154:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ca00/0xa81c4c9a2f3cb2de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676170:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ca00/0xa81c4c9a2f3cb2de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676181:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ca00/0xa81c4c9a2f3cb2de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676190:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ca00/0xa81c4c9a2f3cb2de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676196:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ca00/0xa81c4c9a2f3cb2de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676216:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ca00/0xa81c4c9a2f3cb2de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676235:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201319.676279:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb2d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676287:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb2d7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676294:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb2d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676299:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7d000 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201319.676303:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb2d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676309:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb2d7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676320:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff9624942a6800) 00010000:00010000:3.0:1788201319.676323:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201319.676327:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb2d7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676333:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb2d7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676378:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb2c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676386:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb2c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676399:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb2c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676404:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7c400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201319.676408:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb2c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676414:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb2c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676424:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:3.0:1788201319.676427:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201319.676430:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb2c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.676437:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb2c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201319.676449:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000496d8546 reply state 00000000e8a5bb1d transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb2d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201319.676459:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201319.676796:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201319.676803:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ca00/0xa81c4c9a2f3cb2de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.676819:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7ca00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:0.0:1788201319.676824:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ca00/0xa81c4c9a2f3cb2de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.676831:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ca00/0xa81c4c9a2f3cb2de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.676842:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff9624942a6800) 00010000:00010000:0.0:1788201319.676845:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201319.676848:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ca00/0xa81c4c9a2f3cb2de lrc: 1/0,0 mode: --/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.676855:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ca00/0xa81c4c9a2f3cb2de lrc: 0/0,0 mode: --/PW res: [0x200000402:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.676873:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201319.676875:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201319.676877:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201319.676997:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559562496:12345-192.168.201.56@tcp:36:rm.0 Request processed in 4127us (4776us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1788201319.677008:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 71 00010000:00010000:0.0:1788201319.681939:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb2d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.681965:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb2d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.681974:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb2d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.681981:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7da00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201319.681986:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb2d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.682023:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb2d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.682045:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8ac02452 (ffff9624942a6400) 00010000:00010000:0.0:1788201319.682048:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201319.682054:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb2d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.682061:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7da00/0xa81c4c9a2f3cb2d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8ac02452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201319.682941:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201319.683807:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559562752 00000100:00100000:3.0:1788201319.683825:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559562752 00000100:00100000:2.0:1788201319.684088:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 72 00000100:00100000:2.0:1788201319.684101:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+39:14167:x1875064559562752:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:2.0:1788201319.684186:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201319.684225:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3caf65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99998 expref: 39 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.684251:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9624a8e9f700) 00010000:00010000:2.0:1788201319.684277:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201319.684333:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.684380:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.684392:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.684412:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.684419:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.684426:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.684915:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.684927:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.684935:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201319.686747:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8704 00010000:00010000:2.0:1788201319.686873:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6a00/0xa81c4c9a2f3cb2fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.686891:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6a00/0xa81c4c9a2f3cb2fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.686912:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6a00/0xa81c4c9a2f3cb2fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.686922:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6a00/0xa81c4c9a2f3cb2fa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.686930:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6a00/0xa81c4c9a2f3cb2fa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.686937:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6a00/0xa81c4c9a2f3cb2fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687467:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201319.687522:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687531:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2f3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687538:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687546:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962481512a00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.687551:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687569:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2f3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687585:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9624a84c1500) 00010000:00010000:2.0:1788201319.687589:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201319.687604:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2f3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687610:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962481512a00/0xa81c4c9a2f3cb2f3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687638:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687645:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687650:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687656:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962481513c00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.687659:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687665:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687675:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201319.687677:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201319.687680:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.687686:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962481513c00/0xa81c4c9a2f3cb2e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201319.687699:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053f5cf2e reply state 00000000ef257a6d transno 4294967359 ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201319.687720:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201319.687856:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559562752:12345-192.168.201.56@tcp:36:rm.0 Request processed in 3751us (4918us total) trans 4294967359 rc 0/0 00000100:00100000:2.0:1788201319.687867:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 72 00010000:00010000:2.0:1788201319.693003:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.693028:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.693037:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.693045:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962481512e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.693051:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.693061:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.693085:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x427acf52 (ffff9624a84c1300) 00010000:00010000:2.0:1788201319.693089:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201319.693095:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.693102:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962481512e00/0xa81c4c9a2f3cb2ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x427acf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201319.694002:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201319.694099:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559563008 00000100:00100000:3.0:1788201319.694114:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559563008 00000100:00100000:3.0:1788201319.694192:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 73 00000100:00100000:3.0:1788201319.694226:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+39:14167:x1875064559563008:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:3.0:1788201319.694326:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201319.694390:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2800/0xa81c4c9a2f3caf8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999a6 expref: 39 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.694412:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff962487f56000) 00010000:00010000:3.0:1788201319.694424:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201319.694456:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb301 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.694483:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb301 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.694496:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb301 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.694657:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb308 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.694666:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.694673:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.694827:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb30f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.694836:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb30f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.694843:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb30f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.696624:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201319.696644:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6a00/0xa81c4c9a2f3cb2fa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.696658:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624904a6a00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:1.0:1788201319.696664:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6a00/0xa81c4c9a2f3cb2fa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.696675:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6a00/0xa81c4c9a2f3cb2fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.696697:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9624a84c1500) 00010000:00010000:1.0:1788201319.696701:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201319.696707:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6a00/0xa81c4c9a2f3cb2fa lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.696713:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6a00/0xa81c4c9a2f3cb2fa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.696740:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201319.696742:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201319.696744:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788201319.697874:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].9, 64 off8768 00010000:00010000:2.0:1788201319.698087:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6000/0xa81c4c9a2f3cb316 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698108:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6000/0xa81c4c9a2f3cb316 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698121:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6000/0xa81c4c9a2f3cb316 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698131:0:6693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6000/0xa81c4c9a2f3cb316 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698137:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6000/0xa81c4c9a2f3cb316 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698144:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6000/0xa81c4c9a2f3cb316 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698212:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201319.698245:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb30f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698263:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb30f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698270:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb30f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698276:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7dc00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.698281:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb30f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698288:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb30f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698310:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9624942a6d00) 00010000:00010000:2.0:1788201319.698313:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201319.698318:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb30f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698324:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb30f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698379:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb301 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698386:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb301 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698393:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb301 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698398:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7c400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.698401:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb301 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698407:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb301 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698416:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201319.698418:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201319.698422:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb301 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.698427:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c400/0xa81c4c9a2f3cb301 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201319.698452:0:6693:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6045766 reply state 000000000ae155fb transno 4294967360 ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201319.698463:0:6693:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201319.698793:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559563008:12345-192.168.201.56@tcp:36:rm.0 Request processed in 4564us (4799us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788201319.698802:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 73 00010000:00010000:1.0:1788201319.701957:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.702004:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb308 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.702013:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb308 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.702021:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7d000 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201319.702026:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb308 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.702034:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb308 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.702054:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b739652 (ffff9624942a6700) 00010000:00010000:1.0:1788201319.702058:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201319.702063:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb308 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.702069:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb308 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b739652 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201319.703177:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201319.703270:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559563264 00000100:00100000:1.0:1788201319.703284:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559563264 00000100:00100000:1.0:1788201319.703392:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 74 00000100:00100000:1.0:1788201319.703406:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+39:14167:x1875064559563264:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:1.0:1788201319.703520:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201319.703553:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c5400/0xa81c4c9a2f3cafb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999b4 expref: 39 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.703599:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff9624a84c1a00) 00010000:00010000:1.0:1788201319.703612:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201319.703645:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb31d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.703663:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb31d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.703677:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb31d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.703698:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb324 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.703706:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.703713:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.703872:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb32b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.703880:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb32b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.703888:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb32b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201319.704662:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].10, 64 off8832 00010000:00010000:1.0:1788201319.704755:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb332 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.704778:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb332 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.704788:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb332 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.704797:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb332 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.704804:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb332 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.704811:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb332 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.705850:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201319.705864:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6000/0xa81c4c9a2f3cb316 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.705876:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624904a6000 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:0.0:1788201319.705882:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6000/0xa81c4c9a2f3cb316 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.705892:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6000/0xa81c4c9a2f3cb316 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.705913:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9624942a6d00) 00010000:00010000:0.0:1788201319.705918:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201319.705923:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6000/0xa81c4c9a2f3cb316 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.705930:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6000/0xa81c4c9a2f3cb316 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.705962:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201319.705982:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb332 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.705987:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2e00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:0.0:1788201319.705991:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb332 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.705997:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb332 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.706006:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff9624a8490200) 00010000:00010000:0.0:1788201319.706008:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201319.706011:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb332 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.706018:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201319.706020:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201319.706022:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201319.706786:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201319.706796:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb332 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.706844:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb32b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.706851:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb32b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.706857:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb32b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.706862:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3a00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201319.706866:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb32b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.706885:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb32b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.706897:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff9624a8490200) 00010000:00010000:1.0:1788201319.706899:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201319.706903:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb32b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.706909:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3a00/0xa81c4c9a2f3cb32b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.706934:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb31d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.706940:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb31d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.706947:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb31d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.706965:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201319.706968:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb31d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.706974:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb31d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.706983:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201319.706985:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201319.706989:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb31d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.707006:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb31d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201319.707018:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079b64aa5 reply state 000000007860a627 transno 4294967361 ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201319.707028:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201319.707162:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559563264:12345-192.168.201.56@tcp:36:rm.0 Request processed in 3752us (3989us total) trans 4294967361 rc 0/0 00000100:00100000:1.0:1788201319.707173:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 74 00010000:00010000:1.0:1788201319.710179:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.710204:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb324 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.710213:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb324 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.710220:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3c00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201319.710226:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb324 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.710235:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb324 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.710270:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x532e4152 (ffff9624a8490400) 00010000:00010000:1.0:1788201319.710274:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201319.710279:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb324 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.710312:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb324 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x532e4152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.714804:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201319.716240:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201319.716647:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559563520 00000100:00100000:0.0:1788201319.716661:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559563520 00000100:00100000:0.0:1788201319.716736:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00100000:0.0:1788201319.716750:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+39:14167:x1875064559563520:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:0.0:1788201319.716841:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201319.716878:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cafe3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999c2 expref: 39 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.716904:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9624a8e9fd00) 00010000:00010000:0.0:1788201319.716919:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201319.716965:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb339 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.717006:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.717018:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.717037:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb340 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.717044:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.717051:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.717189:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb347 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.717196:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb347 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.717202:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb347 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201319.717901:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].11, 64 off8896 00010000:00010000:0.0:1788201319.717979:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb34e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.717993:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb34e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718004:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb34e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718019:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb34e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718026:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb34e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718033:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb34e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718066:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201319.718095:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb347 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718102:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb347 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718110:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb347 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718117:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4dfc00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201319.718121:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb347 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718130:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb347 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718142:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962482424300) 00010000:00010000:0.0:1788201319.718145:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201319.718149:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb347 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718165:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb347 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718190:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718195:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb339 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718202:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb339 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718207:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4de600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201319.718210:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb339 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718215:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb339 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718222:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:0.0:1788201319.718224:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201319.718227:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb339 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.718232:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb339 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201319.718240:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f8fb08c reply state 000000006db96077 transno 4294967362 ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201319.718250:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201319.718420:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559563520:12345-192.168.201.56@tcp:36:rm.0 Request processed in 1669us (2189us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788201319.718430:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 75 00010000:00010000:1.0:1788201319.719463:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201319.719488:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb34e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.719507:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df400 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:1.0:1788201319.719512:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb34e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.719523:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb34e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.719542:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff962482424300) 00010000:00010000:1.0:1788201319.719545:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201319.719550:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb34e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.719556:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb34e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.719598:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201319.719601:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201319.719603:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201319.724211:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:2.0:1788201319.724855:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.724871:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb340 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.724879:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.724886:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df800 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.724891:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.724899:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb340 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.724922:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4bf9e852 (ffff962482424700) 00010000:00010000:2.0:1788201319.724926:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201319.724931:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb340 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.724973:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df800/0xa81c4c9a2f3cb340 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4bf9e852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201319.725132:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559563776 00000100:00100000:3.0:1788201319.725146:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559563776 00000100:00100000:3.0:1788201319.725226:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 76 00000100:00100000:3.0:1788201319.725239:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559563776:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:3.0:1788201319.725428:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201319.725454:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624829c4e00/0xa81c4c9a2f3cb00d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999d0 expref: 40 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.725483:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9624a84c1100) 00010000:00010000:3.0:1788201319.725492:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201319.725750:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb355 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.725768:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb355 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.725780:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb355 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.725798:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cb35c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.725806:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cb35c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.725813:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cb35c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.726883:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb363 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.726902:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb363 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.726912:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb363 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201319.729178:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 64 off8960 00010000:00010000:2.0:1788201319.729606:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6e00/0xa81c4c9a2f3cb36a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729629:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6e00/0xa81c4c9a2f3cb36a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729642:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6e00/0xa81c4c9a2f3cb36a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729652:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6e00/0xa81c4c9a2f3cb36a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729659:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6e00/0xa81c4c9a2f3cb36a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729666:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6e00/0xa81c4c9a2f3cb36a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729752:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201319.729801:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb363 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729808:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb363 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729813:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb363 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729820:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624904a7a00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.729824:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb363 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729832:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb363 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729847:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9624a84c1300) 00010000:00010000:2.0:1788201319.729850:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201319.729856:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb363 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729863:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb363 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729891:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb355 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729898:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb355 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729905:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb355 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729909:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7c600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.729919:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb355 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729926:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb355 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729936:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201319.729939:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201319.729942:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb355 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.729948:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7c600/0xa81c4c9a2f3cb355 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201319.729977:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa67b2fd reply state 000000008989f4c2 transno 4294967363 ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cb35c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201319.729988:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201319.730118:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559563776:12345-192.168.201.56@tcp:36:rm.0 Request processed in 4875us (5917us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788201319.730129:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 76 00000100:00100000:2.0:1788201319.734628:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:1.0:1788201319.734716:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201319.734729:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6e00/0xa81c4c9a2f3cb36a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.734743:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624904a6e00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:1.0:1788201319.734763:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6e00/0xa81c4c9a2f3cb36a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.734775:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6e00/0xa81c4c9a2f3cb36a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.734801:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9624a84c1300) 00010000:00010000:1.0:1788201319.734806:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201319.734811:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6e00/0xa81c4c9a2f3cb36a lrc: 1/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.734811:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cb35c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.734818:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6e00/0xa81c4c9a2f3cb36a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.734826:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cb35c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.734833:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cb35c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.734838:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7ce00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201319.734842:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cb35c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.734843:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201319.734845:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201319.734847:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201319.734849:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cb35c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.734858:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x59102352 (ffff9624942a6700) 00010000:00010000:3.0:1788201319.734861:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201319.734865:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cb35c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.734871:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7ce00/0xa81c4c9a2f3cb35c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x59102352 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201319.735198:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559564032 00000100:00100000:0.0:1788201319.735213:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559564032 00000100:00100000:0.0:1788201319.735291:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 77 00000100:00100000:0.0:1788201319.735305:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+39:14167:x1875064559564032:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:0.0:1788201319.735445:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201319.735483:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3800/0xa81c4c9a2f3cb037 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999de expref: 39 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.735505:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962487f56600) 00010000:00010000:0.0:1788201319.735514:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201319.735545:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb371 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.735563:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb371 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.735575:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb371 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.735594:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb378 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.735601:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.735609:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.735777:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb37f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.735786:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb37f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.735793:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb37f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201319.737943:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 64 off9024 00010000:00010000:2.0:1788201319.738056:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb386 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738078:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb386 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738091:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb386 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738114:0:6693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb386 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738122:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb386 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738129:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb386 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738161:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201319.738191:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb37f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738198:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb37f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738205:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb37f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738213:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df200 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.738218:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb37f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738227:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb37f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738242:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962482424700) 00010000:00010000:2.0:1788201319.738245:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201319.738251:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb37f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738270:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb37f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738295:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb371 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738301:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb371 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738308:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb371 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738313:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4de600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201319.738317:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb371 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738323:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb371 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738332:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201319.738334:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201319.738338:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb371 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.738372:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb371 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201319.738384:0:6693:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006be0fd6 reply state 000000002f3cbb27 transno 4294967364 ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.738392:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788201319.738394:0:6693:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201319.738400:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb386 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.738407:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624904a7a00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:1.0:1788201319.738410:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb386 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.738416:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb386 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.738425:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff962482424700) 00010000:00010000:1.0:1788201319.738427:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201319.738430:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb386 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.738444:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7a00/0xa81c4c9a2f3cb386 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.738462:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201319.738463:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201319.738465:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201319.738535:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:14167:x1875064559564032:12345-192.168.201.56@tcp:36:rm.0 Request processed in 3228us (3920us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788201319.738547:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 77 00010000:00010000:1.0:1788201319.741995:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.742014:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb378 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.742022:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb378 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.742030:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4dfc00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201319.742035:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb378 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.742042:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb378 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.742061:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8d464a52 (ffff962482424300) 00010000:00010000:1.0:1788201319.742065:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201319.742071:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb378 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.742077:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb378 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8d464a52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201319.991118:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201319.991154:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570085248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201319.991277:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201319.993431:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570085248 00000100:00100000:3.0:1788201319.993450:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570085248 00000100:00100000:3.0:1788201319.993554:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788201319.993566:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570085248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201319.993604:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47906816 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201319.993727:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570085248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201319.993735:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788201319.995150:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570085248:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201320.183535:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201321.215541:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201322.231024:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201323.254869:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201323.574797:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570085760:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.574869:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.574934:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201323.574940:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570085376:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.574972:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.574998:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570085888:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575023:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.575051:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570085504:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575073:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.575090:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570086016:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575109:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.575126:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201323.575131:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570085632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575154:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.575185:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570085376 00000100:00100000:2.0:1788201323.575192:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570085376 00000100:00100000:2.0:1788201323.575237:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788201323.575247:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570085376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575299:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570085376:12345-0@lo:400:kworker.0 Request processed in 52us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201323.575306:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788201323.575378:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570085888 00000100:00100000:2.0:1788201323.575382:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570085888 00000100:00100000:2.0:1788201323.575426:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570085632 00000100:00100000:2.0:1788201323.575430:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570085632 00000100:00100000:2.0:1788201323.575449:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788201323.575455:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570085888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575489:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570085888:12345-0@lo:400:kworker.0 Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201323.575496:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788201323.575507:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788201323.575514:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570085632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575548:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570085632:12345-0@lo:400:kworker.0 Request processed in 35us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201323.575555:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788201323.575573:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570085760 00000100:00100000:2.0:1788201323.575576:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570085760 00000100:00100000:2.0:1788201323.575600:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570085504 00000100:00100000:2.0:1788201323.575603:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570085504 00000100:00100000:2.0:1788201323.575613:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570086016 00000100:00100000:2.0:1788201323.575616:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570086016 00000100:00100000:2.0:1788201323.575629:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788201323.575635:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570085760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575664:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570085760:12345-0@lo:400:kworker.0 Request processed in 30us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201323.575670:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788201323.575681:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788201323.575687:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570085504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575713:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570085504:12345-0@lo:400:kworker.0 Request processed in 26us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201323.575725:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788201323.575739:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788201323.575745:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570086016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575774:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570086016:12345-0@lo:400:kworker.0 Request processed in 30us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201323.575780:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:2.0:1788201323.575799:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201323.575803:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201323.575805:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201323.575838:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570085632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575849:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570085504:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575857:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570086016:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575886:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570085376:0@lo:400:kworker.0 00010000:00080000:2.0:1788201323.575898:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624904e9180 x1875064570085888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201323.575908:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570085888:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.575917:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570085760:0@lo:400:kworker.0 00000001:00080000:3.0:1788201323.609477:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967362 is committed 00000004:00080000:3.0:1788201323.609521:0:5847:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:3.0:1788201323.609547:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967364 is committed 00000100:00100000:0.0:1788201323.609736:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201323.609755:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570086144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201323.609826:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201323.609880:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570086144 00000100:00100000:0.0:1788201323.609887:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570086144 00000100:00100000:0.0:1788201323.609929:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788201323.609937:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570086144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201323.609963:0:6671:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00010000:00010000:0.0:1788201323.609988:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201323.610008:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000acc227d1/0xa81c4c9a2f3cb12c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a08 expref: 14 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201323.610016:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1788201323.610034:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201323.610039:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201323.610065:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000acc227d1/0xa81c4c9a2f3cb12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a08 expref: 14 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201323.610077:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000acc227d1/0xa81c4c9a2f3cb12c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a08 expref: 14 pid: 6670 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201323.610088:0:6671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570086272:192.168.201.56@tcp:104: 00000100:00100000:0.0:1788201323.610146:0:6671:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487145d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201323.620752:0:6671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570086272:192.168.201.56@tcp:104: 00010000:00010000:0.0:1788201323.620785:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201323.621914:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201323.622743:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559564160 00000100:00100000:1.0:1788201323.622755:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559564160 00010000:00010000:1.0:1788201323.622815:0:11284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000acc227d1/0xa81c4c9a2f3cb12c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a08 expref: 15 pid: 6670 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201323.622907:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:1.0:1788201323.622919:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2341:x1875064559564160:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201323.622938:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201323.622944:0:11284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000acc227d1/0xa81c4c9a2f3cb12c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a08 expref: 15 pid: 6670 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.622957:0:11284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000acc227d1/0xa81c4c9a2f3cb12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a08 expref: 15 pid: 6670 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.622982:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acc227d1/0xa81c4c9a2f3cb12c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a08 expref: 15 pid: 6670 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.623000:0:11284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201323.623005:0:11284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201323.623011:0:11284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.623021:0:11284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201323.623060:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201323.623146:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2341:x1875064559564160:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 228us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.623173:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00080000:2.0:1788201323.623245:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201323.623373:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201323.623385:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201323.623398:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201323.623416:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201323.623439:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201323.623963:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570086144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14024us (14135us total) trans 17179869188 rc 0/0 00000100:00100000:3.0:1788201323.623972:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00010000:2.0:1788201323.624053:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201323.624063:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201323.624074:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df400 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:2.0:1788201323.624087:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201323.624099:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201323.624115:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201323.624123:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb38d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201323.624146:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201323.624148:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201323.624150:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201323.625676:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9624ba114700/2, rc 0, transno 17179869188 00000100:00100000:0.0:1788201323.625734:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570086144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201324.096288:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570086400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201324.096414:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201324.096483:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570086400 00000100:00100000:1.0:1788201324.096492:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570086400 00000100:00100000:1.0:1788201324.096552:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788201324.096563:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570086400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201324.096602:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201324.113062:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570086400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 16491us (16638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201324.113088:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:0.0:1788201324.120120:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba472a00 x1875064570086400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201324.120150:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570086400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201324.278918:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201324.346574:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201324.346622:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201324.346648:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201324.346698:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201324.346730:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559564544 00000100:00100000:0.0:1788201324.346740:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559564544 00000100:00100000:0.0:1788201324.346788:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559564672 00000100:00100000:0.0:1788201324.346792:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559564672 00000100:00100000:0.0:1788201324.346825:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 126 00000100:00100000:0.0:1788201324.346834:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559564544:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201324.346909:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559564544:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 75us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201324.346916:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 126 00000100:00100000:0.0:1788201324.346934:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 127 00000100:00100000:0.0:1788201324.346940:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559564672:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201324.346964:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559564672:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201324.346971:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 127 00000100:00100000:0.0:1788201324.346990:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559564416 00000100:00100000:0.0:1788201324.346994:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559564416 00000100:00100000:0.0:1788201324.347025:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 220 00000100:00100000:0.0:1788201324.347032:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2342:x1875064559564416:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201324.347065:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2342:x1875064559564416:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201324.347071:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 220 00000100:00080000:0.0:1788201324.347101:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201324.347105:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201324.347274:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559564288 00000100:00100000:2.0:1788201324.347278:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559564288 00000100:00100000:2.0:1788201324.347307:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 384 00000100:00100000:2.0:1788201324.347313:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559564288:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201324.347339:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559564288:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 27us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201324.347367:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 384 00000100:00100000:0.0:1788201325.110584:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570086528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201325.110668:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201325.110868:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570086528 00000100:00100000:2.0:1788201325.110877:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570086528 00000100:00100000:2.0:1788201325.110947:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788201325.110958:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875064570086528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201325.110996:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47906816 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788201325.111084:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788201325.112489:0:6846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 457185144479ns, next at 458185141769ns, rc = 0 00000100:00100000:2.0:1788201325.123281:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875064570086528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12315us (12600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201325.123297:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788201325.123672:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570086528:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788201325.162000:0:15417:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 17179869188 is committed 00010000:00010000:2.0:1788201325.302513:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201326.326630:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201326.824912:0:16238:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 3: Fail OST during write, with verification ========================================================== 14:35:25 (1788201325) 00000100:00100000:1.0:1788201326.885716:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201326.885899:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559564928 00000100:00100000:2.0:1788201326.885910:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559564928 00000100:00100000:2.0:1788201326.885982:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00100000:2.0:1788201326.885993:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:14729:x1875064559564928:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1788201326.886016:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201326.886041:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7200/0xa81c4c9a2f3cb394 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99ad3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.886499:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6c00/0xa81c4c9a2f3cb39b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.886515:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6c00/0xa81c4c9a2f3cb39b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.886525:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6c00/0xa81c4c9a2f3cb39b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.886538:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6400/0xa81c4c9a2f3cb3a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.886545:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6400/0xa81c4c9a2f3cb3a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.886551:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6400/0xa81c4c9a2f3cb3a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201326.887861:0:5825:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe:0x0], index 0: 0 00000100:00080000:1.0:1788201326.888254:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201326.888328:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7000/0xa81c4c9a2f3cb3a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.888430:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7000/0xa81c4c9a2f3cb3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.888442:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7000/0xa81c4c9a2f3cb3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.888484:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6c00/0xa81c4c9a2f3cb39b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.888491:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6c00/0xa81c4c9a2f3cb39b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.888497:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6c00/0xa81c4c9a2f3cb39b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.888503:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624904a6c00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201326.888508:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6c00/0xa81c4c9a2f3cb39b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.888515:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6c00/0xa81c4c9a2f3cb39b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.888526:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201326.888530:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201326.888535:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6c00/0xa81c4c9a2f3cb39b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.888540:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6c00/0xa81c4c9a2f3cb39b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201326.888562:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021f145fa reply state 00000000fc328788 transno 4294967365 ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6400/0xa81c4c9a2f3cb3a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201326.888571:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201326.888610:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7200/0xa81c4c9a2f3cb394 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ad3 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.888624:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7000/0xa81c4c9a2f3cb3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ad3 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.888631:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9624a84c1c00) 00010000:00010000:2.0:1788201326.888633:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201326.888635:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624904a7000, rc 0) 00000100:00100000:2.0:1788201326.888892:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:14729:x1875064559564928:12345-192.168.201.56@tcp:101:bash.0 Request processed in 2900us (3183us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788201326.888901:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 78 00010000:00010000:3.0:1788201326.900437:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6400/0xa81c4c9a2f3cb3a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.900457:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6400/0xa81c4c9a2f3cb3a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.900482:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6400/0xa81c4c9a2f3cb3a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.900488:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624904a6400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:3.0:1788201326.900493:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6400/0xa81c4c9a2f3cb3a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.900500:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6400/0xa81c4c9a2f3cb3a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.900515:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x733c6acc (ffff9624a84c1800) 00010000:00010000:3.0:1788201326.900518:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201326.900522:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6400/0xa81c4c9a2f3cb3a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.900528:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6400/0xa81c4c9a2f3cb3a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201326.919443:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201326.919665:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559565056 00000100:00100000:0.0:1788201326.919675:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559565056 00000100:00100000:0.0:1788201326.919743:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 93 00000100:00100000:0.0:1788201326.919754:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:14729:x1875064559565056:12345-192.168.201.56@tcp:101:tee.0 00010000:00010000:0.0:1788201326.919773:0:8088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201326.919793:0:8088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb3b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99ada expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788201326.921235:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1788201326.921440:0:8088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201326.921470:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1788201326.921475:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201326.921491:0:8088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb3b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ada expref: 15 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.921512:0:8088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb3b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ada expref: 15 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.921527:0:8088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4df400, rc 0) 00000100:00100000:0.0:1788201326.921603:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:14729:x1875064559565056:12345-192.168.201.56@tcp:101:tee.0 Request processed in 1850us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201326.921612:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 93 00000100:00100000:3.0:1788201327.173011:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201327.173101:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559565184 00000100:00100000:1.0:1788201327.173111:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559565184 00002000:00100000:1.0:1788201327.173172:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe:0x0] (0->1048575) req@ffff9624ba471180 x1875064559565184/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:448/0 lens 488/0 e 0 to 0 dl 1788201338 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201327.173182:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba471180 with x1875064559565184 ext(0->1048575) 00002000:00010000:1.0:1788201327.173187:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba471180 00000100:00100000:1.0:1788201327.173221:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:1.0:1788201327.173229:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2344:x1875064559565184:12345-192.168.201.56@tcp:4:tee.0 00000100:00100000:1.0:1788201327.220457:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2344:x1875064559565184:12345-192.168.201.56@tcp:4:tee.0 Request processed in 47216us (47442us total) trans 17179869189 rc 0/0 00000100:00100000:1.0:1788201327.220494:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 21 00002000:00100000:1.0:1788201327.220510:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe:0x0] (0->1048575) req@ffff9624ba471180 x1875064559565184/t17179869189(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:448/0 lens 488/448 e 0 to 0 dl 1788201338 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201327.220520:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba471180 with x1875064559565184 ext(0->1048575) 00002000:00010000:1.0:1788201327.220526:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba471180 00000100:00100000:3.0:1788201327.324966:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201327.325513:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559565312 00000100:00100000:0.0:1788201327.325532:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559565312 00002000:00100000:0.0:1788201327.325605:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe:0x0] (1048576->2097151) req@ffff9624ba472a00 x1875064559565312/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:448/0 lens 488/0 e 0 to 0 dl 1788201338 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201327.325616:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba472a00 with x1875064559565312 ext(1048576->2097151) 00002000:00010000:0.0:1788201327.325621:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba472a00 00000100:00100000:0.0:1788201327.325652:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:0.0:1788201327.325662:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2343:x1875064559565312:12345-192.168.201.56@tcp:4:tee.0 00010000:00010000:3.0:1788201327.351660:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201327.365121:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:2343:x1875064559565312:12345-192.168.201.56@tcp:4:tee.0 Request processed in 39449us (40162us total) trans 17179869190 rc 0/0 00000100:00100000:2.0:1788201327.365136:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 22 00002000:00100000:2.0:1788201327.365148:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe:0x0] (1048576->2097151) req@ffff9624ba472a00 x1875064559565312/t17179869190(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:448/0 lens 488/448 e 0 to 0 dl 1788201338 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201327.365158:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba472a00 with x1875064559565312 ext(1048576->2097151) 00002000:00010000:2.0:1788201327.365163:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba472a00 00000100:00100000:2.0:1788201327.490017:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201327.490548:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559565440 00000100:00100000:1.0:1788201327.490563:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559565440 00002000:00100000:1.0:1788201327.490632:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe:0x0] (2097152->3145727) req@ffff9624ba0da300 x1875064559565440/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:448/0 lens 488/0 e 0 to 0 dl 1788201338 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201327.490645:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0da300 with x1875064559565440 ext(2097152->3145727) 00002000:00010000:1.0:1788201327.490651:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0da300 00000100:00100000:1.0:1788201327.490690:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:1.0:1788201327.490700:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:2341:x1875064559565440:12345-192.168.201.56@tcp:4:tee.0 00000100:00100000:2.0:1788201327.524666:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:2341:x1875064559565440:12345-192.168.201.56@tcp:4:tee.0 Request processed in 33945us (34650us total) trans 17179869191 rc 0/0 00000100:00100000:2.0:1788201327.524703:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 23 00002000:00100000:2.0:1788201327.524723:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xe:0x0] (2097152->3145727) req@ffff9624ba0da300 x1875064559565440/t17179869191(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:448/0 lens 488/448 e 0 to 0 dl 1788201338 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201327.524735:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0da300 with x1875064559565440 ext(2097152->3145727) 00002000:00010000:2.0:1788201327.524743:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0da300 00000100:00100000:2.0:1788201327.764753:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201327.766593:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559565568 00000100:00100000:0.0:1788201327.766611:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559565568 00002000:00100000:0.0:1788201327.766678:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe:0x0] (3145728->4194303) req@ffff9624ba0d8380 x1875064559565568/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:448/0 lens 488/0 e 0 to 0 dl 1788201338 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201327.766690:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d8380 with x1875064559565568 ext(3145728->4194303) 00002000:00010000:0.0:1788201327.766697:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d8380 00000100:00100000:0.0:1788201327.766738:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:0.0:1788201327.766749:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:2341:x1875064559565568:12345-192.168.201.56@tcp:4:tee.0 00000100:00100000:1.0:1788201327.825993:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+23:2341:x1875064559565568:12345-192.168.201.56@tcp:4:tee.0 Request processed in 59233us (61244us total) trans 17179869192 rc 0/0 00000100:00100000:1.0:1788201327.826008:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 24 00002000:00100000:1.0:1788201327.826020:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe:0x0] (3145728->4194303) req@ffff9624ba0d8380 x1875064559565568/t17179869192(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:448/0 lens 488/448 e 0 to 0 dl 1788201338 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201327.826032:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d8380 with x1875064559565568 ext(3145728->4194303) 00002000:00010000:1.0:1788201327.826039:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d8380 00000100:00100000:2.0:1788201327.987113:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201327.987277:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559565696 00000100:00100000:2.0:1788201327.987284:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201327.987289:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559565696 00002000:00100000:1.0:1788201327.987371:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xe:0x0] (4194304->5242879) req@ffff9624ba0d9500 x1875064559565696/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:448/0 lens 488/0 e 0 to 0 dl 1788201338 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201327.987397:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d9500 with x1875064559565696 ext(4194304->5242879) 00002000:00010000:1.0:1788201327.987403:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d9500 00000100:00100000:1.0:1788201327.987435:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:1.0:1788201327.987445:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+23:2344:x1875064559565696:12345-192.168.201.56@tcp:4:tee.0 00000100:00100000:3.0:1788201327.995069:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559565952 00000100:00100000:3.0:1788201327.995093:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559565952 00000100:00100000:2.0:1788201327.995394:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 32 00000100:00100000:2.0:1788201327.995406:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:14729:x1875064559565952:12345-192.168.201.56@tcp:35:tee.0 00000001:00080000:2.0:1788201327.995719:0:5829:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967366 00000100:00100000:2.0:1788201327.996644:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:14729:x1875064559565952:12345-192.168.201.56@tcp:35:tee.0 Request processed in 1236us (9354us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788201327.996659:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 32 00000020:00080000:2.0:1788201327.996664:0:5829:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201328.010101:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:2344:x1875064559565696:12345-192.168.201.56@tcp:4:tee.0 Request processed in 22644us (22986us total) trans 17179869193 rc 0/0 00000100:00100000:1.0:1788201328.010117:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 25 00002000:00100000:1.0:1788201328.010131:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xe:0x0] (4194304->5242879) req@ffff9624ba0d9500 x1875064559565696/t17179869193(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:448/0 lens 488/448 e 0 to 0 dl 1788201338 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201328.010142:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d9500 with x1875064559565696 ext(4194304->5242879) 00002000:00010000:1.0:1788201328.010149:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d9500 00010000:00010000:3.0:1788201328.406092:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201328.696828:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570086784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.696905:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.696964:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570087296:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.696989:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.697023:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201328.697029:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570086656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.697058:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.697078:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570087168:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.697115:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.697143:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570086912:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.697167:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.697197:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201328.697203:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570087040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.697226:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.697260:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570086784 00000100:00100000:1.0:1788201328.697268:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570086784 00000100:00100000:1.0:1788201328.697309:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570087296 00000100:00100000:1.0:1788201328.697312:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570087296 00000100:00100000:1.0:1788201328.697423:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570087040 00000100:00100000:1.0:1788201328.697426:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570087040 00000100:00100000:1.0:1788201328.697447:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788201328.697457:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570086784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.697515:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570086784:12345-0@lo:400:kworker.0 Request processed in 60us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.697523:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788201328.697540:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788201328.697547:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570087296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.697576:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570087296:12345-0@lo:400:kworker.0 Request processed in 30us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.697583:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788201328.697595:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788201328.697601:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570087040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.697633:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570087040:12345-0@lo:400:kworker.0 Request processed in 32us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.697638:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788201328.697662:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570087168 00000100:00100000:1.0:1788201328.697665:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570087168 00000100:00100000:1.0:1788201328.697693:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570086912 00000100:00100000:1.0:1788201328.697696:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570086912 00000100:00100000:1.0:1788201328.697729:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788201328.697735:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570087168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.697767:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570087168:12345-0@lo:400:kworker.0 Request processed in 33us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.697774:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788201328.697785:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788201328.697791:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570086912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.697820:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570086912:12345-0@lo:400:kworker.0 Request processed in 29us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.697825:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1788201328.697845:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201328.697849:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201328.697851:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201328.697885:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570087040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.697895:0:3282:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869188 gen 2 00000004:00080000:1.0:1788201328.697901:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9624ba114700, transno 17179869188 00000100:00100000:1.0:1788201328.697909:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570086912:0@lo:400:kworker.0 00010000:00080000:1.0:1788201328.697945:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962485739880 x1875064570087168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201328.697955:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570087168:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.697963:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570086784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.697970:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570087296:0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.700227:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570086656 00000100:00100000:2.0:1788201328.700241:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570086656 00000100:00100000:2.0:1788201328.700302:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788201328.700311:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570086656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.700439:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570086656:12345-0@lo:400:kworker.0 Request processed in 130us (3380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.700446:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788201328.700942:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570086656:0@lo:400:kworker.0 00000001:00080000:3.0:1788201328.807414:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967367 is committed 00000004:00080000:3.0:1788201328.807438:0:5847:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788201328.807970:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570087680:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201328.808044:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201328.808090:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570088192:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201328.808194:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201328.808221:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201328.808228:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570087808:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201328.808257:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201328.808274:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570088320:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201328.808297:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.808410:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570087424:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201328.808443:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.808473:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570087936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201328.808497:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.808512:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201328.808517:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570087552:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201328.808542:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.808556:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570088064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201328.808582:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201328.808617:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570087680 00000100:00100000:1.0:1788201328.808624:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570087680 00000100:00100000:1.0:1788201328.808662:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570088192 00000100:00100000:1.0:1788201328.808665:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570088192 00000100:00100000:1.0:1788201328.808676:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570087808 00000100:00100000:1.0:1788201328.808679:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570087808 00000100:00100000:1.0:1788201328.808688:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570088320 00000100:00100000:1.0:1788201328.808690:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570088320 00000100:00100000:1.0:1788201328.808698:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570087424 00000100:00100000:1.0:1788201328.808700:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570087424 00000100:00100000:1.0:1788201328.808707:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570087936 00000100:00100000:1.0:1788201328.808709:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570087936 00000100:00100000:1.0:1788201328.808716:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570087552 00000100:00100000:1.0:1788201328.808718:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570087552 00000100:00100000:1.0:1788201328.808726:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570088064 00000100:00100000:1.0:1788201328.808728:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570088064 00000100:00100000:1.0:1788201328.808741:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788201328.808749:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3284:x1875064570087680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201328.808778:0:6668:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6 count 1 00010000:00010000:1.0:1788201328.808805:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.808828:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009fffbf27/0xa81c4c9a2f3cb164 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a24 expref: 24 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.808845:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=9s v=(0 0) 00010000:00010000:1.0:1788201328.808851:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201328.808855:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 4/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.808890:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009fffbf27/0xa81c4c9a2f3cb164 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a24 expref: 24 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.808905:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009fffbf27/0xa81c4c9a2f3cb164 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a24 expref: 24 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.808919:0:6668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570088448:192.168.201.56@tcp:104: 00000100:00100000:1.0:1788201328.808981:0:6668:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485952780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201328.808999:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788201328.809007:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3284:x1875064570088192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201328.809023:0:6671:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:10 count 1 00010000:00010000:1.0:1788201328.809034:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.809045:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3cb1a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a55 expref: 24 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.809052:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=9s v=(0 0) 00010000:00010000:1.0:1788201328.809055:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201328.809066:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.809087:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3cb1a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a55 expref: 24 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.809472:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3cb1a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a55 expref: 24 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.809486:0:6671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570088576:192.168.201.56@tcp:104: 00000100:00100000:1.0:1788201328.809521:0:6671:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485952600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201328.822748:0:6671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570088576:192.168.201.56@tcp:104: 00010000:00010000:3.0:1788201328.822782:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201328.823118:0:6668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570088448:192.168.201.56@tcp:104: 00010000:00010000:2.0:1788201328.823146:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201328.823227:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201328.823269:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201328.824906:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559566080 00000100:00100000:1.0:1788201328.824920:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559566080 00010000:00010000:1.0:1788201328.826919:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009fffbf27/0xa81c4c9a2f3cb164 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a24 expref: 25 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.826977:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559566208 00000100:00100000:1.0:1788201328.826983:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559566208 00010000:00010000:1.0:1788201328.827001:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3cb1a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a55 expref: 26 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.827028:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 40 00000100:00100000:1.0:1788201328.827038:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559566080:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201328.827053:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201328.827058:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009fffbf27/0xa81c4c9a2f3cb164 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a24 expref: 26 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.827093:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009fffbf27/0xa81c4c9a2f3cb164 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a24 expref: 26 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.827119:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fffbf27/0xa81c4c9a2f3cb164 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a24 expref: 26 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.827138:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1788201328.827145:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 41 00010000:00010000:1.0:1788201328.827148:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201328.827157:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.827168:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201328.827174:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:2342:x1875064559566208:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201328.827201:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201328.827214:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3cb1a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a55 expref: 25 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.827219:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201328.827237:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3cb1a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a55 expref: 25 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.827261:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab27d75/0xa81c4c9a2f3cb1a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a55 expref: 25 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.827288:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1788201328.827294:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559566080:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 252us (4069us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201328.827297:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201328.827326:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.827334:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 40 00010000:00010000:3.0:1788201328.827385:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.827421:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201328.827473:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+23:2342:x1875064559566208:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 312us (4201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201328.827497:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 41 00010000:00010000:3.0:1788201328.827547:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.827560:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.827573:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.827584:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.827599:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.827619:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201328.828158:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3284:x1875064570087680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19407us (20111us total) trans 17179869194 rc 0/0 00000100:00100000:1.0:1788201328.828166:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788201328.828187:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788201328.828196:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3284:x1875064570087808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201328.828221:0:6668:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:7 count 1 00010000:00010000:1.0:1788201328.828240:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.828257:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb195 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a32 expref: 22 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.828264:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=9s v=(0 0) 00010000:00010000:1.0:1788201328.828269:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201328.828273:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.828305:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb195 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a32 expref: 22 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.828332:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb195 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a32 expref: 22 pid: 6670 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.828384:0:6668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570088704:192.168.201.56@tcp:104: 00000100:00100000:1.0:1788201328.828457:0:6668:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485952f00 going to sleep for 11 seconds 00010000:00010000:1.0:1788201328.828479:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201328.828486:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.828494:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2200 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:1.0:1788201328.828499:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.828510:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.828524:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.828527:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.828564:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.828576:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.828588:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.828589:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.828593:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201328.828598:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.828619:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788201328.828644:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9624c1cc6a00/2, rc 0, transno 17179869194 00000100:00100000:1.0:1788201328.828663:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570087680:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201328.828748:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201328.828771:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570088832:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201328.828815:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201328.829188:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3284:x1875064570088192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20178us (20989us total) trans 17179869195 rc 0/0 00000100:00100000:3.0:1788201328.829199:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788201328.829227:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570088832 00000100:00100000:3.0:1788201328.829235:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570088832 00000100:00100000:3.0:1788201328.829273:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201328.829296:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3284:x1875064570088320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201328.829374:0:6671:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:11 count 1 00002000:00010000:3.0:1788201328.829408:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 6, mtime: 0x6a95c93c, atime: 0x0, ctime: 0x6a95c93c, blocks: 0xb 00010000:00010000:3.0:1788201328.829415:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.829445:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d374bf7/0xa81c4c9a2f3cb102 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999d7 expref: 22 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.829455:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xb:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1788201328.829459:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201328.829464:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.829498:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d374bf7/0xa81c4c9a2f3cb102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999d7 expref: 22 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.829511:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d374bf7/0xa81c4c9a2f3cb102 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999d7 expref: 22 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201328.829528:0:6671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570088960:192.168.201.56@tcp:104: 00000100:00100000:3.0:1788201328.829596:0:6671:0:(client.c:2702:ptlrpc_set_wait()) set ffff962483523cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788201328.829616:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201328.829622:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.829631:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2600 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:3.0:1788201328.829635:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.829645:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.829670:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.829678:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000824378db/0xa81c4c9a2f3cb3c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.829705:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.829707:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.829710:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788201328.830479:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9624c1cc5500/2, rc 0, transno 17179869195 00000100:00100000:1.0:1788201328.830493:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570088192:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1788201328.831537:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201328.834117:0:6668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570088704:192.168.201.56@tcp:104: 00010000:00010000:3.0:1788201328.834170:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.839111:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201328.839166:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201328.839231:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559566336 00000100:00100000:3.0:1788201328.839235:0:6671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570088960:192.168.201.56@tcp:104: 00000100:00100000:2.0:1788201328.839243:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559566336 00010000:00010000:3.0:1788201328.839291:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.839301:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb195 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a32 expref: 23 pid: 6670 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201328.839399:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559566464 00000100:00100000:2.0:1788201328.839404:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559566464 00000100:00100000:3.0:1788201328.839417:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 42 00010000:00010000:2.0:1788201328.839426:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d374bf7/0xa81c4c9a2f3cb102 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999d7 expref: 24 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201328.839439:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559566336:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201328.839464:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788201328.839465:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 43 00010000:00010000:3.0:1788201328.839478:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb195 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a32 expref: 24 pid: 6670 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201328.839491:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559566464:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201328.839513:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201328.839527:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d374bf7/0xa81c4c9a2f3cb102 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999d7 expref: 24 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.839548:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb195 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a32 expref: 24 pid: 6670 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.839551:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d374bf7/0xa81c4c9a2f3cb102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999d7 expref: 24 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.839586:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d374bf7/0xa81c4c9a2f3cb102 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999d7 expref: 24 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.839593:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb195 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a32 expref: 24 pid: 6670 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.839609:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201328.839616:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201328.839622:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201328.839639:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.839640:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201328.839659:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.839664:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.839679:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.839706:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201328.839716:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201328.841695:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559566336:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 2249us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201328.841711:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 42 00010000:00010000:3.0:1788201328.841776:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.841790:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.841875:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.842034:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.842057:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201328.842470:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201328.842484:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.842498:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7c000 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:1.0:1788201328.842503:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.842514:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.842536:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.842543:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000994282dc/0xa81c4c9a2f3cb3d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.842566:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201328.842568:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201328.842569:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201328.843692:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:2341:x1875064559566464:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 4200us (4518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.843708:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:3.0:1788201328.843724:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3284:x1875064570088320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14426us (35421us total) trans 17179869196 rc 0/0 00000100:00100000:3.0:1788201328.843734:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201328.843765:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788201328.843775:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3282:x1875064570087424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201328.843881:0:6671:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:13 count 1 00002000:00010000:3.0:1788201328.843923:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 7, mtime: 0x6a95c93c, atime: 0x0, ctime: 0x6a95c93c, blocks: 0xb 00010000:00010000:3.0:1788201328.843933:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.843955:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f37b5f0/0xa81c4c9a2f3cb0f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999f3 expref: 20 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.843966:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xd:0x0].0x0 since=460s v=(0 0) 00010000:00010000:3.0:1788201328.843971:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201328.843975:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 4/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.844020:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f37b5f0/0xa81c4c9a2f3cb0f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999f3 expref: 20 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201328.844054:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9624c1cc4380/2, rc 0, transno 17179869196 00010000:00010000:3.0:1788201328.844057:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f37b5f0/0xa81c4c9a2f3cb0f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999f3 expref: 20 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.844077:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570088320:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201328.844147:0:6671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570089088:192.168.201.56@tcp:104: 00000100:00100000:3.0:1788201328.844247:0:6671:0:(client.c:2702:ptlrpc_set_wait()) set ffff962483523300 going to sleep for 11 seconds 00010000:00010000:3.0:1788201328.844276:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.844285:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.844995:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.845009:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.845036:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201328.848145:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3284:x1875064570087808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19872us (39810us total) trans 17179869197 rc 0/0 00000100:00100000:3.0:1788201328.848165:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788201328.848219:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201328.848237:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3282:x1875064570087936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201328.848277:0:6668:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:8 count 1 00000100:00100000:1.0:1788201328.848323:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201328.848381:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559566592 00000100:00100000:1.0:1788201328.848392:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559566592 00010000:00010000:1.0:1788201328.848436:0:11284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f37b5f0/0xa81c4c9a2f3cb0f4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999f3 expref: 21 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.848479:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 44 00000100:00100000:1.0:1788201328.848492:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624902bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:2342:x1875064559566592:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201328.848500:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.848509:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201328.848523:0:11284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f37b5f0/0xa81c4c9a2f3cb0f4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999f3 expref: 21 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.848534:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3cb1aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a4e expref: 21 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.848546:0:11284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f37b5f0/0xa81c4c9a2f3cb0f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999f3 expref: 21 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.848550:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=9s v=(0 0) 00010000:00010000:3.0:1788201328.848563:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201328.848577:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.848596:0:11284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201328.848604:0:11284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201328.848612:0:11284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.848624:0:11284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.848627:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3cb1aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a4e expref: 21 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.848674:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3cb1aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a4e expref: 21 pid: 6670 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.848680:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201328.848695:0:6668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570089216:192.168.201.56@tcp:104: 00000100:00100000:1.0:1788201328.848758:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624902bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:2342:x1875064559566592:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 267us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201328.848769:0:6668:0:(client.c:2702:ptlrpc_set_wait()) set ffff962483523780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201328.848786:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 44 00010000:00010000:1.0:1788201328.848955:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f37b5f0/0xa81c4c9a2f3cb0f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999f3 expref: 20 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.848971:0:6671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570089088:192.168.201.56@tcp:104: 00010000:00010000:1.0:1788201328.848990:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.849000:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.849006:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.849016:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.849023:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.849053:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788201328.849600:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3282:x1875064570087424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5825us (41153us total) trans 17179869198 rc 0/0 00000100:00100000:1.0:1788201328.849609:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000004:00080000:1.0:1788201328.849651:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9624c1cc7b80/2, rc 0, transno 17179869198 00000100:00100000:1.0:1788201328.849664:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570087424:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201328.849694:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788201328.849701:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00010000:00010000:3.0:1788201328.849708:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.849717:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3282:x1875064570087552:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201328.849736:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2800 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:3.0:1788201328.849747:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788201328.849768:0:6671:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1788201328.849799:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.849801:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.849805:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201328.849849:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cb148 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a16 expref: 19 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.849856:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.849860:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=9s v=(0 0) 00010000:00010000:1.0:1788201328.849876:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201328.849880:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015b8b209/0xa81c4c9a2f3cb3cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.849884:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.849937:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.849942:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.849945:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201328.850041:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cb148 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a16 expref: 19 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.850057:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cb148 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a16 expref: 19 pid: 6671 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.850073:0:6671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570089344:192.168.201.56@tcp:104: 00000100:00100000:1.0:1788201328.850162:0:6671:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485952f00 going to sleep for 11 seconds 00010000:00010000:3.0:1788201328.850551:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.850554:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.850556:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201328.850738:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.850750:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7ce00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:0.0:1788201328.850754:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.850763:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.850780:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.850799:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120e10ec/0xa81c4c9a2f3cb3da lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201328.850820:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201328.850822:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201328.850823:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201328.854471:0:6671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570089344:192.168.201.56@tcp:104: 00010000:00010000:1.0:1788201328.854504:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201328.854627:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9624c1cc5180/2, rc 0, transno 17179869197 00000100:00100000:2.0:1788201328.854636:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570087808:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201328.854868:0:6668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570089216:192.168.201.56@tcp:104: 00010000:00010000:3.0:1788201328.854886:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.855864:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201328.855907:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201328.859550:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559566720 00000100:00100000:2.0:1788201328.859564:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559566720 00010000:00010000:2.0:1788201328.859619:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3cb1aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a4e expref: 20 pid: 6670 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201328.859695:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559566848 00000100:00100000:2.0:1788201328.859699:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559566848 00010000:00010000:2.0:1788201328.859715:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cb148 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a16 expref: 21 pid: 6671 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201328.859743:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:2.0:1788201328.859752:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:2341:x1875064559566720:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201328.859769:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201328.859776:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3cb1aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a4e expref: 21 pid: 6670 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.859806:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3cb1aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a4e expref: 21 pid: 6670 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.859833:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a133da64/0xa81c4c9a2f3cb1aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a4e expref: 21 pid: 6670 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.859852:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201328.859857:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201328.859862:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.859872:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.859900:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201328.859955:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559566720:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 204us (4096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.859963:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:2.0:1788201328.859983:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00100000:2.0:1788201328.859990:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:2341:x1875064559566848:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201328.859998:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201328.860003:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cb148 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a16 expref: 19 pid: 6671 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.860027:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cb148 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a16 expref: 19 pid: 6671 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.860041:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e58fb720/0xa81c4c9a2f3cb148 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a16 expref: 19 pid: 6671 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.860052:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201328.860055:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201328.860060:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.860068:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201328.860088:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201328.860108:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559566848:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 119us (4200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.860115:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 46 00010000:00010000:3.0:1788201328.860330:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.860361:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.860385:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.860393:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.860410:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201328.860902:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3282:x1875064570087936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12671us (52401us total) trans 17179869199 rc 0/0 00000100:00100000:3.0:1788201328.860911:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201328.860932:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788201328.860940:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3282:x1875064570088064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201328.860962:0:6668:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:9 count 1 00010000:00010000:3.0:1788201328.860982:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.860997:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb19c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99a47 expref: 17 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.861006:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=9s v=(0 0) 00010000:00010000:3.0:1788201328.861009:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201328.861014:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 4/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.861045:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb19c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a47 expref: 17 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.861073:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb19c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a47 expref: 17 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201328.861088:0:6668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570089472:192.168.201.56@tcp:104: 00000100:00100000:3.0:1788201328.861332:0:6668:0:(client.c:2702:ptlrpc_set_wait()) set ffff962483523900 going to sleep for 11 seconds 00010000:00010000:3.0:1788201328.861375:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201328.861382:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.861391:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7d200 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:3.0:1788201328.861395:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.861405:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.861421:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.861429:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0a1bfdc/0xa81c4c9a2f3cb3e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.861446:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.861448:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.861456:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788201328.862044:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9624c1cc4700/2, rc 0, transno 17179869199 00000100:00100000:1.0:1788201328.862053:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570087936:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788201328.862074:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.862083:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.862093:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.862101:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.862173:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201328.862595:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3282:x1875064570087552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12885us (54051us total) trans 17179869200 rc 0/0 00000100:00100000:1.0:1788201328.862605:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201328.862627:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201328.862635:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3283:x1875064570088832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201328.862656:0:6671:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:12 count 1 00002000:00010000:1.0:1788201328.862679:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 6, mtime: 0x6a95c93c, atime: 0x0, ctime: 0x6a95c93c, blocks: 0xb 00010000:00010000:1.0:1788201328.862692:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.862707:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb0fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999e5 expref: 17 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.862783:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788201328.862788:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201328.862792:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.862822:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb0fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999e5 expref: 17 pid: 15349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.862834:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb0fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999e5 expref: 17 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.862846:0:6671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570089600:192.168.201.56@tcp:104: 00000100:00100000:1.0:1788201328.862907:0:6671:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485952780 going to sleep for 11 seconds 00000004:00080000:2.0:1788201328.863025:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9624c1cc5880/2, rc 0, transno 17179869200 00000100:00100000:2.0:1788201328.863032:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570087552:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201328.866284:0:16319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201328.866298:0:16319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.866322:0:16319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2e00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:3.0:1788201328.866327:0:16319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201328.866556:0:6668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570089472:192.168.201.56@tcp:104: 00010000:00010000:2.0:1788201328.866582:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.866754:0:16319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.866778:0:16319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.866786:0:16319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1d8b0c/0xa81c4c9a2f3cb3e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.866805:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.866807:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.866809:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201328.866977:0:6671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875064570089600:192.168.201.56@tcp:104: 00010000:00010000:1.0:1788201328.866994:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201328.876723:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201328.876771:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201328.876844:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559566976 00000100:00100000:1.0:1788201328.876856:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559566976 00010000:00010000:1.0:1788201328.876894:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb19c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a47 expref: 18 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.876942:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559567104 00000100:00100000:1.0:1788201328.876945:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559567104 00010000:00010000:1.0:1788201328.876960:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb0fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999e5 expref: 19 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201328.876983:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:1.0:1788201328.876992:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:2341:x1875064559566976:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201328.877008:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201328.877013:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb19c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a47 expref: 19 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877027:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb19c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a47 expref: 19 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877051:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb19c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99a47 expref: 19 pid: 6668 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877066:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201328.877071:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201328.877077:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877086:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877128:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201328.877178:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559566976:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 187us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.877186:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:1.0:1788201328.877203:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 48 00000100:00100000:1.0:1788201328.877210:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2341:x1875064559567104:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201328.877220:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201328.877224:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb0fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999e5 expref: 17 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877234:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb0fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999e5 expref: 17 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877247:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb0fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd999e5 expref: 17 pid: 15349 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877257:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201328.877260:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201328.877265:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877273:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877302:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201328.877338:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559567104:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 129us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201328.877369:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 48 00010000:00010000:1.0:1788201328.877390:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877400:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877410:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877417:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.877434:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201328.877974:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3282:x1875064570088064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17033us (69389us total) trans 17179869201 rc 0/0 00000100:00100000:1.0:1788201328.877983:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000004:00080000:1.0:1788201328.878033:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9624c1cc6300/2, rc 0, transno 17179869201 00000100:00100000:1.0:1788201328.878040:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570088064:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788201328.878059:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201328.878065:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.878084:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7d400 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:1.0:1788201328.878088:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.878096:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.878109:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.878116:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055ac967b/0xa81c4c9a2f3cb3ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.878133:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201328.878134:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201328.878136:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201328.878254:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.878264:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.878272:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.878289:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201328.878301:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201328.878691:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3283:x1875064570088832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16056us (49876us total) trans 17179869202 rc 0/0 00000100:00100000:1.0:1788201328.878698:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000004:00080000:1.0:1788201328.878732:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962485739880/2, rc 0, transno 17179869202 00000100:00100000:1.0:1788201328.878737:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570088832:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201328.878880:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201328.878887:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.878895:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2200 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:3.0:1788201328.878899:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.878918:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.878931:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.878937:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fc9e8f0/0xa81c4c9a2f3cb3f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201328.878952:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.878954:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201328.878956:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788201329.098522:0:16338:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788201329.098571:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.098585:0:16338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.098610:0:16338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.098618:0:16338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.098647:0:16338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201329.098653:0:16338:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788201329.098675:0:16338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201329.098680:0:16338:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788201329.098686:0:16338:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201329.098710:0:16338:0:(import.c:65:import_set_state_nolock()) ffff9624c1ceb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788201329.098789:0:16319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201329.098796:0:16319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.098804:0:16319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2000 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:3.0:1788201329.098808:0:16319:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.098816:0:16319:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201329.098823:0:16319:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201329.098828:0:16319:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201329.098838:0:16319:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788201329.098841:0:16319:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788201329.098867:0:16319:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.098873:0:16319:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201329.098909:0:16319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.098917:0:16319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962498ac2000/0xa81c4c9a2f3cb0bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb0c3 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201329.098929:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201329.098931:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201329.098932:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201329.098992:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570089728:0@lo:39:umount.0 00000100:00100000:1.0:1788201329.099058:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201329.099238:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201329.099249:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570089856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201329.099282:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201329.099453:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570089728 00000100:00100000:3.0:1788201329.099461:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570089728 00000100:00100000:3.0:1788201329.099514:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201329.099524:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875064570089728:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788201329.099548:0:5826:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb0d8 00000100:00080000:3.0:1788201329.099557:0:5826:0:(import.c:65:import_set_state_nolock()) ffff9624bfdef000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788201329.099618:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+1:3281:x1875064570089728:12345-0@lo:39:umount.0 Request processed in 96us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201329.099625:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000020:00000080:3.0:1788201329.099638:0:5826:0:(genops.c:906:class_export_put()) final put ffff9624b9a36000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788201329.099662:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9624b9a36000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201329.099707:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9624bfdef000 for lustre-MDT0000 00000100:00080000:3.0:1788201329.099744:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9624c1ceb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201329.099753:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570089728:0@lo:39:umount.0 00000100:00100000:1.0:1788201329.099867:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570089856 00000100:00100000:1.0:1788201329.099872:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570089856 00000100:00100000:1.0:1788201329.099914:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201329.099922:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570089856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201329.099934:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201329.099950:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624829c5e00/0xa81c4c9a2f3cb0c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb0bc expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.099963:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201329.100003:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3282:x1875064570089856:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.100009:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1788201329.100027:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201329.100161:0:16338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201329.100164:0:16338:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788201329.100169:0:16338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788201329.101041:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.101056:0:16338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.101062:0:16338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.101069:0:16338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201329.101402:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570089856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201329.101472:0:16338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201329.101481:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.101488:0:16338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.101495:0:16338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201329.101500:0:16338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201329.102962:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201329.102977:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201329.102989:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7d600 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:2.0:1788201329.102993:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201329.103002:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201329.103009:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201329.103014:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201329.103017:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788201329.103134:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.103153:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201329.103185:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.103193:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624b9a7d600/0xa81c4c9a2f3cb084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb08b expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.103209:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201329.103213:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.103219:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624829c5a00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201329.103222:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.103229:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201329.103234:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201329.103239:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788201329.103241:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788201329.103256:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.103261:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201329.103268:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.103286:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201329.103287:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201329.103289:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201329.103315:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570090112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201329.103403:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.103457:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201329.103464:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570089984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201329.103487:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.103517:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570090112 00000100:00100000:1.0:1788201329.103523:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570090112 00000100:00100000:1.0:1788201329.103567:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570089984 00000100:00100000:1.0:1788201329.103570:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570089984 00000100:00100000:1.0:1788201329.103593:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201329.103602:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570090112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201329.103614:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201329.103629:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962498ac2a00/0xa81c4c9a2f3cb0b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb0ae expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.103643:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201329.103678:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3285:x1875064570090112:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.103685:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201329.103703:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201329.103710:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624902bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3285:x1875064570089984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201329.103717:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201329.103727:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624ba4de800/0xa81c4c9a2f3cb08b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb084 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.103743:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201329.103768:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624902bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570089984:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.103774:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201329.103837:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570089984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201329.103846:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570090112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201329.107463:0:16338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201329.107479:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624829c5a00/0xa81c4c9a2f3cb0ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb0b5 expref: -99 pid: 15337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201329.107504:0:16338:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788201329.107513:0:16338:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788201329.107517:0:16338:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788201329.107551:0:16338:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788201329.107557:0:16338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:0.0:1788201329.107567:0:16338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788201329.107572:0:16338:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:3.0:1788201329.108208:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000080:0.0:1788201329.110060:0:16338:0:(ofd_obd.c:1269:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:0.0:1788201329.110168:0:16338:0:(ofd_obd.c:1283:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:1.0:1788201329.198207:0:15417:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 17179869202 is committed 00000001:00080000:1.0:1788201329.198237:0:15417:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 17179869193 is committed 00000100:00100000:2.0:1788201329.206965:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00000080:1.0:1788201329.207741:0:16338:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788201329.207755:0:16338:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff96248ced2800 986744c8-ee81-4a47-8d91-97f81ede1f3e 192.168.201.56@tcp 5 (0 0 1) 0 0 0 0: 0000000000000000 17179869193 stale:0 00000020:00080000:1.0:1788201329.207763:0:16338:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff96248ced7000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 17179869202 stale:0 00000020:00080000:1.0:1788201329.207769:0:16338:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9624909db380) has exports, disconnecting them 00000020:00080000:1.0:1788201329.207774:0:16338:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.201.56@tcp (ffff96248ced2800), last request at 1788201328 00000020:00000080:1.0:1788201329.207789:0:16338:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb0a7 00000020:00010000:1.0:1788201329.207798:0:16338:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96248ced2800: total 0 00000100:00080000:1.0:1788201329.207802:0:16338:0:(import.c:65:import_set_state_nolock()) ffff96248cec2800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201329.207818:0:16338:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.56@tcp (ffff96248ced2800): rc 0 00000020:00080000:1.0:1788201329.207822:0:16338:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff96248ced7000), last request at 1788201328 00000020:00000080:1.0:1788201329.207825:0:16338:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb0a0 00000100:00080000:1.0:1788201329.207829:0:16338:0:(import.c:65:import_set_state_nolock()) ffff96248591d800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201329.207838:0:16338:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96248ced7000): rc 0 00000020:00000080:1.0:1788201329.207840:0:16338:0:(genops.c:906:class_export_put()) final put ffff96248ced7000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:1.0:1788201329.207872:0:16338:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9624909db380) has no exports 00010000:00010000:1.0:1788201329.208066:0:16338:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb3b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40106400000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ada expref: 2 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201329.208495:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000febefb54/0xa81c4c9a2f3cb3b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44907400000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ada expref: 2 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1788201329.214541:0:5814:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96248ced2800: total 1 00010000:00010000:3.0:1788201329.214618:0:5814:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96248ced2800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788201329.214636:0:5814:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96248ced2800, canceled 0 locks, left on hash table 0. 00000020:00000080:3.0:1788201329.214645:0:5814:0:(genops.c:906:class_export_put()) final put ffff96248ced2800/986744c8-ee81-4a47-8d91-97f81ede1f3e 00010000:00010000:3.0:1788201329.214656:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201329.214658:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201329.214660:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201329.214909:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96248ced7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788201329.214956:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96248ced2800/986744c8-ee81-4a47-8d91-97f81ede1f3e for lustre-OST0000 00000020:00000080:0.0:1788201329.214970:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96248591d800 for lustre-OST0000 00000020:00000080:0.0:1788201329.214988:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96248cec2800 for lustre-OST0000 00000100:00100000:3.0:1788201329.215142:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570090240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201329.215218:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201329.215389:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570090240 00000100:00100000:0.0:1788201329.215397:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570090240 00000100:00100000:0.0:1788201329.215448:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788201329.215457:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570090240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201329.215496:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201329.215548:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570090240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201329.215554:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:0.0:1788201329.215595:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517f480 x1875064570090240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201329.215615:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570090240:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201329.215679:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788201329.215825:0:16338:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9624873b76c0 - data ffff96248c0ae1b0/ffff96238126dc00 00000020:01000000:1.0:1788201329.215940:0:16338:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff962487ec4540 - data ffff962493aada20/ffff9624b9d38400 00100000:10000000:1.0:1788201329.224012:0:16338:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788201329.258766:0:16338:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb099 00000020:00000080:0.0:1788201329.258777:0:16338:0:(genops.c:906:class_export_put()) final put ffff96248ced4800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788201329.258788:0:16338:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9624857c5000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788201329.258792:0:16338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624857c5000 2 00000020:01000004:0.0:1788201329.258794:0:16338:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9624857c5000 from lustre-OST0000 00000020:00000080:0.0:1788201329.258819:0:16338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201329.258831:0:16338:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788201329.258834:0:16338:0:(genops.c:906:class_export_put()) final put ffff96248ced3800/lustre-OST0000_UUID 00000020:00000080:0.0:1788201329.258837:0:16338:0:(genops.c:865:class_export_destroy()) destroying export ffff96248ced3800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788201329.258845:0:16338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788201329.258890:0:16338:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788201329.258894:0:16338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788201329.258898:0:16338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201329.258904:0:16338:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788201329.258910:0:16338:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff96248e16f000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201329.258915:0:16338:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff962487eb3380) has exports, disconnecting them 00000020:00080000:0.0:1788201329.258932:0:16338:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff96248e16f000), last request at 1788201297 00000020:00000080:0.0:1788201329.258936:0:16338:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb0d1 00000020:00080000:0.0:1788201329.258945:0:16338:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96248e16f000): rc 0 00000020:00000080:0.0:1788201329.258950:0:16338:0:(genops.c:906:class_export_put()) final put ffff96248e16f000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788201329.259788:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248ced4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788201329.259802:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248e16f000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788201329.260865:0:16338:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788201329.260872:0:16338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201329.260877:0:16338:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788201329.260882:0:16338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201329.261008:0:16338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201329.261017:0:16338:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788201329.261023:0:16338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624857c5000 1 00000020:00000080:2.0:1788201329.261029:0:16338:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb07d 00000020:00000080:2.0:1788201329.261036:0:16338:0:(genops.c:906:class_export_put()) final put ffff96248cec5800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788201329.261040:0:16338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788201329.261044:0:16338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201329.261059:0:16338:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201329.261063:0:16338:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9624909d99c0) has no exports 00000020:00000080:3.0:1788201329.261409:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9624c1ceb000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788201329.261416:0:8:0:(genops.c:906:class_export_put()) final put ffff96248e169000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788201329.261418:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248e169000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788201329.261423:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788201329.261494:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248cec5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788201329.307098:0:16338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201329.307117:0:16338:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788201329.307123:0:16338:0:(genops.c:906:class_export_put()) final put ffff962487d4e000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788201329.307127:0:16338:0:(genops.c:865:class_export_destroy()) destroying export ffff962487d4e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788201329.307138:0:16338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788201329.307722:0:16338:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff962487d4a800 00000020:02000400:2.0:1788201329.307790:0:16338:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788201329.468698:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201329.470495:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201329.470541:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201329.470569:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201329.470591:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201329.470626:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559567488 00000100:00100000:0.0:1788201329.470635:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559567488 00000100:00100000:0.0:1788201329.470672:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559567616 00000100:00100000:0.0:1788201329.470676:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559567616 00000100:00100000:2.0:1788201329.472431:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559567232 00000100:00100000:2.0:1788201329.472445:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559567232 00000100:00100000:2.0:1788201329.472500:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 386 00000100:00100000:2.0:1788201329.472512:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559567232:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201329.472591:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559567232:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 81us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201329.472600:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 386 00000100:00100000:0.0:1788201329.472865:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00100000:0.0:1788201329.472879:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559567616:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201329.472913:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559567616:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 41us (2321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201329.472919:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00100000:0.0:1788201329.472937:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 103 00000100:00100000:0.0:1788201329.472942:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1875064559567488:12345-192.168.201.56@tcp:400:kworker.0 00000020:00080000:0.0:1788201329.472948:0:6670:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.56@tcp 00000100:00100000:0.0:1788201329.472971:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1875064559567488:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 28us (2429us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201329.472977:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 103 00000100:00100000:0.0:1788201329.472998:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559567360 00000100:00100000:0.0:1788201329.473003:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559567360 00000100:00100000:0.0:1788201329.473044:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 224 00000100:00100000:0.0:1788201329.473050:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559567360:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201329.473916:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559567360:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 861us (3341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201329.473925:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 224 00000100:00080000:0.0:1788201329.473952:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201329.473958:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201329.515666:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201329.515748:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559567744 00000100:00100000:0.0:1788201329.515758:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559567744 00000100:00100000:0.0:1788201329.515806:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 104 00000100:00100000:0.0:1788201329.515815:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875064559567744:12345-192.168.201.56@tcp:8:ptlrpcd_00_00.0 00010000:00020000:0.0:1788201329.515837:0:6670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201329.548132:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875064559567744:12345-192.168.201.56@tcp:8:ptlrpcd_00_00.0 Request processed in 32305us (32465us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201329.548148:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 104 00000100:00100000:1.0:1788201330.231477:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201330.231501:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570090368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201330.231571:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201330.231637:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570090368 00000100:00100000:1.0:1788201330.231644:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570090368 00000100:00100000:1.0:1788201330.231681:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788201330.231689:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3282:x1875064570090368:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:1.0:1788201330.231697:0:6673:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201330.231755:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3282:x1875064570090368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (182us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201330.231762:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:02020000:1.0:1788201330.231800:0:3282:0:(client.c:1492:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788201330.239046:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201330.239055:0:3282:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201330.239060:0:3282:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1788201330.263451:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1788201330.263464:0:3282:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201330.263475:0:3282:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:1.0:1788201330.263493:0:3282:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201330.264709:0:3282:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96248c87c000 x1875064570090496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201330.264759:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570090496:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:1.0:1788201330.264832:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201330.264892:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570090496 00000100:00100000:1.0:1788201330.264901:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570090496 00000100:00100000:1.0:1788201330.264935:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788201330.264942:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570090496:12345-0@lo:8:ptlrpcd_00_00.0 00010000:00020000:1.0:1788201330.264960:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201330.265002:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570090496:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 60us (170us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201330.265009:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1788201330.265051:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201330.265056:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201330.265061:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570090496:0@lo:8:ptlrpcd_00_00.0 00010000:00010000:1.0:1788201330.497776:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201331.516903:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201332.536237:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201333.562007:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201333.814682:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201333.814689:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201333.814693:0:37:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201333.814701:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 462 00000100:00080000:1.0:1788201333.814707:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201333.814723:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201333.814750:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624b9c42300 x1875064570090880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201333.814843:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570090752:0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.814915:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201333.814985:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201333.814993:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570090624:0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.815022:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201333.815051:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570090880:0@lo:8:kworker.0 00000100:00100000:1.0:1788201333.815071:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201333.815090:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570091136:0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.815103:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201333.815114:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201333.815116:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570091008:0@lo:400:kworker.0 00000100:00100000:1.0:1788201333.815127:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201333.815257:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570090880 00000100:00100000:2.0:1788201333.815265:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570090880 00000100:00100000:2.0:1788201333.815303:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570091136 00000100:00100000:2.0:1788201333.815307:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570091136 00000100:00100000:2.0:1788201333.815383:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788201333.815395:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570091136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201333.815455:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570091136:12345-0@lo:400:kworker.0 Request processed in 63us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201333.815463:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788201333.815491:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201333.815496:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875064570090880:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788201333.815516:0:6668:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201333.815557:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875064570090880:12345-0@lo:8:kworker.0 Request processed in 60us (483us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201333.815563:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788201333.815606:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201333.815611:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201333.815615:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570090880:0@lo:8:kworker.0 00010000:00080000:2.0:1788201333.815652:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624904a0700 x1875064570091136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201333.815663:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570091136:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.815850:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570090752 00000100:00100000:0.0:1788201333.815855:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570090752 00000100:00100000:0.0:1788201333.815891:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570091008 00000100:00100000:0.0:1788201333.815893:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570091008 00000100:00100000:0.0:1788201333.815912:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788201333.815918:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570090752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.815955:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570090752:12345-0@lo:400:kworker.0 Request processed in 38us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.815961:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788201333.815973:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788201333.815978:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570091008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.816003:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570091008:12345-0@lo:400:kworker.0 Request processed in 26us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201333.816018:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:0.0:1788201333.816033:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201333.816037:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201333.816063:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570091008:0@lo:400:kworker.0 00000100:00100000:0.0:1788201333.816091:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570090752:0@lo:400:kworker.0 00000100:00100000:3.0:1788201333.816335:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570090624 00000100:00100000:3.0:1788201333.816365:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570090624 00000100:00100000:3.0:1788201333.816402:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788201333.816409:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570090624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201333.816452:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570090624:12345-0@lo:400:kworker.0 Request processed in 44us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201333.816458:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788201333.816499:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570090624:0@lo:400:kworker.0 00000100:00100000:2.0:1788201334.331691:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570091264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201334.331780:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201334.340957:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570091264 00000100:00100000:1.0:1788201334.340972:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570091264 00000100:00100000:1.0:1788201334.341261:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788201334.341274:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570091264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201334.341315:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201334.341428:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570091264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (9647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201334.341436:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:2.0:1788201334.344011:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248517df80 x1875064570091264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201334.344041:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570091264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201334.582070:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201334.582243:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559568128 00000100:00100000:2.0:1788201334.582253:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559568128 00000100:00100000:2.0:1788201334.582312:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 107 00000100:00100000:2.0:1788201334.582320:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559568128:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:2.0:1788201334.582379:0:6668:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201334.582445:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559568128:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 124us (385us total) trans 0 rc -19/-19 00010000:00010000:1.0:1788201334.583023:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201334.583438:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 107 00000100:00100000:0.0:1788201334.589677:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201334.590169:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201334.590319:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201334.592649:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559567872 00000100:00100000:2.0:1788201334.592663:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559567872 00000100:00100000:2.0:1788201334.592746:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 388 00000100:00100000:2.0:1788201334.592757:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559567872:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201334.593187:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559567872:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 430us (3521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201334.593196:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 388 00000100:00100000:3.0:1788201334.594173:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559568000 00000100:00100000:3.0:1788201334.594197:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559568000 00000100:00100000:3.0:1788201334.594273:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 227 00000100:00100000:3.0:1788201334.594292:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559568000:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201334.594377:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559568000:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 96us (4058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201334.594384:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 227 00000100:00080000:2.0:1788201334.597597:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201334.600070:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559568256 00000100:00100000:1.0:1788201334.600084:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559568256 00000100:00100000:1.0:1788201334.600167:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 132 00000100:00100000:1.0:1788201334.600179:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559568256:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201334.600285:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559568256:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 109us (10116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201334.600293:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 132 00000100:00080000:0.0:1788201334.602736:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201335.606571:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201336.630607:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201337.654607:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201338.678993:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201338.939002:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570091392:0@lo:400:kworker.0 00000100:00100000:3.0:1788201338.939077:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201338.941004:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570091392 00000100:00100000:1.0:1788201338.941018:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570091392 00000100:00100000:1.0:1788201338.941082:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788201338.941092:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570091392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201338.941190:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570091392:12345-0@lo:400:kworker.0 Request processed in 99us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201338.941197:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788201338.941256:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570091392:0@lo:400:kworker.0 00000100:00080000:0.0:1788201338.945598:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201338.945610:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201338.945614:0:8:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201338.945624:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:0.0:1788201338.945630:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201338.945638:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788201338.945682:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624b9deb100 x1875064570091648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201338.945780:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570091648:0@lo:8:kworker.0 00000100:00100000:0.0:1788201338.945857:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201338.945914:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570091648 00000100:00100000:0.0:1788201338.945932:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570091648 00000100:00100000:0.0:1788201338.945968:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788201338.945975:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570091648:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788201338.945995:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201338.946051:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570091648:12345-0@lo:8:kworker.0 Request processed in 74us (192us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201338.946058:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788201338.946083:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570091904:0@lo:400:kworker.0 00000100:00100000:0.0:1788201338.946109:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201338.946150:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570091904 00000100:00100000:0.0:1788201338.946154:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570091904 00000100:00100000:0.0:1788201338.946191:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788201338.946197:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1d5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570091904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201338.946237:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1d5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570091904:12345-0@lo:400:kworker.0 Request processed in 40us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201338.946243:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1788201338.946389:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201338.948007:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201338.948018:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201338.948022:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570091648:0@lo:8:kworker.0 00000100:00100000:3.0:1788201338.948683:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570091776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201338.948758:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201338.948805:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201338.948812:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570091520:0@lo:400:kworker.0 00000100:00100000:3.0:1788201338.948836:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201338.949257:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570091776 00000100:00100000:1.0:1788201338.949275:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570091776 00000100:00100000:1.0:1788201338.949376:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570091520 00000100:00100000:1.0:1788201338.949379:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570091520 00000100:00100000:1.0:1788201338.949402:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788201338.949411:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570091776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201338.949471:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570091776:12345-0@lo:400:kworker.0 Request processed in 61us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201338.949478:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788201338.949494:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00010000:00080000:0.0:1788201338.949527:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624b9debb80 x1875064570091904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201338.949527:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570091520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201338.949542:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570091904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201338.949564:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570091520:12345-0@lo:400:kworker.0 Request processed in 52us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201338.949570:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:3.0:1788201338.949680:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201338.949707:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570091520:0@lo:400:kworker.0 00000100:00100000:3.0:1788201338.949720:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570091776:0@lo:400:kworker.0 00000100:00100000:0.0:1788201339.447283:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201339.447311:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570092032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201339.447424:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201339.447638:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570092032 00000100:00100000:2.0:1788201339.447650:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570092032 00000100:00100000:2.0:1788201339.447704:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788201339.447714:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570092032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201339.447756:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201339.447808:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570092032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201339.447814:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00080000:0.0:1788201339.448101:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248517f480 x1875064570092032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201339.448122:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570092032:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201339.702703:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201339.705784:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201339.705834:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201339.705867:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201339.705923:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559568512 00000100:00100000:0.0:1788201339.705933:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559568512 00000100:00100000:0.0:1788201339.706001:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 230 00000100:00100000:0.0:1788201339.706012:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559568512:12345-192.168.201.56@tcp:400:kworker.0 00000100:00080000:3.0:1788201339.706061:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201339.706080:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559568640 00000100:00100000:1.0:1788201339.706086:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201339.706086:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559568640 00000100:00100000:3.0:1788201339.706116:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559568768 00000100:00100000:0.0:1788201339.706119:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559568512:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 104us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201339.706131:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559568768 00000100:00100000:0.0:1788201339.706139:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 230 00000100:00100000:3.0:1788201339.706177:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 109 00000100:00100000:3.0:1788201339.706185:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559568640:12345-192.168.201.56@tcp:8:kworker.0 00000100:00100000:2.0:1788201339.706190:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559568384 00000100:00100000:2.0:1788201339.706196:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559568384 00010000:00020000:3.0:1788201339.706207:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201339.706230:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 390 00000100:00100000:2.0:1788201339.706239:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559568384:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201339.709525:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 110 00000100:00100000:1.0:1788201339.709544:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559568768:12345-192.168.201.56@tcp:9:kworker.0 00000020:00000080:1.0:1788201339.709575:0:6668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb110 00000100:00080000:1.0:1788201339.709586:0:6668:0:(import.c:65:import_set_state_nolock()) ffff96248591b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201339.709633:0:6668:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788201339.710600:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+2:2340:x1875064559568768:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 1057us (4510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201339.710611:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 110 00010000:00010000:1.0:1788201339.710643:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201339.710727:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201339.729251:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559568640:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 23051us (23367us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201339.729280:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 109 00000100:00100000:2.0:1788201339.736836:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559568384:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 30587us (31051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201339.736872:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 390 00010000:00010000:2.0:1788201340.726939:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201341.751335:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201342.610553:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:2.0:1788201342.610563:0:7629:0:(genops.c:906:class_export_put()) final put ffff96248591a000/986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:2.0:1788201342.610591:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248591a000/986744c8-ee81-4a47-8d91-97f81ede1f3e for lustre-OST0001 00000020:00000080:2.0:1788201342.610634:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96248591b800 for lustre-OST0001 00010000:00010000:1.0:1788201342.774652:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201343.806124:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201344.056994:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201344.057001:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201344.057004:0:37:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201344.057012:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:2.0:1788201344.057017:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788201344.057023:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:2.0:1788201344.057045:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624b9c40700 x1875064570092416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201344.057117:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570092160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201344.057182:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201344.057236:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201344.057242:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570092288:0@lo:400:kworker.0 00000100:00100000:2.0:1788201344.057269:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201344.057299:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570092416:0@lo:8:kworker.0 00000100:00100000:2.0:1788201344.057325:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201344.057371:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570092544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201344.057408:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201344.057913:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201344.057921:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570092672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201344.057948:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201344.057984:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570092160 00000100:00100000:2.0:1788201344.057992:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570092160 00000100:00100000:2.0:1788201344.058037:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788201344.058056:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570092160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201344.058108:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570092160:12345-0@lo:400:kworker.0 Request processed in 63us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201344.058115:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788201344.060591:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570092416 00000100:00100000:3.0:1788201344.060604:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570092416 00000100:00100000:3.0:1788201344.060644:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570092672 00000100:00100000:3.0:1788201344.060647:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570092672 00000100:00100000:3.0:1788201344.060687:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201344.060697:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570092672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201344.060784:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570092672:12345-0@lo:400:kworker.0 Request processed in 88us (2834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201344.060791:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201344.060810:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788201344.060814:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875064570092416:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788201344.060833:0:6671:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201344.060867:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875064570092416:12345-0@lo:8:kworker.0 Request processed in 52us (3541us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201344.060873:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1788201344.061124:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201344.061433:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570092160:0@lo:400:kworker.0 00000100:00100000:0.0:1788201344.062482:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570092288 00000100:00100000:0.0:1788201344.062499:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570092288 00000100:00100000:0.0:1788201344.063712:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570092544 00000100:00100000:0.0:1788201344.063719:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570092544 00000100:00100000:0.0:1788201344.063763:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788201344.063773:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570092288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201344.063861:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570092288:12345-0@lo:400:kworker.0 Request processed in 88us (6589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201344.063868:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788201344.063886:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788201344.063892:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570092544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201344.063923:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570092544:12345-0@lo:400:kworker.0 Request processed in 31us (6513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201344.063929:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:0.0:1788201344.063998:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201344.064037:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570092288:0@lo:400:kworker.0 00000100:00080000:0.0:1788201344.067517:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201344.067599:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201344.067605:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570092416:0@lo:8:kworker.0 00010000:00080000:0.0:1788201344.067650:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624b9d63480 x1875064570092672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201344.067661:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570092672:0@lo:400:kworker.0 00000100:00100000:0.0:1788201344.067691:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570092544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201344.577448:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201344.577475:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570092800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201344.577559:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201344.577668:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570092800 00000100:00100000:1.0:1788201344.577677:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570092800 00000100:00100000:1.0:1788201344.577735:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788201344.577745:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570092800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201344.577782:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201344.577957:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570092800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 213us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201344.577965:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:2.0:1788201344.578046:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624904a0e00 x1875064570092800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201344.578065:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570092800:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201344.831957:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201344.832625:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201344.832660:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201344.832687:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201344.832731:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559568896 00000100:00100000:3.0:1788201344.832742:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559568896 00000100:00100000:3.0:1788201344.832797:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 392 00000100:00100000:3.0:1788201344.832807:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559568896:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201344.832888:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559568896:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201344.832896:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 392 00000100:00100000:3.0:1788201344.832947:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559569024 00000100:00100000:3.0:1788201344.832951:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559569024 00000100:00100000:3.0:1788201344.832989:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 233 00000100:00100000:3.0:1788201344.832996:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559569024:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201344.833029:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559569024:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 34us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201344.833046:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 233 00000100:00080000:3.0:1788201344.833134:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201344.833279:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559569152 00000100:00100000:2.0:1788201344.833284:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559569152 00000100:00100000:2.0:1788201344.833314:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 112 00000100:00100000:2.0:1788201344.833320:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875064559569152:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:2.0:1788201344.833357:0:6671:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201344.833391:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875064559569152:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 70us (773us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201344.833409:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 112 00010000:00010000:1.0:1788201345.854914:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201346.873228:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201347.895881:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201348.337669:0:16785:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788201348.337673:0:16785:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788201348.337781:0:16785:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff962487d4b000 00000020:01000004:2.0:1788201348.337803:0:16785:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788201348.337821:0:16785:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788201348.337837:0:16785:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff962487eb3380) 00000020:00000080:2.0:1788201348.337855:0:16785:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788201348.412206:0:16785:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788201348.416699:0:16785:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788201348.421237:0:16785:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788201348.428284:0:16785:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788201348.440167:0:16785:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xd:0x0] (8/32) 00100000:10000000:0.0:1788201348.453208:0:16785:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 529: rc = 0 00100000:10000000:0.0:1788201348.455979:0:16785:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:0.0:1788201348.456128:0:16785:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 529: rc = 0 00100000:10000000:1.0:1788201348.467322:0:16785:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 377: rc = 0 00100000:10000000:1.0:1788201348.469224:0:16785:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 377: rc = 0 00100000:10000000:1.0:1788201348.470485:0:16785:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 377: rc = 0 00100000:10000000:1.0:1788201348.475695:0:16785:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 377: rc = 0 00100000:10000000:2.0:1788201348.477179:0:16785:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 377: rc = 0 00100000:10000000:2.0:1788201348.478160:0:16785:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 377: rc = 0 00000020:00000080:2.0:1788201348.480799:0:16785:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788201348.480817:0:16785:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788201348.480833:0:16785:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3cb404 00000020:01000004:2.0:1788201348.480844:0:16785:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788201348.480876:0:16785:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.156@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788201348.480881:0:16785:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788201348.480888:0:16785:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788201348.481303:0:16785:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788201348.481311:0:16785:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788201348.501331:0:16785:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788201348.501462:0:16785:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.156@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788201348.501468:0:16785:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788201348.501470:0:16785:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201348.501472:0:16785:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201348.501473:0:16785:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201348.501475:0:16785:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201348.501476:0:16785:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201348.501478:0:16785:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201348.501481:0:16785:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201348.501483:0:16785:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201348.501487:0:16785:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788201348.501490:0:16785:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201348.501491:0:16785:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201348.501493:0:16785:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201348.501494:0:16785:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201348.501495:0:16785:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201348.501496:0:16785:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201348.501497:0:16785:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201348.501498:0:16785:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201348.501499:0:16785:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201348.501543:0:16785:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788201348.501574:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570092928:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201348.501700:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201348.501879:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba2c3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201348.502009:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570092928 00000100:00100000:1.0:1788201348.502020:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570092928 00000100:00100000:1.0:1788201348.502128:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788201348.502141:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:16785:x1875064570092928:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201348.502182:0:5820:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788201348.502186:0:5820:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788201348.502191:0:5820:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788201348.508400:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:16785:x1875064570092928:12345-0@lo:253:mount.lustre.0 Request processed in 6247us (6685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.508421:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1788201348.509048:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570092928:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201348.509093:0:16785:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788201348.509098:0:16785:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201348.509099:0:16785:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201348.509101:0:16785:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201348.509102:0:16785:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201348.509103:0:16785:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201348.509104:0:16785:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201348.509106:0:16785:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201348.509109:0:16785:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201348.509110:0:16785:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201348.509144:0:16785:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962487d4b000 from lustre-OST0000 10000000:01000000:3.0:1788201348.509184:0:16785:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788201348.509188:0:16785:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788201348.509200:0:16785:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962485b40000 local copy 00010000:00010000:3.0:1788201348.509213:0:16785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201348.509728:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201348.510309:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201348.510466:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba2c3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201348.510581:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570093056 00000100:00100000:2.0:1788201348.510590:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570093056 00000100:00100000:2.0:1788201348.510699:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1788201348.510713:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:16785:x1875064570093056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201348.511195:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:16785:x1875064570093056:12345-0@lo:501:mount.lustre.0 Request processed in 484us (886us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201348.511204:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788201348.511297:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093056:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788201348.511323:0:16785:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788201348.511529:0:16785:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788201348.511540:0:16785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.511554:0:16785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201348.511590:0:16785:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962487d4b000 10000000:01000000:0.0:1788201348.511596:0:16785:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788201348.511603:0:16785:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788201348.511606:0:16785:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201348.511611:0:16785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788201348.511614:0:16785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201348.511655:0:16785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.511664:0:16785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.511686:0:16785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201348.511710:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201348.511766:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.512291:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623818af480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201348.512418:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570093184 00000100:00100000:3.0:1788201348.512426:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570093184 00000100:00100000:3.0:1788201348.512471:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788201348.512480:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:16785:x1875064570093184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201348.512497:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201348.512514:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624b9a7c600/0xa81c4c9a2f3cb412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb40b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201348.512544:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624b9a7c600/0xa81c4c9a2f3cb412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb40b expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201348.512557:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624b9a7c600/0xa81c4c9a2f3cb412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb40b expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201348.512577:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7c600, rc 0) 00000100:00100000:3.0:1788201348.512623:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:16785:x1875064570093184:12345-0@lo:101:mount.lustre.0 Request processed in 144us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.512630:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1788201348.512737:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201348.512755:0:16785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.512765:0:16785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201348.521725:0:16785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 14 count 14 00000040:00080000:0.0:1788201348.522944:0:16785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201348.523170:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:0.0:1788201348.523198:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 128 off8544 00000040:00080000:0.0:1788201348.523215:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 112 off8656 00000040:00080000:0.0:1788201348.523240:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8880 00000040:00080000:0.0:1788201348.523258:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9104 00000040:00080000:0.0:1788201348.523275:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 80 off9184 00000040:00080000:0.0:1788201348.523433:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 224 off9408 00000040:00080000:0.0:1788201348.523553:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9632 00000040:00080000:0.0:1788201348.523577:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 80 off9712 00000040:00080000:0.0:1788201348.523707:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 224 off9936 00000040:00080000:0.0:1788201348.523729:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].11, 224 off10160 00000040:00080000:0.0:1788201348.523755:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].12, 120 off10280 00000040:00080000:0.0:1788201348.523812:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].13, 224 off10504 00000040:00080000:0.0:1788201348.523830:0:16785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 14 00000100:00100000:0.0:1788201348.523933:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201348.524045:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.524108:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b36b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201348.524140:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570093312 00000100:00100000:3.0:1788201348.524150:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570093312 00000100:00100000:3.0:1788201348.524233:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788201348.524246:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:16785:x1875064570093312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201348.524572:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:16785:x1875064570093312:12345-0@lo:501:mount.lustre.0 Request processed in 327us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.524581:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788201348.524712:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201348.524771:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201348.524824:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201348.524895:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9df6780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201348.525145:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570093440 00000100:00100000:0.0:1788201348.525149:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570093440 00000100:00100000:0.0:1788201348.525230:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1788201348.525239:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:16785:x1875064570093440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201348.525744:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:16785:x1875064570093440:12345-0@lo:503:mount.lustre.0 Request processed in 506us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.525753:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788201348.525842:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093440:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201348.526459:0:16785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201348.526566:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201348.526628:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201348.526672:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9df6780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201348.526824:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570093568 00000100:00100000:0.0:1788201348.526830:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570093568 00000100:00100000:0.0:1788201348.526872:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788201348.526881:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:16785:x1875064570093568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201348.527162:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:16785:x1875064570093568:12345-0@lo:502:mount.lustre.0 Request processed in 281us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.527170:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1788201348.527261:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201348.527606:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:1.0:1788201348.527657:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 128 off8544 00000040:00080000:1.0:1788201348.527691:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 112 off8656 00000040:00080000:1.0:1788201348.527738:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8880 00000040:00080000:1.0:1788201348.528027:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9104 00000040:00080000:1.0:1788201348.528067:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 80 off9184 00000040:00080000:1.0:1788201348.528120:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 224 off9408 00000040:00080000:1.0:1788201348.528157:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9632 00000040:00080000:1.0:1788201348.528192:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 80 off9712 00000040:00080000:1.0:1788201348.528244:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 224 off9936 00000040:00080000:1.0:1788201348.528282:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].11, 224 off10160 00000040:00080000:1.0:1788201348.528333:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].12, 120 off10280 00000100:00100000:1.0:1788201348.528411:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201348.528492:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201348.528534:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9df6780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201348.528679:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570093696 00000100:00100000:0.0:1788201348.528686:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570093696 00000100:00100000:0.0:1788201348.528741:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1788201348.528823:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:16785:x1875064570093696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201348.529184:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:16785:x1875064570093696:12345-0@lo:502:mount.lustre.0 Request processed in 433us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.529192:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1788201348.529291:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201348.529620:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].13, 224 off10504 00000040:00080000:1.0:1788201348.529632:0:16785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788201348.531096:0:16786:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201348.531109:0:16786:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788201348.531118:0:16786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201348.531121:0:16786:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788201348.531128:0:16786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201348.531148:0:16786:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9624909d99c0) 00000020:00000080:3.0:1788201348.531178:0:16786:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788201348.531186:0:16786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201348.531260:0:16786:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962487d4b000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788201348.531268:0:16786:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201348.531275:0:16786:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3cb420 00010000:00010000:3.0:1788201348.535670:0:16786:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00080000:3.0:1788201348.537582:0:16786:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 17179869202 srv lr: 17179869184 lx: 1875064570088832 gen 0 00000001:00080000:3.0:1788201348.537653:0:16786:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: 986744c8-ee81-4a47-8d91-97f81ede1f3e idx: 1 lr: 17179869193 srv lr: 17179869184 lx: 1875064559565696 gen 0 00000001:00000004:3.0:1788201348.537672:0:16786:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 17179869202 00080000:10000000:3.0:1788201348.545494:0:16786:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00000020:00000080:3.0:1788201348.550446:0:16786:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788201348.550466:0:16786:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201348.550475:0:16786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201348.550478:0:16786:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788201348.550481:0:16786:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201348.550485:0:16786:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788201348.550487:0:16786:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201348.550488:0:16786:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201348.550490:0:16786:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201348.550493:0:16786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201348.550495:0:16786:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201348.550497:0:16786:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201348.550502:0:16786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201348.550503:0:16786:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201348.550507:0:16786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201348.550509:0:16786:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201348.550512:0:16786:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201348.550514:0:16786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201348.550516:0:16786:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201348.550518:0:16786:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201348.550521:0:16786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201348.550522:0:16786:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201348.550526:0:16786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788201348.550633:0:16786:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201348.550637:0:16786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201348.550639:0:16786:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788201348.550643:0:16786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 14 count 14 00000020:01000000:1.0:1788201348.553954:0:16785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788201348.554019:0:16785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788201348.554052:0:16785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.554068:0:16785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201348.554090:0:16785:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff962487d4b000 from 1 10000000:01000000:1.0:1788201348.554093:0:16785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201348.554152:0:16785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.554171:0:16785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.554186:0:16785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201348.554219:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201348.554325:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201348.554409:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9df6780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201348.557886:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570093824 00000100:00100000:0.0:1788201348.557915:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570093824 00000100:00100000:0.0:1788201348.558687:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1788201348.558704:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:16785:x1875064570093824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201348.558730:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201348.558769:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624ba4dec00/0xa81c4c9a2f3cb43c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb435 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.558818:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624ba4dec00/0xa81c4c9a2f3cb43c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb435 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.558831:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624ba4dec00/0xa81c4c9a2f3cb43c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb435 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.558843:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dec00, rc 0) 00000100:00100000:0.0:1788201348.560737:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:16785:x1875064570093824:12345-0@lo:101:mount.lustre.0 Request processed in 2023us (6397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.560766:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1788201348.560958:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201348.561002:0:16785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.561018:0:16785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201348.574671:0:16785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 7 count 7 00000040:00080000:1.0:1788201348.575141:0:16785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201348.575332:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:1.0:1788201348.575424:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:1.0:1788201348.575478:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:1.0:1788201348.575517:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:1.0:1788201348.575554:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:1.0:1788201348.575640:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:1.0:1788201348.575646:0:16785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 6 count 7 00000100:00100000:1.0:1788201348.575734:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201348.575817:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201348.575867:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9df6780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201348.575872:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570093952 00000100:00100000:2.0:1788201348.575881:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570093952 00000100:00100000:2.0:1788201348.576109:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788201348.576121:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:16785:x1875064570093952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201348.576594:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570093952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201348.576637:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201348.576686:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201348.576717:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:16785:x1875064570093952:12345-0@lo:501:mount.lustre.0 Request processed in 597us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201348.576727:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1788201348.576924:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9df6780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201348.577025:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570094080 00000100:00100000:2.0:1788201348.577031:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570094080 00000100:00100000:0.0:1788201348.577137:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1788201348.577151:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:16785:x1875064570094080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201348.577775:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:16785:x1875064570094080:12345-0@lo:503:mount.lustre.0 Request processed in 626us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.577784:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1788201348.577928:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094080:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201348.579045:0:16785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201348.579156:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201348.579324:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201348.579509:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9df6780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201348.579859:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570094208 00000100:00100000:0.0:1788201348.579867:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570094208 00000100:00100000:0.0:1788201348.580045:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1788201348.580058:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:16785:x1875064570094208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201348.580431:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:16785:x1875064570094208:12345-0@lo:502:mount.lustre.0 Request processed in 374us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.580450:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1788201348.581018:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201348.582624:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:2.0:1788201348.582738:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:0.0:1788201348.583285:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:0.0:1788201348.583333:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:0.0:1788201348.583646:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000100:00100000:0.0:1788201348.583714:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201348.583914:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.584078:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201348.584140:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570094336 00000100:00100000:3.0:1788201348.584152:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570094336 00000100:00100000:3.0:1788201348.584388:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788201348.584402:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:16785:x1875064570094336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201348.584665:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:16785:x1875064570094336:12345-0@lo:502:mount.lustre.0 Request processed in 265us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.584685:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1788201348.584881:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201348.585442:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:1.0:1788201348.585459:0:16785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:1.0:1788201348.586844:0:16790:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201348.586860:0:16790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201348.586864:0:16790:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788201348.586872:0:16790:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff962487d4b000 00000020:00000080:1.0:1788201348.586875:0:16790:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201348.586886:0:16790:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201348.586888:0:16790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201348.586890:0:16790:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788201348.586892:0:16790:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201348.586895:0:16790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201348.586903:0:16790:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788201348.586909:0:16790:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff962487d4b000 00000020:00000080:1.0:1788201348.586911:0:16790:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201348.587250:0:16790:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201348.587254:0:16790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201348.587256:0:16790:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788201348.587259:0:16790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 7 count 7 00000020:01000000:1.0:1788201348.587322:0:16785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1788201348.587378:0:16785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201348.587405:0:16785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.587420:0:16785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201348.587479:0:16785:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788201348.587482:0:16785:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962487d4b000 10000000:01000000:1.0:1788201348.587487:0:16785:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962487d4b000 10000000:01000000:1.0:1788201348.587492:0:16785:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201348.587500:0:16785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff962487d4b000 from 1 10000000:01000000:1.0:1788201348.587503:0:16785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201348.587554:0:16785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.587566:0:16785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.587580:0:16785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201348.587614:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201348.587718:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201348.593271:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624982c9840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201348.594024:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570094464 00000100:00100000:0.0:1788201348.594038:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570094464 00000100:00100000:0.0:1788201348.594110:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1788201348.594124:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:16785:x1875064570094464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201348.594148:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201348.594174:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb44a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb443 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.594216:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb44a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb443 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.594229:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb44a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb443 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.594239:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4de200, rc 0) 00000100:00100000:0.0:1788201348.594362:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:16785:x1875064570094464:12345-0@lo:101:mount.lustre.0 Request processed in 221us (6624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.594369:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1788201348.594725:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201348.594748:0:16785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.594761:0:16785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201348.627083:0:16785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000040:00080000:1.0:1788201348.628188:0:16785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201348.628555:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:1.0:1788201348.628603:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 120 off8536 00000040:00080000:1.0:1788201348.628634:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 168 off8704 00000040:00080000:1.0:1788201348.628679:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8928 00000040:00080000:1.0:1788201348.631552:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9152 00000040:00080000:0.0:1788201348.634690:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9272 00000040:00080000:0.0:1788201348.634853:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 168 off9440 00000040:00080000:0.0:1788201348.634889:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9664 00000040:00080000:0.0:1788201348.635000:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9888 00000040:00080000:0.0:1788201348.635040:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 120 off10008 00000040:00080000:0.0:1788201348.635076:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10232 00000040:00080000:0.0:1788201348.635131:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 224 off10456 00000040:00080000:0.0:1788201348.635167:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 88 off10544 00000040:00080000:0.0:1788201348.635201:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 128 off10672 00000040:00080000:0.0:1788201348.635257:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 144 off10816 00000040:00080000:0.0:1788201348.635292:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 160 off10976 00000040:00080000:0.0:1788201348.635325:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 224 off11200 00000040:00080000:0.0:1788201348.635406:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11424 00000040:00080000:0.0:1788201348.635439:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 80 off11504 00000040:00080000:0.0:1788201348.635475:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 224 off11728 00000040:00080000:0.0:1788201348.635525:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11952 00000040:00080000:0.0:1788201348.635564:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 88 off12040 00000040:00080000:0.0:1788201348.635598:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 128 off12168 00000040:00080000:0.0:1788201348.635646:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 144 off12312 00000040:00080000:0.0:1788201348.635679:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 128 off12440 00000040:00080000:0.0:1788201348.635709:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 224 off12664 00000040:00080000:0.0:1788201348.635752:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 224 off12888 00000040:00080000:0.0:1788201348.635786:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 80 off12968 00000040:00080000:0.0:1788201348.635816:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 224 off13192 00000040:00080000:0.0:1788201348.635866:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13416 00000040:00080000:0.0:1788201348.635903:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 88 off13504 00000040:00080000:0.0:1788201348.635936:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 128 off13632 00000040:00080000:0.0:1788201348.635985:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 144 off13776 00000040:00080000:0.0:1788201348.636037:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 128 off13904 00000040:00080000:0.0:1788201348.636081:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 224 off14128 00000040:00080000:0.0:1788201348.636134:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 224 off14352 00000040:00080000:0.0:1788201348.636170:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 80 off14432 00000040:00080000:0.0:1788201348.636204:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 224 off14656 00000040:00080000:0.0:1788201348.636252:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14880 00000040:00080000:0.0:1788201348.636289:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 120 off15000 00000040:00080000:0.0:1788201348.636474:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 224 off15224 00000040:00080000:0.0:1788201348.636491:0:16785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 41 count 42 00000100:00100000:0.0:1788201348.636672:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201348.636765:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.636829:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201348.637168:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570094592 00000100:00100000:2.0:1788201348.637179:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570094592 00000100:00100000:2.0:1788201348.637255:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1788201348.637266:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:16785:x1875064570094592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201348.637603:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:16785:x1875064570094592:12345-0@lo:501:mount.lustre.0 Request processed in 337us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201348.637611:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1788201348.640621:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201348.640992:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201348.641103:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.641159:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201348.641234:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570094720 00000100:00100000:2.0:1788201348.641243:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570094720 00000100:00100000:2.0:1788201348.641315:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1788201348.641327:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:16785:x1875064570094720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201348.642076:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:16785:x1875064570094720:12345-0@lo:503:mount.lustre.0 Request processed in 747us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201348.642086:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1788201348.642244:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094720:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788201348.645113:0:16785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201348.645274:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201348.645424:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201348.645477:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff96238360f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201348.645563:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570094848 00000100:00100000:0.0:1788201348.645572:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570094848 00000100:00100000:0.0:1788201348.645631:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1788201348.645642:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:16785:x1875064570094848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201348.646039:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:16785:x1875064570094848:12345-0@lo:502:mount.lustre.0 Request processed in 398us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.646048:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1788201348.646246:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201348.646578:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:3.0:1788201348.646638:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 120 off8536 00000040:00080000:3.0:1788201348.646670:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 168 off8704 00000040:00080000:3.0:1788201348.646713:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8928 00000040:00080000:3.0:1788201348.646747:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9152 00000040:00080000:3.0:1788201348.646817:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9272 00000040:00080000:3.0:1788201348.646851:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 168 off9440 00000040:00080000:3.0:1788201348.646882:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9664 00000040:00080000:3.0:1788201348.646956:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9888 00000040:00080000:3.0:1788201348.647009:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 120 off10008 00000040:00080000:3.0:1788201348.647043:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10232 00000040:00080000:3.0:1788201348.647089:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 224 off10456 00000040:00080000:3.0:1788201348.647124:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 88 off10544 00000040:00080000:3.0:1788201348.647158:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 128 off10672 00000040:00080000:3.0:1788201348.647206:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 144 off10816 00000040:00080000:3.0:1788201348.647244:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 160 off10976 00000040:00080000:3.0:1788201348.647282:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 224 off11200 00000040:00080000:3.0:1788201348.647323:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11424 00000040:00080000:3.0:1788201348.647382:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 80 off11504 00000040:00080000:3.0:1788201348.647411:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 224 off11728 00000040:00080000:3.0:1788201348.647450:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11952 00000040:00080000:3.0:1788201348.647513:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 88 off12040 00000040:00080000:3.0:1788201348.647555:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 128 off12168 00000040:00080000:3.0:1788201348.647605:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 144 off12312 00000040:00080000:3.0:1788201348.647656:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 128 off12440 00000040:00080000:3.0:1788201348.647690:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 224 off12664 00000040:00080000:3.0:1788201348.647751:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 224 off12888 00000040:00080000:3.0:1788201348.647781:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 80 off12968 00000040:00080000:3.0:1788201348.647808:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 224 off13192 00000040:00080000:3.0:1788201348.647849:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13416 00000040:00080000:3.0:1788201348.647879:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 88 off13504 00000040:00080000:3.0:1788201348.647907:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 128 off13632 00000040:00080000:3.0:1788201348.647933:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 144 off13776 00000040:00080000:3.0:1788201348.647983:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 128 off13904 00000040:00080000:3.0:1788201348.648018:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 224 off14128 00000040:00080000:3.0:1788201348.648058:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 224 off14352 00000040:00080000:3.0:1788201348.648088:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 80 off14432 00000040:00080000:3.0:1788201348.648117:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 224 off14656 00000040:00080000:3.0:1788201348.648161:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14880 00000040:00080000:3.0:1788201348.648196:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 120 off15000 00000100:00100000:3.0:1788201348.648262:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201348.648392:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201348.648449:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba2c3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201348.649016:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570094976 00000100:00100000:0.0:1788201348.649029:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570094976 00000100:00100000:0.0:1788201348.649094:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1788201348.649104:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:16785:x1875064570094976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201348.649440:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:16785:x1875064570094976:12345-0@lo:502:mount.lustre.0 Request processed in 335us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.649449:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1788201348.650065:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570094976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201348.650240:0:16785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 224 off15224 00000040:00080000:3.0:1788201348.650260:0:16785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788201348.653655:0:16793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788201348.653680:0:16793:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff962487fc0000) 00000020:00000080:1.0:1788201348.653724:0:16793:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788201348.653955:0:16793:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962487d4b000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788201348.653960:0:16793:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962487d4b000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788201348.653963:0:16793:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962487d4b000 3 00010000:00080000:1.0:1788201348.654012:0:16793:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962382b0c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.156@tcp at head 00010000:00010000:1.0:1788201348.655917:0:16793:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788201348.656067:0:16793:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788201348.656118:0:16793:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201348.656136:0:16793:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa81c4c9a2f3cb458 00000100:00080000:1.0:1788201348.656150:0:16793:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201348.656157:0:16793:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff962382b0c000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201348.656215:0:16793:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624904a2d80 x1875064570095104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201348.656249:0:16793:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788201348.656331:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201348.656336:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201348.656338:0:8:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201348.656371:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:1.0:1788201348.656374:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201348.656379:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201348.656393:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624904a3100 x1875064570095360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201348.656461:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570095232:0@lo:400:kworker.0 00000100:00100000:2.0:1788201348.658901:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570095104:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201348.663167:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.663249:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570095232 00000100:00100000:0.0:1788201348.663264:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570095232 00000100:00100000:0.0:1788201348.663391:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788201348.663405:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570095232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201348.665788:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201348.665864:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570095360:0@lo:8:kworker.0 00000100:00100000:2.0:1788201348.665921:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201348.666183:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570095104 00000100:00100000:3.0:1788201348.666194:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570095104 00000100:00100000:3.0:1788201348.666239:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201348.666247:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3281:x1875064570095104:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788201348.666283:0:5826:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:3.0:1788201348.666331:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa81c4c9a2f3cb45f 00000004:00100000:3.0:1788201348.666368:0:5826:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201348.666419:0:5826:0:(import.c:65:import_set_state_nolock()) ffff96248f026800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201348.666495:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875064570095104:12345-0@lo:38:llog_process_th.0 Request processed in 246us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.666516:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201348.666554:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570095360 00000100:00100000:3.0:1788201348.666558:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570095360 00000100:00100000:3.0:1788201348.666583:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788201348.666589:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570095360:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788201348.666628:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570095360:12345-0@lo:8:kworker.0 Request processed in 38us (706us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788201348.666635:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788201348.666687:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201348.666699:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788201348.667087:0:3281:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788201348.667096:0:3281:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201348.667099:0:3281:0:(import.c:65:import_set_state_nolock()) ffff962382b0c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201348.667109:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570095104:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788201348.667128:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201348.667132:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201348.667135:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570095360:0@lo:8:kworker.0 00000100:00100000:2.0:1788201348.667279:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570095616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201348.667330:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201348.667393:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201348.667402:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570095488:0@lo:400:kworker.0 00000100:00100000:2.0:1788201348.667429:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201348.667519:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570095616 00000100:00100000:3.0:1788201348.667525:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570095616 00000100:00100000:3.0:1788201348.667581:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788201348.667590:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570095616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.667641:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570095616:12345-0@lo:400:kworker.0 Request processed in 53us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.667647:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788201348.667667:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570095488 00000100:00100000:3.0:1788201348.667680:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570095488 00000100:00080000:2.0:1788201348.667921:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201348.667927:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201348.667957:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788201348.667974:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570095488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201348.668014:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570095488:12345-0@lo:400:kworker.0 Request processed in 50us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.668020:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788201348.668063:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570095488:0@lo:400:kworker.0 00010000:00080000:3.0:1788201348.668077:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624904a3b80 x1875064570095616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201348.668089:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570095616:0@lo:400:kworker.0 00000040:00080000:1.0:1788201348.668999:0:16793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000100:00100000:0.0:1788201348.669422:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570095232:12345-0@lo:400:kworker.0 Request processed in 6015us (6261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201348.669435:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788201348.669634:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570095232:0@lo:400:kworker.0 00000020:01000000:2.0:1788201348.671839:0:16785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788201348.671898:0:16785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201348.671988:0:16785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201348.672005:0:16785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788201348.672120:0:16785:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788201348.672123:0:16785:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201348.672124:0:16785:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201348.672125:0:16785:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201348.672126:0:16785:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201348.672128:0:16785:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201348.672130:0:16785:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201348.672133:0:16785:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201348.672134:0:16785:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201348.672148:0:16785:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788201348.672151:0:16785:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201348.672152:0:16785:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201348.672153:0:16785:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201348.672154:0:16785:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201348.672155:0:16785:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201348.672156:0:16785:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201348.672156:0:16785:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201348.672157:0:16785:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201348.672158:0:16785:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201348.672197:0:16785:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788201348.672226:0:16785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba116a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570095744:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201348.672333:0:16785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201348.672419:0:16785:0:(client.c:2702:ptlrpc_set_wait()) set ffff96238360f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201348.673975:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570095744 00000100:00100000:1.0:1788201348.673992:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570095744 00000100:00100000:1.0:1788201348.674074:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1788201348.674086:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:16785:x1875064570095744:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201348.674131:0:5820:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788201348.674149:0:5820:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788201348.712310:0:5820:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201348.712327:0:5820:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788201348.712707:0:5841:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201348.712715:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201348.712744:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201348.712780:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3cb0ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb0e6 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201348.712794:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3cb109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd999fa expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201348.712804:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201348.712861:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3cb109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd999fa expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201348.712877:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3cb109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd999fa expref: 9 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201348.712920:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570095872:192.168.201.56@tcp:104: 00010000:00010000:3.0:1788201348.713477:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3cb0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3cb0e6 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201348.713488:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3cb0ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb0e6 expref: 19 pid: 5818 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201348.713500:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570096000:0@lo:104: 00000100:00100000:3.0:1788201348.713576:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201348.713615:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff962485b36900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201348.713640:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570096000 00000100:00100000:3.0:1788201348.713648:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570096000 00000100:00100000:3.0:1788201348.713704:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201348.713714:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570096000:12345-0@lo:104: 00010000:00010000:3.0:1788201348.713728:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cb0ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201348.715204:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201348.715222:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570096000:12345-0@lo:104: Request processed in 1504us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201348.715233:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788201348.715362:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201348.715373:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cb0ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.715385:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7c200 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:0.0:1788201348.715391:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3cb0ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.715402:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3cb0ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201348.715411:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3cb0ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201348.715417:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201348.715468:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cb0ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.715476:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201348.715502:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cb0ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.715509:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624b9a7c200/0xa81c4c9a2f3cb0e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cb0ed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201348.715528:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201348.715530:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201348.715549:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201348.715587:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570096128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201348.715639:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201348.715706:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570096128 00000100:00100000:0.0:1788201348.715714:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570096128 00010000:00010000:0.0:1788201348.715749:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3cb0ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb0e6 expref: 20 pid: 5818 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201348.715875:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570096000:0@lo:104: 00000100:00100000:2.0:1788201348.716534:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201348.716549:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+20:3282:x1875064570096128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201348.716566:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201348.716574:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3cb0ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb0e6 expref: 20 pid: 5818 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201348.716586:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3cb0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb0e6 expref: 20 pid: 5818 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201348.716605:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624b9a7de00/0xa81c4c9a2f3cb0ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb0e6 expref: 20 pid: 5818 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201348.716620:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201348.716669:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570096128:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201348.716690:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201348.716858:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570096128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201348.719791:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201348.720120:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559569280 00000100:00100000:1.0:1788201348.720133:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559569280 00010000:00010000:1.0:1788201348.720198:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3cb109 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd999fa expref: 10 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201348.720266:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 50 00000100:00100000:1.0:1788201348.720277:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559569280:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201348.720296:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201348.720303:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3cb109 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd999fa expref: 10 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.720318:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3cb109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd999fa expref: 10 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.720378:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.720387:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201348.720411:0:5811:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012377394s 00010000:00010000:1.0:1788201348.720416:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.720425:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.720433:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.720440:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.720447:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624b9a7d200 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:1.0:1788201348.720459:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.720470:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.720482:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.720493:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201348.720579:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559569280:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 302us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201348.720589:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 50 00010000:00010000:1.0:1788201348.720658:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624829c5c00/0xa81c4c9a2f3cb109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd999fa expref: 9 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201348.720679:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570095872:192.168.201.56@tcp:104: 00010000:00010000:1.0:1788201348.720717:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.720728:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.720736:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201348.720743:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624b9a7d200/0xa81c4c9a2f3cb466 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201348.724481:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:16785:x1875064570095744:12345-0@lo:253:mount.lustre.0 Request processed in 50380us (52130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201348.724520:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1788201348.724663:0:16785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba116a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:16785:1875064570095744:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201348.724684:0:16785:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788201348.724688:0:16785:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201348.724690:0:16785:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201348.724699:0:16785:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201348.724700:0:16785:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201348.724702:0:16785:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201348.724703:0:16785:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201348.724705:0:16785:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201348.724707:0:16785:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201348.724709:0:16785:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788201348.724729:0:16785:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788201348.729194:0:16785:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201348.729693:0:16785:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201348.730123:0:16785:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201348.730287:0:16785:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201348.730615:0:16785:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201348.730939:0:16785:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00080000:3.0:1788201348.732235:0:16785:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-OST0000, 2 recoverable clients, last_transno 17179869202 00010000:00080000:0.0:1788201348.732997:0:16797:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-OST0000: started recovery thread pid 16797 00010000:00080000:0.0:1788201348.733017:0:16797:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788201348.733022:0:16797:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1788201348.733225:0:16785:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788201348.733321:0:16785:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788201348.733367:0:16785:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788201348.733410:0:16785:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788201348.919784:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201349.686902:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201349.686933:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570096256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201349.687044:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201349.687190:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570096256 00000100:00100000:3.0:1788201349.687202:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570096256 00000100:00100000:3.0:1788201349.687370:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788201349.687384:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570096256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201349.687434:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201349.687496:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570096256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201349.687504:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:2.0:1788201349.687698:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624904a1c00 x1875064570096256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201349.687722:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570096256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201349.747435:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201349.747974:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559569408 00000100:00100000:1.0:1788201349.747989:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559569408 00000100:00100000:1.0:1788201349.748076:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 411 00000100:00100000:1.0:1788201349.748089:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:10055:x1875064559569408:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201349.748116:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201349.748144:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962498ac2800/0xa81c4c9a2f3cb46d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd99ae1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.748184:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962498ac2800/0xa81c4c9a2f3cb46d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ae1 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.748197:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962498ac2800/0xa81c4c9a2f3cb46d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ae1 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.748209:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac2800, rc 0) 00000100:00100000:1.0:1788201349.748285:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559569408:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 199us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201349.748293:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 411 00000100:00100000:0.0:1788201349.764142:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201349.764234:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559569536 00000100:00100000:1.0:1788201349.764248:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559569536 00000100:00100000:1.0:1788201349.764321:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 412 00000100:00100000:1.0:1788201349.764333:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559569536:12345-192.168.201.56@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201349.764393:0:5820:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1788201349.764423:0:5820:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201349.764427:0:5820:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788201349.767795:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559569536:12345-192.168.201.56@tcp:256:ll_cfg_requeue.0 Request processed in 3447us (3653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201349.767816:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 412 00000100:00100000:3.0:1788201349.773772:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201349.773876:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559569664 00000100:00100000:1.0:1788201349.773889:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559569664 00000100:00100000:1.0:1788201349.773961:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:1.0:1788201349.773974:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559569664:12345-192.168.201.56@tcp:8:ll_cfg_requeue.0 00010000:00080000:1.0:1788201349.774023:0:8088:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '986744c8-ee81-4a47-8d91-97f81ede1f3e' at ffff962492c03800, cookie 0xa81c4c9a2f3cb42e 00010000:00080000:1.0:1788201349.774029:0:8088:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp recovering/t17179869189 exp ffff962492c03800 cur 481 last 1788201348 00010000:02000400:1.0:1788201349.774040:0:8088:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1788201349.788876:0:8088:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:1.0:1788201349.788908:0:8088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff962492c03800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 2097152 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201349.789638:0:8088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00000100:00080000:1.0:1788201349.789831:0:8088:0:(import.c:65:import_set_state_nolock()) ffff962382b0c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201349.791218:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559569664:12345-192.168.201.56@tcp:8:ll_cfg_requeue.0 Request processed in 15946us (16163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201349.791374:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:2.0:1788201349.813922:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201349.815401:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559569792 00000100:00100000:0.0:1788201349.815417:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559569792 00000100:00100000:0.0:1788201349.815515:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 115 00000100:00100000:0.0:1788201349.815530:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559569792:12345-192.168.201.56@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788201349.815558:0:6671:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9624ba114700 x1875064559569792/t0(0) o101->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:470/0 lens 328/0 e 0 to 0 dl 1788201360 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201349.815578:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559569792:12345-192.168.201.56@tcp:101:ldlm_lock_repla.0 Request processed in 53us (1672us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201349.815586:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 115 00010000:00080000:0.0:1788201349.815611:0:16797:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1788201349.941472:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201349.946168:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559569920 00000100:00100000:3.0:1788201349.946190:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559569920 00000100:00100000:3.0:1788201349.946499:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 236 00000100:00100000:3.0:1788201349.946530:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559569920:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201349.946650:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559569920:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 125us (5189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201349.946660:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 236 00000100:00080000:3.0:1788201349.946703:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201349.946782:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:3.0:1788201349.946969:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201349.949087:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559570048 00000100:00100000:1.0:1788201349.949104:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559570048 00000100:00100000:1.0:1788201349.949186:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:1.0:1788201349.949199:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559570048:12345-192.168.201.56@tcp:63:ll_sa.0 00010000:00010000:1.0:1788201349.949253:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201349.949275:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2200/0xa81c4c9a2f3cb474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99ae8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.949332:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3400/0xa81c4c9a2f3cb47b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.949522:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3400/0xa81c4c9a2f3cb47b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.949534:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3400/0xa81c4c9a2f3cb47b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.949552:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2000/0xa81c4c9a2f3cb482 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb9679252 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.949558:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2000/0xa81c4c9a2f3cb482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb9679252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.949565:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2000/0xa81c4c9a2f3cb482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb9679252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950013:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3400/0xa81c4c9a2f3cb47b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950022:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3400/0xa81c4c9a2f3cb47b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950029:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3400/0xa81c4c9a2f3cb47b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950036:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201349.950042:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3400/0xa81c4c9a2f3cb47b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950050:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3400/0xa81c4c9a2f3cb47b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950063:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201349.950073:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201349.950078:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3400/0xa81c4c9a2f3cb47b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950085:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3400/0xa81c4c9a2f3cb47b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950096:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2000/0xa81c4c9a2f3cb482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb9679252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950102:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2000/0xa81c4c9a2f3cb482 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb9679252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950109:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2000/0xa81c4c9a2f3cb482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb9679252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950114:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2000 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201349.950116:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2000/0xa81c4c9a2f3cb482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb9679252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950121:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2000/0xa81c4c9a2f3cb482 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb9679252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950129:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb9679252 (ffff9624a8490d00) 00010000:00010000:1.0:1788201349.950131:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201349.950134:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2000/0xa81c4c9a2f3cb482 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb9679252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950139:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2000/0xa81c4c9a2f3cb482 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb9679252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950174:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2200/0xa81c4c9a2f3cb474 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ae8 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950198:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201349.950201:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201349.950207:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2200/0xa81c4c9a2f3cb474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ae8 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201349.950217:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac2200, rc -2) 00000100:00100000:1.0:1788201349.950293:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559570048:12345-192.168.201.56@tcp:63:ll_sa.0 Request processed in 1097us (3510us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201349.950302:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 3 10000000:01000000:2.0:1788201349.950625:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201349.950630:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9624902af800 from 9 10000000:01000000:2.0:1788201349.950634:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201349.950682:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201349.950691:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201349.950701:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201349.950724:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba116a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570096384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201349.950778:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201349.950830:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff96238360f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201349.954419:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570096384 00000100:00100000:3.0:1788201349.954441:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570096384 00000100:00100000:3.0:1788201349.954626:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1788201349.954642:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570096384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201349.954668:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201349.954693:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624b9a7c400/0xa81c4c9a2f3cb490 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb489 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201349.954730:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624b9a7c400/0xa81c4c9a2f3cb490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb489 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201349.954744:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624b9a7c400/0xa81c4c9a2f3cb490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb489 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201349.954755:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7c400, rc 0) 00000100:00100000:3.0:1788201349.954874:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570096384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (4093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201349.954883:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1788201349.955890:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba116a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570096384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201349.955931:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb490 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201349.955958:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb490 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201349.956031:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9dea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570096512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788201349.956097:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201349.956144:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201349.956240:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570096512 00000100:00100000:2.0:1788201349.956247:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570096512 00000100:00100000:2.0:1788201349.956299:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1788201349.956308:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570096512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201349.956335:0:5820:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201349.956380:0:5820:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201349.956384:0:5820:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788201349.956469:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570096512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 161us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201349.956476:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1788201349.956676:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9dea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570096512:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1788201349.956713:0:5822:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff96249852b000 already not connected (conn 24, was 0): DISCONN 00010000:00080000:0.0:1788201349.956723:0:5822:0:(ldlm_lib.c:85:import_set_conn()) imp ffff96249852b000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.201.156@tcp, moved to head 00000100:00080000:0.0:1788201349.956728:0:5822:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201349.956734:0:5822:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788201349.956755:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624b9de9500 x1875064570096640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1788201349.956800:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201349.956808:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb490 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201349.956816:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb490 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201349.956862:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570096640:0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1788201349.956894:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201349.957025:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570096640 00000100:00100000:0.0:1788201349.957030:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570096640 00000100:00100000:0.0:1788201349.957061:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788201349.957067:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570096640:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1788201349.957096:0:6670:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff962492c00000, cookie 0xa81c4c9a2f3cb427 00010000:00080000:0.0:1788201349.957101:0:6670:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t17179869194 exp ffff962492c00000 cur 482 last 1788201348 00002000:00100000:0.0:1788201349.957117:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff962492c00000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788201349.957120:0:6670:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788201349.957123:0:6670:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1788201349.957244:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9624857c5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201349.957292:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570096640:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 224us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201349.957299:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:0.0:1788201349.957318:0:16797:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788201349.957323:0:16797:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 17179869203 00010000:00080000:0.0:1788201349.957327:0:16797:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 17179869203 00010000:00080000:0.0:1788201349.957330:0:16797:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 17179869203 00010000:00080000:0.0:1788201349.957744:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9de9500 x1875064570096640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201349.957755:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869202 gen 2 00000004:00080000:0.0:1788201349.957760:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9624c1cc6a00, transno 17179869194 00000004:00080000:0.0:1788201349.957779:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9624c1cc5500, transno 17179869195 00000004:00080000:0.0:1788201349.957783:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9624c1cc4380, transno 17179869196 00000004:00080000:0.0:1788201349.957787:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9624c1cc5180, transno 17179869197 00000004:00080000:0.0:1788201349.957789:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9624c1cc7b80, transno 17179869198 00000004:00080000:0.0:1788201349.957791:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9624c1cc4700, transno 17179869199 00000004:00080000:0.0:1788201349.957794:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9624c1cc5880, transno 17179869200 00000004:00080000:0.0:1788201349.957797:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9624c1cc6300, transno 17179869201 00000004:00080000:0.0:1788201349.957800:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962485739880, transno 17179869202 00000100:00080000:0.0:1788201349.957806:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 5 00000100:00080000:0.0:1788201349.957823:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1788201349.957828:0:3281:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788201349.957830:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869202 gen 2 00000100:00080000:0.0:1788201349.957833:0:3281:0:(recover.c:53:ptlrpc_replay_next()) import ffff96249852b000 from lustre-OST0000_UUID committed 17179869202 last 0 00000100:00080000:0.0:1788201349.957836:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1788201349.957937:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570096640:0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1788201349.957978:0:16843:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1788201349.957982:0:16843:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:0.0:1788201349.957987:0:16843:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:0.0:1788201349.958026:0:16843:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1788201349.958055:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570096768:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788201349.958088:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201349.958121:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570096768 00000100:00100000:0.0:1788201349.958126:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570096768 00000100:00100000:0.0:1788201349.958153:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788201349.958161:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570096768:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788201349.958175:0:6671:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff9624b9dea300 x1875064570096768/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:470/0 lens 224/0 e 0 to 0 dl 1788201360 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201349.958190:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570096768:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 31us (103us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201349.958196:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00080000:0.0:1788201349.958209:0:16797:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 17179869203 00010000:00080000:0.0:1788201349.958213:0:16797:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00010000:00080000:0.0:1788201349.958217:0:16797:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201349.958219:0:16797:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201349.958233:0:16797:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.201.56@tcp: req@ffff9624ba114700 x1875064559569792/t0(0) o101->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:470/0 lens 328/0 e 0 to 0 dl 1788201360 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201349.958248:0:16797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201349.958273:0:16797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb497 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99ada expref: -99 pid: 16797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201349.958298:0:16797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb497 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ada expref: 6 pid: 16797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201349.958317:0:16797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb497 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ada expref: 6 pid: 16797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201349.958328:0:16797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dee00, rc 0) 00010000:00080000:0.0:1788201349.958406:0:16797:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201349.958417:0:16797:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00000004:00080000:2.0:1788201349.964700:0:6845:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 9 done 00000100:00100000:2.0:1788201349.972234:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201349.974749:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559570176 00000100:00100000:0.0:1788201349.974768:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559570176 00000100:00100000:1.0:1788201349.975219:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 137 00000100:00100000:1.0:1788201349.975232:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559570176:12345-192.168.201.56@tcp:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1788201349.975252:0:6670:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff96248c858a80 x1875064559570176/t0(0) o400->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:470/0 lens 224/0 e 0 to 0 dl 1788201360 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201349.975274:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559570176:12345-192.168.201.56@tcp:400:ptlrpcd_rcv.0 Request processed in 47us (3052us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201349.975281:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 137 00010000:00080000:0.0:1788201349.975317:0:16797:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788201349.975559:0:16797:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836480 00010000:00080000:3.0:1788201350.109586:0:16797:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:3.0:1788201350.109607:0:16797:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9624b9dea300 x1875064570096768/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:470/0 lens 224/0 e 0 to 0 dl 1788201360 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000001:00100000:0.0:1788201350.109829:0:16853:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000001:00100000:0.0:1788201350.109837:0:16853:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1788201350.110112:0:16797:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.201.56@tcp: req@ffff96248c858a80 x1875064559570176/t0(0) o400->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:470/0 lens 224/0 e 0 to 0 dl 1788201360 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788201350.110179:0:16797:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1788201350.116679:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1788201350.116700:0:3281:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9624b9de9500 x1875064570096768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201365 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201350.116713:0:3281:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9624b9de9500 x1875064570096768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201365 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201350.116720:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:1.0:1788201350.116739:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:1.0:1788201350.116753:0:3281:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00002000:00080000:3.0:1788201350.119038:0:16797:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788201350.119047:0:16797:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00100000:3.0:1788201350.119464:0:6846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8b9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064570097024:0@lo:7:osp-pre-0-0.0 00000100:00100000:3.0:1788201350.119532:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201350.119568:0:6846:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624916a1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201350.119582:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201350.119591:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570096896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201350.119616:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201350.119647:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570096896 00000100:00100000:3.0:1788201350.119653:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570096896 00000100:00100000:3.0:1788201350.119697:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788201350.119706:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570096896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201350.119724:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:3.0:1788201350.119767:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570096896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201350.119774:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788201350.119815:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570096896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201350.120256:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570097024 00000100:00100000:0.0:1788201350.120261:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570097024 00000100:00100000:0.0:1788201350.120294:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201350.120301:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6846:x1875064570097024:12345-0@lo:7:osp-pre-0-0.0 00002000:00080000:3.0:1788201350.137088:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788201350.137103:0:6671:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x240000400:0x21:0x0] 00000100:00100000:3.0:1788201350.137220:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6846:x1875064570097024:12345-0@lo:7:osp-pre-0-0.0 Request processed in 16915us (17683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201350.137231:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201350.137889:0:6846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8b9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064570097024:0@lo:7:osp-pre-0-0.0 00000004:00080000:0.0:1788201350.137906:0:6846:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x240000400:0x21:0x0] 00000100:00080000:1.0:1788201350.141798:0:3281:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000015f2bc70): req@ffff962492c6c700 x1875064570090368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/224 e 0 to 0 dl 1788201346 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201350.141835:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570096768:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788201350.142034:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201350.142165:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570090368 00000100:00100000:0.0:1788201350.142176:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570090368 00000100:00100000:0.0:1788201350.142242:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788201350.142253:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570090368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201350.142284:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:0.0:1788201350.142364:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570090368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201350.142371:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788201350.142881:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570090368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201350.967510:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201351.994257:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201353.015102:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201353.794899:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570097536:0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.794980:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201353.795038:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201353.795045:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570097152:0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.795077:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201353.795108:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570097664:0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.795133:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201353.795160:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570097408:0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.795182:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201353.795203:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788201353.795209:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570097280:0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.795231:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201353.795247:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570097792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.795271:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201353.795316:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570097664 00000100:00100000:0.0:1788201353.795326:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570097664 00000100:00100000:0.0:1788201353.796575:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570097408 00000100:00100000:0.0:1788201353.796587:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570097408 00000100:00100000:0.0:1788201353.796628:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788201353.796641:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570097664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.798947:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570097536 00000100:00100000:0.0:1788201353.798961:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570097536 00000100:00100000:0.0:1788201353.799024:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570097280 00000100:00100000:0.0:1788201353.799027:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570097280 00000100:00100000:0.0:1788201353.799041:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570097792 00000100:00100000:0.0:1788201353.799044:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570097792 00000100:00100000:0.0:1788201353.799063:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788201353.799072:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570097536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.799161:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570097536:12345-0@lo:400:kworker.0 Request processed in 90us (4181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201353.799169:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788201353.799188:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788201353.799194:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570097280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.799229:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570097280:12345-0@lo:400:kworker.0 Request processed in 36us (3997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201353.799235:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788201353.799247:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788201353.799253:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570097792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.799281:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570097792:12345-0@lo:400:kworker.0 Request processed in 29us (4009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201353.799286:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:0.0:1788201353.801588:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201353.801598:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201353.801601:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201353.801623:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788201353.801648:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570097408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.801790:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570097408:12345-0@lo:400:kworker.0 Request processed in 149us (6605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201353.801799:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788201353.802154:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570097664:12345-0@lo:400:kworker.0 Request processed in 5516us (7018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201353.802161:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788201353.802213:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570097280:0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.802230:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570097792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.802241:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570097408:0@lo:400:kworker.0 00010000:00080000:0.0:1788201353.802286:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9de8000 x1875064570097664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201353.802866:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570097664:0@lo:400:kworker.0 00000100:00100000:0.0:1788201353.802903:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570097536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201353.804585:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570097152 00000100:00100000:1.0:1788201353.804596:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570097152 00000100:00100000:1.0:1788201353.804643:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1788201353.804652:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570097152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201353.804757:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570097152:12345-0@lo:400:kworker.0 Request processed in 106us (9678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201353.804765:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1788201353.804917:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570097152:0@lo:400:kworker.0 00010000:00010000:3.0:1788201354.041552:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201354.807663:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570097920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201354.807737:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201354.808512:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570097920 00000100:00100000:2.0:1788201354.808522:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570097920 00000100:00100000:2.0:1788201354.808596:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788201354.808608:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570097920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201354.808662:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201354.808717:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570097920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201354.808725:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:0.0:1788201354.809072:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624904ea300 x1875064570097920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201354.809092:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570097920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201355.058783:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201355.059019:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559570304 00000100:00100000:0.0:1788201355.059029:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559570304 00000100:00100000:0.0:1788201355.059102:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 416 00000100:00100000:0.0:1788201355.059113:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559570304:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201355.059194:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559570304:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 84us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201355.059202:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 416 00000100:00100000:3.0:1788201355.060710:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201355.060783:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201355.060817:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559570432 00000100:00100000:3.0:1788201355.060825:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559570432 00000100:00100000:3.0:1788201355.065149:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 240 00000100:00100000:3.0:1788201355.065161:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559570432:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201355.065253:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559570432:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 94us (4473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201355.065261:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 240 00000100:00080000:3.0:1788201355.065368:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201355.065491:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201355.065748:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559570560 00000100:00100000:2.0:1788201355.065757:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559570560 00000100:00100000:2.0:1788201355.065800:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 140 00000100:00100000:2.0:1788201355.065809:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559570560:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201355.065854:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559570560:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 47us (7024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.065886:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 140 00000100:00080000:3.0:1788201355.067054:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201355.326172:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201355.326193:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570098048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201355.326260:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201355.326453:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570098048 00000100:00100000:3.0:1788201355.326462:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570098048 00000100:00100000:3.0:1788201355.326533:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201355.326543:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570098048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201355.326578:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:3.0:1788201355.326627:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570098048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201355.326635:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201355.326687:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570098048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201355.326760:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201356.088180:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201356.817401:0:17144:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788201357.130664:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201358.136337:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201358.907321:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570098560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201358.907423:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201358.907484:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201358.907491:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570098176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201358.907522:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201358.907543:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570098688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201358.907568:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201358.907739:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570098176 00000100:00100000:1.0:1788201358.907748:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570098176 00000100:00100000:1.0:1788201358.907808:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1788201358.907817:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570098176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201358.907869:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570098176:12345-0@lo:400:kworker.0 Request processed in 53us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201358.907877:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1788201358.907984:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570098176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201358.908011:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570098304:0@lo:400:kworker.0 00000100:00100000:2.0:1788201358.908037:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201358.908057:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570098816:0@lo:400:kworker.0 00000100:00100000:2.0:1788201358.908077:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201358.908109:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201358.908115:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570098432:0@lo:400:kworker.0 00000100:00100000:2.0:1788201358.908138:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201358.908169:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570098560 00000100:00100000:2.0:1788201358.908173:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570098560 00000100:00100000:2.0:1788201358.908212:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570098304 00000100:00100000:2.0:1788201358.908216:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570098304 00000100:00100000:2.0:1788201358.908228:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570098816 00000100:00100000:2.0:1788201358.908230:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570098816 00000100:00100000:2.0:1788201358.908244:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788201358.908262:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570098560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201358.908426:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570098688 00000100:00100000:1.0:1788201358.908430:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570098688 00000100:00100000:1.0:1788201358.908460:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570098432 00000100:00100000:1.0:1788201358.908463:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570098432 00000100:00100000:1.0:1788201358.908481:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788201358.908488:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570098688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201358.908530:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570098688:12345-0@lo:400:kworker.0 Request processed in 43us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201358.908544:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788201358.908556:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788201358.908563:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570098432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201358.908612:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570098432:12345-0@lo:400:kworker.0 Request processed in 49us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201358.908618:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788201358.908756:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570098560:12345-0@lo:400:kworker.0 Request processed in 495us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201358.908763:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788201358.908777:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788201358.908783:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570098304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201358.908828:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570098304:12345-0@lo:400:kworker.0 Request processed in 45us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201358.908834:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788201358.908845:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788201358.908851:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570098816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201358.908876:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570098816:12345-0@lo:400:kworker.0 Request processed in 26us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201358.908882:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1788201358.908907:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201358.908911:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201358.908913:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201358.908947:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570098432:0@lo:400:kworker.0 00000100:00100000:2.0:1788201358.908958:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570098304:0@lo:400:kworker.0 00000100:00100000:2.0:1788201358.908968:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570098816:0@lo:400:kworker.0 00010000:00080000:2.0:1788201358.909001:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624904ea300 x1875064570098688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201358.909012:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570098688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201358.909022:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570098560:0@lo:400:kworker.0 00010000:00010000:3.0:1788201359.158493:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201359.928991:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201359.929029:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570098944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201359.929108:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201359.929238:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570098944 00000100:00100000:2.0:1788201359.929247:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570098944 00000100:00100000:2.0:1788201359.929305:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788201359.929316:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570098944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201359.929377:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201359.929438:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570098944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.929456:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00010000:00080000:1.0:1788201359.929553:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba19b100 x1875064570098944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201359.929574:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570098944:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201360.184172:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201360.187936:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201360.187983:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201360.188064:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201360.188250:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559570688 00000100:00100000:1.0:1788201360.188261:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559570688 00000100:00100000:1.0:1788201360.188325:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 418 00000100:00100000:1.0:1788201360.188337:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559570688:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201360.188481:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559570688:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 146us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201360.188732:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559570944 00000100:00100000:0.0:1788201360.188738:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559570944 00000100:00100000:0.0:1788201360.188800:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 143 00000100:00100000:0.0:1788201360.188810:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559570944:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201360.188847:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559570944:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 40us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201360.188856:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 143 00000100:00100000:2.0:1788201360.189010:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559570816 00000100:00100000:2.0:1788201360.189015:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559570816 00000100:00100000:2.0:1788201360.189051:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 244 00000100:00100000:2.0:1788201360.189059:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559570816:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201360.189089:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559570816:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 32us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201360.189108:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 244 00000100:00080000:2.0:1788201360.189128:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201360.189132:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201360.190260:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 418 00000100:00100000:0.0:1788201360.438577:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201360.438601:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570099072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201360.438683:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201360.438757:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570099072 00000100:00100000:3.0:1788201360.438774:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570099072 00000100:00100000:3.0:1788201360.438845:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788201360.438856:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570099072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201360.438894:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:3.0:1788201360.438946:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570099072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201360.438954:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788201360.439007:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570099072:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201360.439216:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201361.206850:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201361.298374:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201361.299431:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559571072 00000100:00100000:0.0:1788201361.299445:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559571072 00000100:00100000:0.0:1788201361.299516:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 81 00000100:00100000:0.0:1788201361.299526:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:15033:x1875064559571072:12345-192.168.201.56@tcp:41:lfs.0 00000004:00000024:0.0:1788201361.299574:0:5827:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788201361.299697:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:15033:x1875064559571072:12345-192.168.201.56@tcp:41:lfs.0 Request processed in 172us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.299719:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 81 00000100:00100000:2.0:1788201361.310709:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201361.310988:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559571200 00000100:00100000:3.0:1788201361.310999:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559571200 00000100:00100000:3.0:1788201361.311132:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 137 00000100:00100000:3.0:1788201361.311144:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e3ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:15033:x1875064559571200:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:3.0:1788201361.311173:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:3.0:1788201361.311285:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e3ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:15033:x1875064559571200:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 142us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201361.311293:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 137 00000100:00100000:3.0:1788201361.322768:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201361.323012:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559571328 00000100:00100000:2.0:1788201361.323023:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559571328 00000100:00100000:2.0:1788201361.323075:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 118 00000100:00100000:2.0:1788201361.323083:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559571328:12345-192.168.201.56@tcp:8:lfs.0 00010000:00080000:2.0:1788201361.323120:0:6668:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:2.0:1788201361.323149:0:6668:0:(genops.c:1406:class_connect()) connect: client 986744c8-ee81-4a47-8d91-97f81ede1f3e, cookie 0xa81c4c9a2f3cb49e 00002000:00100000:2.0:1788201361.323161:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff9623824b2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788201361.323186:0:6668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:2.0:1788201361.323514:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788201361.323939:0:6668:0:(import.c:65:import_set_state_nolock()) ffff9623824b7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201361.324027:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559571328:12345-192.168.201.56@tcp:8:lfs.0 Request processed in 942us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201361.324036:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 118 00000100:00100000:1.0:1788201361.326109:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201361.326205:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559571456 00000100:00100000:0.0:1788201361.326216:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559571456 00000100:00100000:0.0:1788201361.326288:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 138 00000100:00100000:0.0:1788201361.326299:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:15033:x1875064559571456:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:0.0:1788201361.326323:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201361.326421:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:15033:x1875064559571456:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 123us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.326428:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 138 00000100:00080000:2.0:1788201361.327119:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201362.236920:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201363.082694:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00010000:00010000:3.0:1788201363.254531:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201364.033738:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570099584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.033839:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201364.033894:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201364.033901:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570099200:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.033939:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201364.033984:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570099712:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034009:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201364.034045:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570099328:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034082:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201364.034100:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570099840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034122:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201364.034138:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201364.034143:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570099456:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034164:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201364.034208:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570099584 00000100:00100000:1.0:1788201364.034215:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570099584 00000100:00100000:1.0:1788201364.034264:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570099328 00000100:00100000:1.0:1788201364.034268:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570099328 00000100:00100000:1.0:1788201364.034280:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570099840 00000100:00100000:1.0:1788201364.034283:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570099840 00000100:00100000:1.0:1788201364.034299:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788201364.034307:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570099584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034387:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570099584:12345-0@lo:400:kworker.0 Request processed in 80us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201364.034394:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788201364.034410:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788201364.034415:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570099328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034444:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570099328:12345-0@lo:400:kworker.0 Request processed in 29us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201364.034449:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788201364.034459:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788201364.034465:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570099840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034490:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570099840:12345-0@lo:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201364.034505:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788201364.034523:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570099200 00000100:00100000:1.0:1788201364.034527:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570099200 00000100:00100000:1.0:1788201364.034551:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1788201364.034557:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570099200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034586:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570099200:12345-0@lo:400:kworker.0 Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201364.034592:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1788201364.034618:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570099712 00000100:00100000:1.0:1788201364.034621:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570099712 00000100:00100000:1.0:1788201364.034645:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570099456 00000100:00100000:1.0:1788201364.034647:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570099456 00000100:00100000:1.0:1788201364.034665:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788201364.034671:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570099712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034696:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570099712:12345-0@lo:400:kworker.0 Request processed in 26us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201364.034714:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788201364.034725:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788201364.034730:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570099456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034756:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570099456:12345-0@lo:400:kworker.0 Request processed in 26us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201364.034762:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1788201364.034786:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201364.034790:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201364.034792:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201364.034829:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570099456:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034850:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570099328:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034858:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570099840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034883:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570099200:0@lo:400:kworker.0 00010000:00080000:1.0:1788201364.034894:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624904a2d80 x1875064570099712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201364.034905:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570099712:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.034912:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570099584:0@lo:400:kworker.0 00010000:00010000:2.0:1788201364.278607:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201365.048369:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570099968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201365.048458:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201365.048558:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570099968 00000100:00100000:2.0:1788201365.048567:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570099968 00000100:00100000:2.0:1788201365.048616:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788201365.048626:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570099968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201365.048665:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201365.048724:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570099968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201365.048732:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00010000:00080000:2.0:1788201365.048775:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba19aa00 x1875064570099968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201365.048794:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570099968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201365.303247:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201365.305719:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201365.305767:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201365.305801:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201365.305830:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201365.305875:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559571712 00000100:00100000:2.0:1788201365.305885:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559571712 00000100:00100000:2.0:1788201365.305960:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 248 00000100:00100000:2.0:1788201365.305972:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559571712:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201365.306066:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559571712:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201365.306073:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 248 00000100:00100000:2.0:1788201365.306099:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559571840 00000100:00100000:2.0:1788201365.306103:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559571840 00000100:00100000:2.0:1788201365.306130:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559571968 00000100:00100000:2.0:1788201365.306134:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559571968 00000100:00100000:2.0:1788201365.306156:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 146 00000100:00100000:2.0:1788201365.306163:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559571840:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201365.306192:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559571840:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 30us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201365.306197:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 146 00000100:00100000:2.0:1788201365.306209:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 147 00000100:00100000:2.0:1788201365.306215:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559571968:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201365.306236:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559571968:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201365.306243:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 147 00000100:00080000:2.0:1788201365.306259:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201365.306264:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201365.306266:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201365.306778:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559571584 00000100:00100000:0.0:1788201365.306785:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559571584 00000100:00100000:0.0:1788201365.306817:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 420 00000100:00100000:0.0:1788201365.306824:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559571584:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201365.306860:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559571584:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 37us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201365.306867:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 420 00000100:00100000:3.0:1788201365.559298:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201365.559325:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570100096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201365.559424:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201365.559532:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570100096 00000100:00100000:2.0:1788201365.559540:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570100096 00000100:00100000:2.0:1788201365.559585:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788201365.559608:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570100096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201365.559641:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:2.0:1788201365.559720:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570100096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201365.559725:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788201365.559810:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570100096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201366.327085:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201367.129897:0:17443:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00010000:00010000:2.0:1788201367.350575:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201368.375564:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201368.721658:0:17491:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00000100:00100000:3.0:1788201369.142993:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570100608:0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.143105:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201369.143188:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788201369.143195:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570100224:0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.143230:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201369.143255:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570100736:0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.143286:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201369.143320:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570100608 00000100:00100000:3.0:1788201369.143330:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570100608 00000100:00100000:0.0:1788201369.143337:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570100224 00000100:00100000:0.0:1788201369.143360:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570100224 00000100:00100000:0.0:1788201369.143414:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1788201369.143414:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788201369.143424:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570100224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.143424:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570100608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201369.143918:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570100224:12345-0@lo:400:kworker.0 Request processed in 493us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201369.143949:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1788201369.144111:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570100352:0@lo:400:kworker.0 00000100:00100000:2.0:1788201369.144152:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201369.144186:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570100864:0@lo:400:kworker.0 00000100:00100000:2.0:1788201369.144211:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201369.144232:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201369.144238:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570100480:0@lo:400:kworker.0 00000100:00100000:2.0:1788201369.144261:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201369.144299:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570100736 00000100:00100000:2.0:1788201369.144304:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570100736 00000100:00100000:2.0:1788201369.144356:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570100480 00000100:00100000:2.0:1788201369.144359:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570100480 00000100:00100000:2.0:1788201369.144389:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788201369.144397:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570100736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201369.144876:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570100352 00000100:00100000:1.0:1788201369.144883:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570100352 00000100:00100000:1.0:1788201369.144913:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570100864 00000100:00100000:1.0:1788201369.144916:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570100864 00000100:00100000:1.0:1788201369.144933:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788201369.144940:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570100352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201369.144989:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570100352:12345-0@lo:400:kworker.0 Request processed in 50us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201369.144995:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788201369.145008:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788201369.145014:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570100864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201369.145039:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570100864:12345-0@lo:400:kworker.0 Request processed in 26us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201369.145044:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788201369.145087:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570100352:0@lo:400:kworker.0 00000100:00100000:1.0:1788201369.145099:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570100864:0@lo:400:kworker.0 00000100:00100000:1.0:1788201369.145170:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788201369.145179:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570100480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201369.145218:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570100480:12345-0@lo:400:kworker.0 Request processed in 41us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201369.145224:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1788201369.145249:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201369.145255:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201369.145257:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201369.145275:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570100480:0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.145660:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570100608:12345-0@lo:400:kworker.0 Request processed in 2235us (2553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201369.145669:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788201369.151050:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570100224:0@lo:400:kworker.0 00000100:00100000:2.0:1788201369.153427:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570100736:12345-0@lo:400:kworker.0 Request processed in 9013us (10122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201369.153452:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00010000:00080000:0.0:1788201369.153579:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bb8ba680 x1875064570100736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201369.153597:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570100736:0@lo:400:kworker.0 00000100:00100000:0.0:1788201369.153641:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570100608:0@lo:400:kworker.0 00010000:00010000:3.0:1788201369.398583:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201370.166688:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570100992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201370.166797:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201370.167019:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570100992 00000100:00100000:2.0:1788201370.167032:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570100992 00000100:00100000:2.0:1788201370.167107:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788201370.167119:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570100992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201370.167173:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201370.167253:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570100992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201370.167261:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00010000:00080000:0.0:1788201370.167376:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624904e9f80 x1875064570100992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201370.167401:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570100992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201370.421878:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201370.421927:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201370.421977:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201370.422051:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559572352 00000100:00100000:1.0:1788201370.422064:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559572352 00000100:00100000:1.0:1788201370.422146:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 150 00000100:00100000:1.0:1788201370.422160:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559572352:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201370.422259:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559572352:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 101us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201370.422266:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 150 00000100:00080000:1.0:1788201370.422471:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201370.422895:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201370.423453:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559572224 00000100:00100000:3.0:1788201370.423464:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559572224 00010000:00010000:2.0:1788201370.423609:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201370.423827:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559572096 00000100:00100000:0.0:1788201370.423833:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559572096 00000100:00100000:0.0:1788201370.423892:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 422 00000100:00100000:0.0:1788201370.423903:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559572096:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201370.423985:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559572096:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 83us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201370.423993:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 422 00000100:00100000:3.0:1788201370.424047:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 252 00000100:00100000:3.0:1788201370.424055:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559572224:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201370.424108:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559572224:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 55us (2131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201370.424116:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 252 00000100:00100000:1.0:1788201370.424231:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559572480 00000100:00100000:1.0:1788201370.424236:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559572480 00000100:00100000:1.0:1788201370.424279:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 151 00000100:00100000:1.0:1788201370.424287:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559572480:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201370.424330:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559572480:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 45us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201370.424337:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 151 00000100:00080000:1.0:1788201370.424396:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201370.424401:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201370.679539:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570101120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201370.679637:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201370.679764:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570101120 00000100:00100000:0.0:1788201370.679774:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570101120 00000100:00100000:0.0:1788201370.679827:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788201370.679835:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570101120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201370.679870:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:0.0:1788201370.679929:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570101120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201370.679937:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788201370.680025:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570101120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201370.686886:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201370.694612:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559572608 00000100:00100000:1.0:1788201370.694634:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559572608 00000100:00100000:1.0:1788201370.694740:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 82 00000100:00100000:1.0:1788201370.694753:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:15497:x1875064559572608:12345-192.168.201.56@tcp:41:lfs.0 00000004:00000024:1.0:1788201370.694816:0:6693:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201370.694923:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:15497:x1875064559572608:12345-192.168.201.56@tcp:41:lfs.0 Request processed in 171us (8051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201370.694930:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 82 00000100:00100000:3.0:1788201370.698944:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201370.699405:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559572736 00000100:00100000:0.0:1788201370.699423:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559572736 00000100:00100000:0.0:1788201370.699505:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 143 00000100:00100000:0.0:1788201370.699516:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:15497:x1875064559572736:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:0.0:1788201370.699545:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:0.0:1788201370.699657:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:15497:x1875064559572736:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 142us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201370.699664:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 143 00000100:00100000:0.0:1788201370.708548:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201370.709569:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559572864 00000100:00100000:2.0:1788201370.709580:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559572864 00000100:00100000:2.0:1788201370.709653:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 144 00000100:00100000:2.0:1788201370.709663:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:15497:x1875064559572864:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:2.0:1788201370.709690:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201370.709772:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:15497:x1875064559572864:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 110us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201370.709778:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 144 00000100:00100000:1.0:1788201370.754926:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201370.755613:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559573120 00000100:00100000:3.0:1788201370.755626:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559573120 00000100:00100000:3.0:1788201370.755699:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 83 00000100:00100000:3.0:1788201370.755710:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:15513:x1875064559573120:12345-192.168.201.56@tcp:101:cmp.0 00010000:00010000:3.0:1788201370.755731:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201370.755754:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb4a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99aef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.755897:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb4ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.755912:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb4ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.755924:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb4ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201370.755937:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xd:0x0]: returning size 5242880 00010000:00010000:3.0:1788201370.756203:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7d000/0xa81c4c9a2f3cb4a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99aef expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.756237:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb4ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99aef expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.756246:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9624a84c1c00) 00010000:00010000:3.0:1788201370.756249:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201370.756252:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624b9a7dc00, rc 0) 00000100:00100000:3.0:1788201370.758117:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:15513:x1875064559573120:12345-192.168.201.56@tcp:101:cmp.0 Request processed in 2398us (3190us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788201370.758131:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 83 00000100:00100000:1.0:1788201370.787139:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201370.787535:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559573248 00000100:00100000:3.0:1788201370.787545:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559573248 00000100:00100000:3.0:1788201370.787628:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:3.0:1788201370.787640:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559573248:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201370.787660:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201370.787688:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624b9a7dc00/0xa81c4c9a2f3cb4ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99aef expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.787710:0:11284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9624a84c1c00) 00010000:00010000:3.0:1788201370.787716:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201370.787789:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559573248:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 151us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201370.787798:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:0.0:1788201370.829436:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201370.829528:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559573504 00000100:00100000:2.0:1788201370.829538:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559573504 00000100:00100000:2.0:1788201370.829607:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:2.0:1788201370.829617:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:15513:x1875064559573504:12345-192.168.201.56@tcp:35:cmp.0 00000100:00100000:2.0:1788201370.829862:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:15513:x1875064559573504:12345-192.168.201.56@tcp:35:cmp.0 Request processed in 245us (435us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788201370.829870:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:2.0:1788201370.881520:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201370.887023:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559573760 00000100:00100000:1.0:1788201370.887044:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559573760 00000100:00100000:1.0:1788201370.887138:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 84 00000100:00100000:1.0:1788201370.887150:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:15519:x1875064559573760:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:1.0:1788201370.887225:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201370.887254:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7000/0xa81c4c9a2f3cb3a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ad3 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.887277:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9624a84c1c00) 00010000:00010000:1.0:1788201370.887288:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201370.887313:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb4ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.887327:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb4ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.887337:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb4ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.887701:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb4c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.887712:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb4c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.887790:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb4c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.888385:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3600/0xa81c4c9a2f3cb4c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.888395:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3600/0xa81c4c9a2f3cb4c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.888403:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3600/0xa81c4c9a2f3cb4c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201370.891680:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 64 off9088 00000004:00080000:1.0:1788201370.891693:0:6693:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 502964350845ns, next at 503964347717ns, rc = 0 00010000:00010000:1.0:1788201370.891772:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb4cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.891788:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb4cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.891799:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb4cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.891808:0:6693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb4cf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.891825:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb4cf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.891831:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb4cf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.891858:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201370.891881:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3600/0xa81c4c9a2f3cb4c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.891887:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3600/0xa81c4c9a2f3cb4c8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.891893:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3600/0xa81c4c9a2f3cb4c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.891900:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201370.891904:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3600/0xa81c4c9a2f3cb4c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.891911:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3600/0xa81c4c9a2f3cb4c8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.892176:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9624a8490200) 00010000:00010000:1.0:1788201370.892181:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201370.892186:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3600/0xa81c4c9a2f3cb4c8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.892193:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3600/0xa81c4c9a2f3cb4c8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.892211:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb4ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.892223:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb4ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.892229:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb4ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.892234:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201370.892237:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb4ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.892243:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb4ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.892250:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201370.892252:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201370.892255:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb4ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.892259:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3e00/0xa81c4c9a2f3cb4ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201370.892270:0:6693:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b33b8c98 reply state 00000000e4547cc0 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb4c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201370.892279:0:6693:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201370.892394:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:15519:x1875064559573760:12345-192.168.201.56@tcp:36:rm.0 Request processed in 5243us (10880us total) trans 4294967370 rc 0/0 00010000:00010000:0.0:1788201370.892600:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201370.892607:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb4cf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.892615:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3200 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:0.0:1788201370.892619:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb4cf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.892626:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb4cf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.892636:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9624a8490200) 00010000:00010000:0.0:1788201370.892638:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201370.892641:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb4cf lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.892646:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3200/0xa81c4c9a2f3cb4cf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.892668:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.892670:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.892671:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201370.893191:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 84 00010000:00010000:1.0:1788201370.897695:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb4c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.897741:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb4c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.897750:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb4c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.897757:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3c00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201370.897762:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb4c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.897771:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb4c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.897788:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x733c6acc (ffff9624a8490700) 00010000:00010000:1.0:1788201370.897792:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201370.897796:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb4c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.897804:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac3c00/0xa81c4c9a2f3cb4c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x733c6acc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201371.449434:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201372.471967:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201373.495709:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201374.271931:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201374.271956:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570101248:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.272059:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201374.272137:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570101248 00000100:00100000:2.0:1788201374.272145:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570101248 00000100:00100000:1.0:1788201374.272157:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570101376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.272199:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201374.272216:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1788201374.272230:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570101248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.272244:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570101376 00000100:00100000:1.0:1788201374.272249:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570101376 00000100:00100000:2.0:1788201374.272292:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570101248:12345-0@lo:400:kworker.0 Request processed in 66us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201374.272301:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1788201374.272305:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788201374.272323:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570101376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.272420:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570101376:12345-0@lo:400:kworker.0 Request processed in 98us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201374.272428:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788201374.272434:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570101248:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.272478:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570101376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.272530:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201374.272538:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570101504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.272565:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201374.272597:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570101504 00000100:00100000:1.0:1788201374.272600:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570101504 00000100:00080000:2.0:1788201374.272643:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201374.272648:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788201374.272657:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570101504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.272711:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570101504:12345-0@lo:400:kworker.0 Request processed in 56us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201374.272718:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788201374.272740:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570101504:0@lo:400:kworker.0 00000100:00100000:2.0:1788201374.272765:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570101632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201374.272799:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201374.272821:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201374.272829:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570101760:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.272834:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570101632 00000100:00100000:1.0:1788201374.272839:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570101632 00000100:00100000:2.0:1788201374.272870:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201374.272872:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788201374.272882:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570101632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201374.272904:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570101760 00000100:00100000:2.0:1788201374.272909:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570101760 00000100:00100000:1.0:1788201374.272929:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570101632:12345-0@lo:400:kworker.0 Request processed in 46us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201374.272936:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788201374.272945:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788201374.273011:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570101760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201374.273045:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570101760:12345-0@lo:400:kworker.0 Request processed in 38us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201374.273052:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788201374.273068:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201374.273075:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570101888:0@lo:400:kworker.0 00000100:00100000:2.0:1788201374.273098:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201374.273126:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201374.273130:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788201374.273146:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624904a2680 x1875064570101760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201374.273164:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570101760:0@lo:400:kworker.0 00000100:00100000:2.0:1788201374.273175:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570101632:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.279488:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570101888 00000100:00100000:1.0:1788201374.279504:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570101888 00000100:00100000:1.0:1788201374.279609:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788201374.279620:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570101888:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788201374.279834:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201374.280078:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570101888:12345-0@lo:400:kworker.0 Request processed in 458us (6976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201374.280088:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788201374.280155:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570101888:0@lo:400:kworker.0 00000001:00080000:0.0:1788201374.329148:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967370 is committed 00000004:00080000:0.0:1788201374.329162:0:5847:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:2.0:1788201374.329450:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201374.329473:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570102016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201374.329566:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201374.329629:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570102016 00000100:00100000:2.0:1788201374.329637:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570102016 00000100:00100000:2.0:1788201374.329686:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788201374.329695:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570102016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201374.329723:0:8088:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:14 count 1 00002000:00010000:1.0:1788201374.337583:0:8088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 5242880, mtime: 0x6a95c96f, atime: 0x0, ctime: 0x6a95c96f, blocks: 0x2807 00010000:00010000:1.0:1788201374.337604:0:8088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201374.337632:0:8088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb497 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ada expref: 5 pid: 16797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201374.337644:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788201374.337649:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201374.337655:0:8088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201374.337708:0:8088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb497 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99ada expref: 5 pid: 16797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201374.337726:0:8088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb497 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99ada expref: 5 pid: 16797 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201374.337748:0:8088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8088:1875064570102144:192.168.201.56@tcp:104: 00000100:00100000:1.0:1788201374.337976:0:8088:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c7e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201374.349197:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201374.349238:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559573888 00000100:00100000:3.0:1788201374.349257:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559573888 00000100:00100000:0.0:1788201374.349314:0:8088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8088:1875064570102144:192.168.201.56@tcp:104: 00010000:00010000:3.0:1788201374.349325:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb497 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99ada expref: 6 pid: 16797 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.349369:0:8088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201374.349391:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:3.0:1788201374.349404:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559573888:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201374.349420:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201374.349426:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb497 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99ada expref: 6 pid: 16797 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201374.349439:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb497 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99ada expref: 6 pid: 16797 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201374.349464:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb497 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99ada expref: 6 pid: 16797 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201374.349483:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201374.349488:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201374.349494:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201374.349505:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201374.349545:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201374.349604:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559573888:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 203us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201374.349623:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 51 00010000:00010000:0.0:1788201374.349703:0:8088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.349714:0:8088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.349726:0:8088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.349734:0:8088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.349758:0:8088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1788201374.350168:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201374.350255:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201374.350263:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201374.350272:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3000 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:3.0:1788201374.350276:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201374.350286:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201374.350299:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201374.350311:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016f89bf4/0xa81c4c9a2f3cb4d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201374.350332:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201374.350335:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201374.350338:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201374.351073:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1875064570102016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21365us (21495us total) trans 21474836481 rc 0/0 00000100:00100000:0.0:1788201374.351085:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000004:00080000:2.0:1788201374.351116:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9624ba170e00/2, rc 0, transno 21474836481 00000100:00100000:2.0:1788201374.351126:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570102016:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201374.518781:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201375.287851:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570102272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201375.287932:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201375.288136:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570102272 00000100:00100000:2.0:1788201375.288144:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570102272 00000100:00100000:2.0:1788201375.288200:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788201375.288209:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570102272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201375.288254:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201375.288304:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570102272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201375.288311:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00080000:2.0:1788201375.288387:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba172680 x1875064570102272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.288406:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570102272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201375.540733:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201375.540786:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201375.540885:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201375.540947:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201375.540989:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559574016 00000100:00100000:0.0:1788201375.540998:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559574016 00000100:00100000:0.0:1788201375.541053:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 424 00000100:00100000:0.0:1788201375.541064:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559574016:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201375.541145:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559574016:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 82us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201375.541153:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 424 00000100:00100000:1.0:1788201375.541163:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559574144 00000100:00100000:1.0:1788201375.541168:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559574144 00000100:00100000:1.0:1788201375.541222:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 256 00000100:00100000:1.0:1788201375.541239:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2344:x1875064559574144:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201375.541276:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2344:x1875064559574144:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 39us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201375.541283:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 256 00000100:00080000:1.0:1788201375.541301:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201375.542571:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559574400 00000100:00100000:2.0:1788201375.542582:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559574400 00000100:00100000:2.0:1788201375.542680:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559574272 00000100:00100000:2.0:1788201375.542684:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559574272 00000100:00080000:1.0:1788201375.542690:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201375.542999:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 154 00000100:00100000:3.0:1788201375.543011:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559574400:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201375.543086:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559574400:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 77us (2298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201375.543094:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 154 00000100:00100000:3.0:1788201375.543111:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 155 00000100:00100000:3.0:1788201375.543119:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559574272:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201375.543143:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559574272:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 26us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201375.543149:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 155 00010000:00010000:1.0:1788201375.543663:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201375.798564:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201375.798584:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570102400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201375.798648:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201375.798715:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570102400 00000100:00100000:0.0:1788201375.798722:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570102400 00000100:00100000:0.0:1788201375.798766:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788201375.798773:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570102400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201375.798806:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:0.0:1788201375.798844:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570102400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201375.798850:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788201375.798890:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570102400:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788201375.882636:0:16853:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 21474836481 is committed 00010000:00010000:3.0:1788201376.566557:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201377.590569:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201377.748932:0:17688:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 4: Fail OST during read, with verification ========================================================== 14:36:16 (1788201376) 00000100:00100000:0.0:1788201377.801804:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201377.801879:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559574656 00000100:00100000:2.0:1788201377.801888:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559574656 00000100:00100000:2.0:1788201377.801960:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 85 00000100:00100000:2.0:1788201377.801971:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:16093:x1875064559574656:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1788201377.801994:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201377.802016:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7600/0xa81c4c9a2f3cb4dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99af6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.802367:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7400/0xa81c4c9a2f3cb4e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.802382:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7400/0xa81c4c9a2f3cb4e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.802392:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7400/0xa81c4c9a2f3cb4e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788201377.804039:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201377.804839:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7e00/0xa81c4c9a2f3cb4eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.804863:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7e00/0xa81c4c9a2f3cb4eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.804896:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7e00/0xa81c4c9a2f3cb4eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201377.812744:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf:0x0], index 0: 0 00010000:00010000:2.0:1788201377.813057:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7800/0xa81c4c9a2f3cb4f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.813078:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7800/0xa81c4c9a2f3cb4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.813092:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7800/0xa81c4c9a2f3cb4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.813130:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7400/0xa81c4c9a2f3cb4e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.813138:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7400/0xa81c4c9a2f3cb4e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.813145:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7400/0xa81c4c9a2f3cb4e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.813151:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624904a7400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201377.813156:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7400/0xa81c4c9a2f3cb4e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.813163:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7400/0xa81c4c9a2f3cb4e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.813176:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:2.0:1788201377.813179:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201377.813191:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7400/0xa81c4c9a2f3cb4e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.813198:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7400/0xa81c4c9a2f3cb4e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201377.813213:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a0f0a1a reply state 000000006e3e20ef transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7e00/0xa81c4c9a2f3cb4eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201377.813222:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201377.813260:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7600/0xa81c4c9a2f3cb4dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99af6 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.813275:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7800/0xa81c4c9a2f3cb4f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99af6 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.813281:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9624a84c1900) 00010000:00010000:2.0:1788201377.813284:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201377.813286:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624904a7800, rc 0) 00000100:00100000:2.0:1788201377.813402:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:16093:x1875064559574656:12345-192.168.201.56@tcp:101:bash.0 Request processed in 11431us (11605us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788201377.813410:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 85 00010000:00010000:2.0:1788201377.826069:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7e00/0xa81c4c9a2f3cb4eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.826090:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7e00/0xa81c4c9a2f3cb4eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.826098:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7e00/0xa81c4c9a2f3cb4eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.826120:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624904a7e00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201377.826126:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7e00/0xa81c4c9a2f3cb4eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.826134:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7e00/0xa81c4c9a2f3cb4eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.826151:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xee27d887 (ffff9624a84c1600) 00010000:00010000:2.0:1788201377.826155:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201377.826160:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7e00/0xa81c4c9a2f3cb4eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201377.826168:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7e00/0xa81c4c9a2f3cb4eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201377.841635:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201377.841695:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559574784 00000100:00100000:0.0:1788201377.841706:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559574784 00000100:00100000:0.0:1788201377.841771:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:0.0:1788201377.841784:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:16093:x1875064559574784:12345-192.168.201.56@tcp:101:tee.0 00010000:00010000:0.0:1788201377.841820:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201377.841842:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9591d8b/0xa81c4c9a2f3cb500 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99afd expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788201377.842079:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1788201377.863878:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201377.863915:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788201377.863921:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201377.863939:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9591d8b/0xa81c4c9a2f3cb500 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99afd expref: 6 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201377.863963:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9591d8b/0xa81c4c9a2f3cb500 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99afd expref: 6 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201377.863978:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dfc00, rc 0) 00000100:00100000:3.0:1788201377.864045:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:16093:x1875064559574784:12345-192.168.201.56@tcp:101:tee.0 Request processed in 22264us (22421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201377.864054:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:0.0:1788201377.871980:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201377.872179:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559574912 00000100:00100000:3.0:1788201377.872190:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559574912 00002000:00100000:3.0:1788201377.872250:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (0->8191) req@ffff9624b9de9500 x1875064559574912/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:498/0 lens 8680/0 e 0 to 0 dl 1788201388 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201377.872260:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de9500 with x1875064559574912 ext(0->8191) 00002000:00010000:3.0:1788201377.872265:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de9500 00000100:00100000:3.0:1788201377.872299:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:3.0:1788201377.872308:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559574912:12345-192.168.201.56@tcp:4:tee.0 00000100:00100000:3.0:1788201377.872905:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559574912:12345-192.168.201.56@tcp:4:tee.0 Request processed in 596us (933us total) trans 21474836482 rc 0/0 00000100:00100000:3.0:1788201377.872912:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 26 00002000:00100000:3.0:1788201377.872919:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (0->8191) req@ffff9624b9de9500 x1875064559574912/t21474836482(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:498/0 lens 8680/448 e 0 to 0 dl 1788201388 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201377.872928:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de9500 with x1875064559574912 ext(0->8191) 00002000:00010000:3.0:1788201377.872931:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de9500 00000100:00100000:0.0:1788201378.076511:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201378.076893:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559575040 00000100:00100000:1.0:1788201378.076904:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559575040 00002000:00100000:1.0:1788201378.077138:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (8192->1056767) req@ffff9624b9deb480 x1875064559575040/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:499/0 lens 488/0 e 0 to 0 dl 1788201389 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201378.077151:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9deb480 with x1875064559575040 ext(8192->1056767) 00002000:00010000:1.0:1788201378.077156:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9deb480 00000100:00100000:1.0:1788201378.077239:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00100000:1.0:1788201378.077249:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559575040:12345-192.168.201.56@tcp:4:tee.0 00000100:00100000:0.0:1788201378.112264:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559575040:12345-192.168.201.56@tcp:4:tee.0 Request processed in 35004us (35751us total) trans 21474836483 rc 0/0 00000100:00100000:0.0:1788201378.112278:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 27 00002000:00100000:0.0:1788201378.112293:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (8192->1056767) req@ffff9624b9deb480 x1875064559575040/t21474836483(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:499/0 lens 488/448 e 0 to 0 dl 1788201389 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201378.112304:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9deb480 with x1875064559575040 ext(8192->1056767) 00002000:00010000:0.0:1788201378.112311:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9deb480 00000100:00100000:2.0:1788201378.389157:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201378.389876:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559575168 00000100:00100000:0.0:1788201378.389886:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559575168 00002000:00100000:0.0:1788201378.389941:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xf:0x0] (1056768->2105343) req@ffff9624ba172680 x1875064559575168/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:499/0 lens 488/0 e 0 to 0 dl 1788201389 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201378.390021:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba172680 with x1875064559575168 ext(1056768->2105343) 00002000:00010000:0.0:1788201378.390028:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba172680 00000100:00100000:0.0:1788201378.390104:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:0.0:1788201378.390115:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559575168:12345-192.168.201.56@tcp:4:tee.0 00000100:00100000:0.0:1788201378.411321:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559575168:12345-192.168.201.56@tcp:4:tee.0 Request processed in 21195us (22174us total) trans 21474836484 rc 0/0 00000100:00100000:0.0:1788201378.412872:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 28 00002000:00100000:0.0:1788201378.412904:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xf:0x0] (1056768->2105343) req@ffff9624ba172680 x1875064559575168/t21474836484(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:499/0 lens 488/448 e 0 to 0 dl 1788201389 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201378.412918:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba172680 with x1875064559575168 ext(1056768->2105343) 00002000:00010000:0.0:1788201378.412926:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba172680 00010000:00010000:1.0:1788201378.615294:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201378.644750:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201378.644920:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559575296 00000100:00100000:0.0:1788201378.644930:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559575296 00002000:00100000:0.0:1788201378.644983:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (2105344->3153919) req@ffff96248517d500 x1875064559575296/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:499/0 lens 488/0 e 0 to 0 dl 1788201389 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201378.644992:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248517d500 with x1875064559575296 ext(2105344->3153919) 00002000:00010000:0.0:1788201378.644996:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248517d500 00000100:00100000:0.0:1788201378.645023:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:0.0:1788201378.645031:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2341:x1875064559575296:12345-192.168.201.56@tcp:4:tee.0 00000100:00100000:0.0:1788201378.664148:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2341:x1875064559575296:12345-192.168.201.56@tcp:4:tee.0 Request processed in 19106us (19396us total) trans 21474836485 rc 0/0 00000100:00100000:0.0:1788201378.664163:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 29 00002000:00100000:0.0:1788201378.664178:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (2105344->3153919) req@ffff96248517d500 x1875064559575296/t21474836485(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:499/0 lens 488/448 e 0 to 0 dl 1788201389 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201378.664189:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248517d500 with x1875064559575296 ext(2105344->3153919) 00002000:00010000:0.0:1788201378.664195:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248517d500 00000100:00100000:2.0:1788201378.876670:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201378.876774:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559575424 00000100:00100000:0.0:1788201378.876793:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559575424 00002000:00100000:0.0:1788201378.876841:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xf:0x0] (3153920->4202495) req@ffff9624904a1c00 x1875064559575424/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:499/0 lens 488/0 e 0 to 0 dl 1788201389 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201378.876849:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a1c00 with x1875064559575424 ext(3153920->4202495) 00002000:00010000:0.0:1788201378.876865:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a1c00 00000100:00100000:0.0:1788201378.876895:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:0.0:1788201378.876903:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559575424:12345-192.168.201.56@tcp:4:tee.0 00000100:00100000:0.0:1788201378.937628:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559575424:12345-192.168.201.56@tcp:4:tee.0 Request processed in 60714us (60956us total) trans 21474836486 rc 0/0 00000100:00100000:0.0:1788201378.937645:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 30 00002000:00100000:0.0:1788201378.941747:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xf:0x0] (3153920->4202495) req@ffff9624904a1c00 x1875064559575424/t21474836486(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:499/0 lens 488/448 e 0 to 0 dl 1788201389 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201378.941770:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a1c00 with x1875064559575424 ext(3153920->4202495) 00002000:00010000:0.0:1788201378.941828:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a1c00 00000100:00100000:3.0:1788201379.170038:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201379.170200:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559575680 00000100:00100000:1.0:1788201379.170212:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559575680 00000100:00100000:1.0:1788201379.170300:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:1.0:1788201379.170311:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624afebe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:16093:x1875064559575680:12345-192.168.201.56@tcp:35:tee.0 00000001:00080000:1.0:1788201379.170657:0:5828:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967372 00000100:00100000:1.0:1788201379.170780:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624afebe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:16093:x1875064559575680:12345-192.168.201.56@tcp:35:tee.0 Request processed in 471us (753us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788201379.170803:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 34 00000020:00080000:1.0:1788201379.170808:0:5828:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1788201379.170866:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201379.203380:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201379.203546:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559575808 00000100:00100000:0.0:1788201379.203566:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559575808 00000100:00080000:2.0:1788201379.203638:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1788201379.203646:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (4202496->5242879) req@ffff9624bb8bb480 x1875064559575808/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/0 e 0 to 0 dl 1788201390 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201379.203658:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8bb480 with x1875064559575808 ext(4202496->5242879) 00002000:00010000:0.0:1788201379.203663:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8bb480 00000100:00100000:0.0:1788201379.203699:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:0.0:1788201379.203710:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559575808:12345-192.168.201.56@tcp:4:tee.0 00000100:00100000:0.0:1788201379.225807:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559575808:12345-192.168.201.56@tcp:4:tee.0 Request processed in 22088us (22461us total) trans 21474836487 rc 0/0 00000100:00100000:0.0:1788201379.225821:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 31 00002000:00100000:0.0:1788201379.225833:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (4202496->5242879) req@ffff9624bb8bb480 x1875064559575808/t21474836487(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/448 e 0 to 0 dl 1788201390 ref 1 fl Complete:/600/0 rc 0/0 job:'tee.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201379.225859:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8bb480 with x1875064559575808 ext(4202496->5242879) 00002000:00010000:0.0:1788201379.225865:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8bb480 00000100:00100000:0.0:1788201379.238100:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201379.238200:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559575936 00000100:00100000:3.0:1788201379.238211:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559575936 00000100:00100000:3.0:1788201379.238429:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:3.0:1788201379.238451:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9deb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:10052:x1875064559575936:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201379.238468:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788201379.238489:0:11284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:3.0:1788201379.238493:0:11284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb mtime from disk: 0 -> 1788201379 00002000:00010000:3.0:1788201379.238495:0:11284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb ctime from disk: 0 -> 1788201379 00010000:00010000:3.0:1788201379.238543:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9591d8b/0xa81c4c9a2f3cb500 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99afd expref: 18 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201379.238584:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201379.238640:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9deb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:10052:x1875064559575936:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 191us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201379.238647:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:2.0:1788201379.294539:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201379.294645:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559576192 00000100:00100000:1.0:1788201379.294655:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559576192 00000100:00100000:1.0:1788201379.294723:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 86 00000100:00100000:1.0:1788201379.294736:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:16099:x1875064559576192:12345-192.168.201.56@tcp:101:cmp.0 00010000:00010000:1.0:1788201379.294762:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201379.294784:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2a00/0xa81c4c9a2f3cb507 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b04 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201379.294893:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb50e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201379.294914:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb50e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201379.294940:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb50e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201379.294953:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 5242880 00010000:00010000:1.0:1788201379.295089:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2a00/0xa81c4c9a2f3cb507 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b04 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201379.295109:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb50e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b04 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201379.295118:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9624a84c1900) 00010000:00010000:1.0:1788201379.295133:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201379.295137:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962498ac2e00, rc 0) 00000100:00100000:1.0:1788201379.295202:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:16099:x1875064559576192:12345-192.168.201.56@tcp:101:cmp.0 Request processed in 466us (677us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788201379.295209:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 86 00000100:00100000:1.0:1788201379.302281:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201379.302459:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559576320 00000100:00100000:2.0:1788201379.302469:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559576320 00000100:00100000:2.0:1788201379.302529:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 121 00000100:00100000:2.0:1788201379.302539:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2343:x1875064559576320:12345-192.168.201.56@tcp:101:cmp.0 00010000:00010000:2.0:1788201379.302562:0:8088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201379.302587:0:8088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdfa1b37/0xa81c4c9a2f3cb51c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b0b expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201379.302617:0:8088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 5242880, mtime: 0x6a95c9a3, atime: 0x0, ctime: 0x6a95c9a3, blocks: 0x1 00010000:00010000:2.0:1788201379.302651:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788201379.302656:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201379.302666:0:8088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdfa1b37/0xa81c4c9a2f3cb51c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b0b expref: 18 pid: 8088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201379.302685:0:8088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cdfa1b37/0xa81c4c9a2f3cb51c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b0b expref: 18 pid: 8088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201379.302698:0:8088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624904a7400, rc 0) 00000100:00100000:2.0:1788201379.302761:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559576320:12345-192.168.201.56@tcp:101:cmp.0 Request processed in 223us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201379.302768:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 121 00000100:00100000:3.0:1788201379.312480:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201379.312656:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559576448 00000100:00100000:0.0:1788201379.312666:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559576448 00000100:00100000:0.0:1788201379.312737:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:0.0:1788201379.312748:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:2342:x1875064559576448:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201379.312766:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201379.312791:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962498ac2e00/0xa81c4c9a2f3cb50e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b04 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201379.312812:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9624a84c1900) 00010000:00010000:0.0:1788201379.312817:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201379.312876:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559576448:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 130us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201379.312883:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:1.0:1788201379.350888:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201379.350943:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201379.351032:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559576576 00000100:00100000:0.0:1788201379.351042:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559576576 00002000:00100000:0.0:1788201379.351090:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xf:0x0] (0->1048575) req@ffff9624bb8b9880 x1875064559576576/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/0 e 0 to 0 dl 1788201390 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201379.351102:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b9880 with x1875064559576576 ext(0->1048575) 00002000:00010000:0.0:1788201379.351107:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b9880 00000100:00100000:0.0:1788201379.351140:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559576704 00000100:00100000:0.0:1788201379.351143:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559576704 00002000:00100000:0.0:1788201379.351159:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xf:0x0] (1048576->2097151) req@ffff9624bb8bb800 x1875064559576704/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/0 e 0 to 0 dl 1788201390 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201379.351182:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8bb800 with x1875064559576704 ext(1048576->2097151) 00002000:00010000:0.0:1788201379.351186:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8bb800 00000100:00100000:0.0:1788201379.351199:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 32 00000100:00100000:0.0:1788201379.351208:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:2343:x1875064559576576:12345-192.168.201.56@tcp:3:cmp.0 00000100:00100000:1.0:1788201379.353893:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201379.353928:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201379.354059:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788201379.354163:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788201379.354656:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559576832 00000100:00100000:2.0:1788201379.354665:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559576832 00002000:00100000:2.0:1788201379.354708:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (2097152->3145727) req@ffff9624bb8ba680 x1875064559576832/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/0 e 0 to 0 dl 1788201390 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201379.354719:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8ba680 with x1875064559576832 ext(2097152->3145727) 00002000:00010000:2.0:1788201379.354724:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8ba680 00000100:00100000:2.0:1788201379.354742:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788201379.354748:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559576960 00000100:00100000:2.0:1788201379.354751:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559576960 00002000:00100000:2.0:1788201379.354764:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (3145728->4194303) req@ffff9624bb8b8e00 x1875064559576960/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/0 e 0 to 0 dl 1788201390 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201379.354772:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b8e00 with x1875064559576960 ext(3145728->4194303) 00002000:00010000:2.0:1788201379.354775:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b8e00 00000100:00100000:2.0:1788201379.358548:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:2.0:1788201379.358589:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559576704:12345-192.168.201.56@tcp:3:cmp.0 00000100:00100000:3.0:1788201379.391006:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570102528:0@lo:400:kworker.0 00000100:00100000:3.0:1788201379.391111:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201379.391211:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570102528 00000100:00100000:3.0:1788201379.391233:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570102528 00000100:00100000:3.0:1788201379.391292:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1788201379.391303:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570102528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201379.391837:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570102528:12345-0@lo:400:kworker.0 Request processed in 533us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201379.391848:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1788201379.391973:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570102528:0@lo:400:kworker.0 00000100:00100000:3.0:1788201379.392027:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570102656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201379.392064:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201379.392099:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570102656 00000100:00100000:3.0:1788201379.392103:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570102656 00000100:00100000:3.0:1788201379.392134:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788201379.392140:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570102656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201379.392195:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570102656:12345-0@lo:400:kworker.0 Request processed in 54us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201379.392201:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788201379.393768:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570102656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201379.393857:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201379.393868:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570102784:0@lo:400:kworker.0 00000100:00100000:3.0:1788201379.394295:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201379.394793:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559576704:12345-192.168.201.56@tcp:3:cmp.0 Request processed in 36208us (43844us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788201379.394805:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 33 00002000:00100000:2.0:1788201379.394821:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xf:0x0] (1048576->2097151) req@ffff9624bb8bb800 x1875064559576704/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/440 e 0 to 0 dl 1788201390 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201379.394834:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8bb800 with x1875064559576704 ext(1048576->2097151) 00002000:00010000:2.0:1788201379.394842:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8bb800 00000100:00100000:2.0:1788201379.394875:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:2.0:1788201379.394890:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:2344:x1875064559576832:12345-192.168.201.56@tcp:3:cmp.0 00000100:00100000:2.0:1788201379.396114:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570103040:0@lo:400:kworker.0 00000100:00100000:2.0:1788201379.396169:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201379.396200:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201379.396205:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570103168:0@lo:400:kworker.0 00000100:00100000:2.0:1788201379.396229:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201379.396263:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570102784 00000100:00100000:2.0:1788201379.396270:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570102784 00000100:00100000:2.0:1788201379.396318:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570103040 00000100:00100000:2.0:1788201379.396320:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570103040 00000100:00100000:2.0:1788201379.396367:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788201379.396375:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570102784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201379.396422:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570102784:12345-0@lo:400:kworker.0 Request processed in 48us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201379.396429:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788201379.396456:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788201379.396469:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570103040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201379.396499:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570103040:12345-0@lo:400:kworker.0 Request processed in 31us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201379.396505:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1788201379.396521:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201379.396525:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201379.396557:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e58000 x1875064570103040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201379.396571:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570103040:0@lo:400:kworker.0 00000100:00100000:2.0:1788201379.396636:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201379.396645:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570102912:0@lo:400:kworker.0 00000100:00100000:2.0:1788201379.396671:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201379.396777:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:2343:x1875064559576576:12345-192.168.201.56@tcp:3:cmp.0 Request processed in 45568us (45898us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788201379.396786:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 32 00002000:00100000:2.0:1788201379.396795:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xf:0x0] (0->1048575) req@ffff9624bb8b9880 x1875064559576576/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/440 e 0 to 0 dl 1788201390 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201379.396804:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b9880 with x1875064559576576 ext(0->1048575) 00002000:00010000:2.0:1788201379.396811:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b9880 00000100:00100000:2.0:1788201379.396860:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00100000:2.0:1788201379.396868:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559576960:12345-192.168.201.56@tcp:3:cmp.0 00000100:00100000:3.0:1788201379.397696:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836481 gen 2 00000004:00080000:3.0:1788201379.397707:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9624ba170e00, transno 21474836481 00000100:00100000:3.0:1788201379.397725:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570102784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201379.397847:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570103168 00000100:00100000:1.0:1788201379.397854:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570103168 00000100:00100000:1.0:1788201379.397917:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570102912 00000100:00100000:1.0:1788201379.397921:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570102912 00000100:00100000:1.0:1788201379.397945:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788201379.397953:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570103168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201379.398038:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570103168:12345-0@lo:400:kworker.0 Request processed in 86us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201379.398045:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788201379.398062:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788201379.398069:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570102912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201379.398104:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570102912:12345-0@lo:400:kworker.0 Request processed in 36us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201379.398109:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:1.0:1788201379.398126:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201379.398149:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570102912:0@lo:400:kworker.0 00000100:00100000:1.0:1788201379.398176:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570103168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201379.424511:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559576832:12345-192.168.201.56@tcp:3:cmp.0 Request processed in 29613us (70614us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788201379.424528:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 34 00002000:00100000:3.0:1788201379.424545:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xf:0x0] (2097152->3145727) req@ffff9624bb8ba680 x1875064559576832/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/440 e 0 to 0 dl 1788201390 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201379.425012:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8ba680 with x1875064559576832 ext(2097152->3145727) 00002000:00010000:3.0:1788201379.425023:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8ba680 00000100:00100000:2.0:1788201379.443722:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559576960:12345-192.168.201.56@tcp:3:cmp.0 Request processed in 46843us (89781us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788201379.443736:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 35 00002000:00100000:2.0:1788201379.443761:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xf:0x0] (3145728->4194303) req@ffff9624bb8b8e00 x1875064559576960/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/440 e 0 to 0 dl 1788201390 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201379.443773:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b8e00 with x1875064559576960 ext(3145728->4194303) 00002000:00010000:2.0:1788201379.443779:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b8e00 00000001:00080000:1.0:1788201379.486864:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967374 is committed 00000100:00100000:3.0:1788201379.487189:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201379.489675:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559577088 00000100:00100000:0.0:1788201379.489692:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559577088 00002000:00100000:0.0:1788201379.489753:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (4194304->5242879) req@ffff9624bfe6a300 x1875064559577088/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/0 e 0 to 0 dl 1788201390 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201379.489764:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe6a300 with x1875064559577088 ext(4194304->5242879) 00002000:00010000:0.0:1788201379.489770:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe6a300 00000100:00100000:0.0:1788201379.489801:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:0.0:1788201379.489810:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559577088:12345-192.168.201.56@tcp:3:cmp.0 00000100:00100000:0.0:1788201379.521241:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559577088:12345-192.168.201.56@tcp:3:cmp.0 Request processed in 31411us (34044us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788201379.521256:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 36 00002000:00100000:0.0:1788201379.521287:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xf:0x0] (4194304->5242879) req@ffff9624bfe6a300 x1875064559577088/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/440 e 0 to 0 dl 1788201390 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201379.521299:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe6a300 with x1875064559577088 ext(4194304->5242879) 00002000:00010000:0.0:1788201379.521319:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe6a300 00000100:00100000:3.0:1788201379.537666:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201379.537801:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559577216 00000100:00100000:2.0:1788201379.537878:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559577216 00002000:00100000:2.0:1788201379.537936:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xf:0x0] (5242880->5246975) req@ffff9624ba170e00 x1875064559577216/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/0 e 0 to 0 dl 1788201390 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201379.537947:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba170e00 with x1875064559577216 ext(5242880->5246975) 00002000:00010000:2.0:1788201379.537953:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba170e00 00000100:00100000:2.0:1788201379.537992:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 37 00000100:00100000:2.0:1788201379.538003:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559577216:12345-192.168.201.56@tcp:3:cmp.0 00000100:00100000:0.0:1788201379.542140:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559577216:12345-192.168.201.56@tcp:3:cmp.0 Request processed in 4126us (4471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201379.542154:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 37 00002000:00100000:0.0:1788201379.542184:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xf:0x0] (5242880->5246975) req@ffff9624ba170e00 x1875064559577216/t0(0) o3->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:500/0 lens 488/440 e 0 to 0 dl 1788201390 ref 1 fl Complete:/600/0 rc 0/0 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201379.542195:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba170e00 with x1875064559577216 ext(5242880->5246975) 00002000:00010000:0.0:1788201379.542202:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba170e00 00000100:00100000:3.0:1788201379.555601:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201379.555711:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559577472 00000100:00100000:2.0:1788201379.555721:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559577472 00000100:00100000:2.0:1788201379.555790:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00100000:2.0:1788201379.555800:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:16099:x1875064559577472:12345-192.168.201.56@tcp:35:cmp.0 00000100:00100000:2.0:1788201379.556157:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:16099:x1875064559577472:12345-192.168.201.56@tcp:35:cmp.0 Request processed in 357us (566us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788201379.556165:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 35 00010000:00010000:3.0:1788201379.638896:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201380.408796:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570103296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201380.408877:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201380.409089:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570103296 00000100:00100000:2.0:1788201380.409099:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570103296 00000100:00100000:2.0:1788201380.409158:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788201380.409169:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570103296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201380.409205:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201380.414014:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570103296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4836us (5125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.414038:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00010000:00080000:1.0:1788201380.416109:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9de9f80 x1875064570103296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201380.416139:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570103296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201380.659530:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201380.659568:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201380.659595:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201380.659633:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201380.659677:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559577856 00000100:00100000:3.0:1788201380.659687:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559577856 00000100:00100000:3.0:1788201380.659730:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559577984 00000100:00100000:3.0:1788201380.659733:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559577984 00000100:00100000:3.0:1788201380.659765:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 158 00000100:00100000:3.0:1788201380.659776:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559577856:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201380.659864:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559577856:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 90us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201380.659872:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 158 00000100:00100000:3.0:1788201380.659900:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 159 00000100:00100000:3.0:1788201380.659907:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559577984:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201380.659929:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559577984:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 23us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201380.659935:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 159 00000100:00100000:3.0:1788201380.659953:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559577728 00000100:00100000:3.0:1788201380.659956:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559577728 00000100:00100000:3.0:1788201380.659982:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 260 00000100:00100000:3.0:1788201380.659988:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559577728:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201380.660020:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559577728:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 32us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201380.660027:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 260 00000100:00080000:3.0:1788201380.660051:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201380.661677:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559577600 00000100:00100000:0.0:1788201380.661689:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559577600 00000100:00100000:0.0:1788201380.661747:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 426 00000100:00100000:0.0:1788201380.661755:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559577600:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201380.661817:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559577600:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 63us (2299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201380.661823:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 426 00010000:00010000:2.0:1788201380.662464:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201380.918530:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201380.918553:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570103424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201380.918621:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201380.918685:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570103424 00000100:00100000:0.0:1788201380.918692:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570103424 00000100:00100000:0.0:1788201380.918735:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788201380.918744:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570103424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201380.918767:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 63504384 pending 17039360 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201380.918807:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570103424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201380.918813:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788201380.918854:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570103424:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788201380.984895:0:16853:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 21474836487 is committed 00000020:01000004:0.0:1788201381.232498:0:17790:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788201381.232547:0:17790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201381.232579:0:17790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201381.232587:0:17790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201381.232594:0:17790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201381.232618:0:17790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201381.232624:0:17790:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788201381.232653:0:17790:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201381.232658:0:17790:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788201381.232666:0:17790:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201381.232693:0:17790:0:(import.c:65:import_set_state_nolock()) ffff962382b0c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788201381.232769:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201381.232776:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.232784:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac3800 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:2.0:1788201381.232788:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.232797:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201381.232804:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201381.232810:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201381.232813:0:5814:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788201381.232815:0:5814:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788201381.232841:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.232847:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201381.232897:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570103680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201381.232973:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201381.233052:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.233060:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962498ac3800/0xa81c4c9a2f3cb443 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb44a expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.233071:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201381.233080:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201381.233081:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201381.233116:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570103552:0@lo:39:umount.0 00000100:00100000:2.0:1788201381.233148:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201381.233196:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570103552 00000100:00100000:2.0:1788201381.233203:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570103552 00000100:00100000:2.0:1788201381.233258:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788201381.233268:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875064570103552:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201381.233298:0:5827:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb45f 00000100:00080000:2.0:1788201381.233305:0:5827:0:(import.c:65:import_set_state_nolock()) ffff96248f026800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201381.233389:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+1:3281:x1875064570103552:12345-0@lo:39:umount.0 Request processed in 122us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201381.233396:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000020:00000080:2.0:1788201381.233415:0:5827:0:(genops.c:906:class_export_put()) final put ffff96248736a000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:2.0:1788201381.233454:0:3281:0:(import.c:65:import_set_state_nolock()) ffff962382b0c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788201381.233464:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570103552:0@lo:39:umount.0 00000100:00080000:2.0:1788201381.233492:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201381.233501:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201381.233516:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248736a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201381.233559:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96248f026800 for lustre-MDT0000 00000100:00080000:2.0:1788201381.233589:0:17790:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201381.233592:0:17790:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201381.233597:0:17790:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788201381.234482:0:17790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.234494:0:17790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.234517:0:17790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.234524:0:17790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.234540:0:17790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201381.234552:0:16319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201381.234557:0:16319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.234565:0:16319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4de400 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:2.0:1788201381.234568:0:16319:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.234576:0:16319:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201381.234583:0:16319:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201381.234589:0:16319:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201381.234591:0:16319:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788201381.234614:0:16319:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.234620:0:16319:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201381.234922:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201381.234933:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570103808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201381.234976:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201381.235235:0:16319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.235256:0:16319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624ba4de400/0xa81c4c9a2f3cb40b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb412 expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.235491:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201381.235494:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201381.235496:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201381.235512:0:17790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.235520:0:17790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.235526:0:17790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.235531:0:17790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.235578:0:17790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201381.235583:0:17790:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788201381.235588:0:17790:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788201381.235611:0:17790:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788201381.235615:0:17790:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:2.0:1788201381.235620:0:17790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788201381.235625:0:17790:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00000100:00100000:3.0:1788201381.236373:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570103680 00000100:00100000:3.0:1788201381.236383:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570103680 00000100:00100000:3.0:1788201381.236507:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570103808 00000100:00100000:3.0:1788201381.236521:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570103808 00000100:00100000:3.0:1788201381.236548:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201381.236558:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624902bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+20:3282:x1875064570103680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201381.236571:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201381.236589:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb44a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb443 expref: 20 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.236602:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201381.236657:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624902bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570103680:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (3684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201381.236664:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201381.236712:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201381.236717:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3282:x1875064570103808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201381.236724:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201381.236731:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624b9a7c600/0xa81c4c9a2f3cb412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb40b expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.236739:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201381.236759:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3282:x1875064570103808:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201381.236765:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201381.238699:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570103808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201381.238714:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570103680:0@lo:103:ldlm_bl.0 00002000:00000080:2.0:1788201381.240753:0:17790:0:(ofd_obd.c:1269:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:2.0:1788201381.240798:0:17790:0:(ofd_obd.c:1283:ofd_iocontrol()) syncing ost lustre-OST0000 00010000:00010000:0.0:1788201381.241072:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201381.241081:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201381.241103:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962498ac2c00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:0.0:1788201381.241108:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201381.241135:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201381.241142:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201381.241148:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201381.241151:0:5814:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788201381.241153:0:5814:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788201381.241201:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201381.241208:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201381.241242:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201381.241250:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff962498ac2c00/0xa81c4c9a2f3cb435 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb43c expref: -99 pid: 16785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201381.241263:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201381.241265:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201381.241267:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201381.241463:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570103936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201381.241531:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201381.242006:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570103936 00000100:00100000:3.0:1788201381.242013:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570103936 00000100:00100000:3.0:1788201381.242069:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788201381.242078:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3284:x1875064570103936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201381.242100:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201381.242116:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624ba4dec00/0xa81c4c9a2f3cb43c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb435 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.242129:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201381.242216:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064570103936:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201381.242223:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201381.244704:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570103936:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788201381.270009:0:17790:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788201381.270027:0:17790:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff962492c03800 986744c8-ee81-4a47-8d91-97f81ede1f3e 192.168.201.56@tcp 5 (0 0 1) 0 0 0 0: 0000000000000000 21474836487 stale:0 00000020:00080000:1.0:1788201381.270035:0:17790:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff962492c00000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 21474836481 stale:0 00000020:00080000:1.0:1788201381.270040:0:17790:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9624909d99c0) has exports, disconnecting them 00000020:00080000:1.0:1788201381.270045:0:17790:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.201.56@tcp (ffff962492c03800), last request at 1788201380 00000020:00000080:1.0:1788201381.270059:0:17790:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb42e 00000020:00010000:1.0:1788201381.270068:0:17790:0:(genops.c:1942:obd_stale_export_put()) Put export ffff962492c03800: total 0 00000100:00080000:1.0:1788201381.270074:0:17790:0:(import.c:65:import_set_state_nolock()) ffff962382b0c800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201381.270215:0:17790:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.56@tcp (ffff962492c03800): rc 0 00000020:00080000:1.0:1788201381.270219:0:17790:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff962492c00000), last request at 1788201380 00000020:00000080:1.0:1788201381.270222:0:17790:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb427 00000100:00080000:1.0:1788201381.270228:0:17790:0:(import.c:65:import_set_state_nolock()) ffff9624857c5800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201381.270250:0:17790:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff962492c00000): rc 0 00000020:00000080:1.0:1788201381.270253:0:17790:0:(genops.c:906:class_export_put()) final put ffff962492c00000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:1.0:1788201381.270292:0:17790:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9624909d99c0) has no exports 00000020:00000080:0.0:1788201381.270311:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff962492c00000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788201381.270375:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9624857c5800 for lustre-OST0000 00010000:00010000:1.0:1788201381.270619:0:17790:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000cdfa1b37/0xa81c4c9a2f3cb51c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b0b expref: 2 pid: 8088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201381.270653:0:17790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdfa1b37/0xa81c4c9a2f3cb51c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b0b expref: 2 pid: 8088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1788201381.271036:0:5813:0:(genops.c:1928:obd_stale_export_get()) Get export ffff962492c03800: total 0 00010000:00010000:2.0:1788201381.271041:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201381.271080:0:5813:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff962492c03800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788201381.271161:0:5813:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff962492c03800, canceled 0 locks, left on hash table 0. 00000020:00000080:2.0:1788201381.271171:0:5813:0:(genops.c:906:class_export_put()) final put ffff962492c03800/986744c8-ee81-4a47-8d91-97f81ede1f3e 00010000:00010000:2.0:1788201381.271194:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201381.271196:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201381.271199:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201381.271287:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201381.271501:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff962492c03800/986744c8-ee81-4a47-8d91-97f81ede1f3e for lustre-OST0000 00000020:00000080:0.0:1788201381.271540:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff962382b0c800 for lustre-OST0000 00000020:01000000:0.0:1788201381.275820:0:17790:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff962487ec4780 - data ffff9624b3f36bd0/ffff9623835ed800 00000020:01000000:0.0:1788201381.275949:0:17790:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9624850c9900 - data ffff9624b3f52ca8/ffff9623838cd000 00100000:10000000:0.0:1788201381.284871:0:17790:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788201381.334062:0:17790:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb420 00000020:00000080:3.0:1788201381.334074:0:17790:0:(genops.c:906:class_export_put()) final put ffff962492c05800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788201381.334248:0:17790:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962487d4b000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788201381.334253:0:17790:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962487d4b000 2 00000020:01000004:3.0:1788201381.334256:0:17790:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff962487d4b000 from lustre-OST0000 00000020:00000080:3.0:1788201381.334334:0:17790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201381.334392:0:17790:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788201381.334396:0:17790:0:(genops.c:906:class_export_put()) final put ffff9624902d7000/lustre-OST0000_UUID 00000020:00000080:3.0:1788201381.334408:0:17790:0:(genops.c:865:class_export_destroy()) destroying export ffff9624902d7000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788201381.334416:0:17790:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788201381.334473:0:17790:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788201381.334477:0:17790:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788201381.334481:0:17790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201381.334486:0:17790:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788201381.334493:0:17790:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff962382b0d000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201381.334499:0:17790:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff962487fc0000) has exports, disconnecting them 00000020:00080000:3.0:1788201381.334505:0:17790:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff962382b0d000), last request at 1788201348 00000020:00000080:3.0:1788201381.334509:0:17790:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb458 00000020:00080000:3.0:1788201381.334518:0:17790:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff962382b0d000): rc 0 00000020:00000080:3.0:1788201381.334523:0:17790:0:(genops.c:906:class_export_put()) final put ffff962382b0d000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788201381.334730:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff962492c05800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788201381.336587:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff962382b0d000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788201381.340767:0:17790:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788201381.340779:0:17790:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201381.340785:0:17790:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788201381.340794:0:17790:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201381.340830:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff962382b0c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788201381.340963:0:17790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201381.340973:0:17790:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788201381.340978:0:17790:0:(genops.c:906:class_export_put()) final put ffff962382b0f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788201381.340982:0:17790:0:(genops.c:865:class_export_destroy()) destroying export ffff962382b0f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788201381.340987:0:17790:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788201381.341063:0:17790:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962487d4b000 1 00000020:00000080:2.0:1788201381.341069:0:17790:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb404 00000020:00000080:2.0:1788201381.341076:0:17790:0:(genops.c:906:class_export_put()) final put ffff962487d49800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788201381.341097:0:17790:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788201381.341104:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff962487d49800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788201381.341114:0:17790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201381.341119:0:17790:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201381.341123:0:17790:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff962487eb3380) has no exports 00000020:00000080:2.0:1788201381.363371:0:17790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201381.363392:0:17790:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788201381.363406:0:17790:0:(genops.c:906:class_export_put()) final put ffff962487d48000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788201381.363411:0:17790:0:(genops.c:865:class_export_destroy()) destroying export ffff962487d48000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788201381.363421:0:17790:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788201381.363575:0:17790:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff962487d4e800 00000020:02000400:2.0:1788201381.363632:0:17790:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788201381.691499:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201382.711865:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201383.734517:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201384.502688:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570104320:0@lo:400:kworker.0 00000100:00100000:2.0:1788201384.502762:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201384.502822:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201384.502827:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570104192:0@lo:400:kworker.0 00000100:00100000:2.0:1788201384.502854:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201384.503292:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570104064:0@lo:400:kworker.0 00000100:00100000:3.0:1788201384.503330:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201384.503410:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570104576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201384.503435:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201384.503455:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201384.503567:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570104064 00000100:00100000:1.0:1788201384.503576:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570104064 00000100:00100000:1.0:1788201384.503630:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1788201384.503639:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570104064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201384.503693:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570104064:12345-0@lo:400:kworker.0 Request processed in 54us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201384.503700:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1788201384.503756:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570104192 00000100:00100000:1.0:1788201384.503761:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570104192 00000100:00100000:1.0:1788201384.503787:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788201384.503794:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570104192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201384.503833:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570104192:12345-0@lo:400:kworker.0 Request processed in 40us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201384.503839:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788201384.503858:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570104320 00000100:00100000:1.0:1788201384.503861:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570104320 00000100:00100000:1.0:1788201384.503880:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570104576 00000100:00100000:1.0:1788201384.503882:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570104576 00000100:00100000:1.0:1788201384.503912:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788201384.503918:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570104576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201384.503948:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570104576:12345-0@lo:400:kworker.0 Request processed in 31us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201384.503954:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788201384.503965:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788201384.503969:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3283:x1875064570104320:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201384.503990:0:6671:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201384.504015:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3283:x1875064570104320:12345-0@lo:400:kworker.0 Request processed in 45us (1254us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201384.504022:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1788201384.504054:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201384.504087:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570104192:0@lo:400:kworker.0 00000100:00080000:1.0:1788201384.504098:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201384.504104:0:3283:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201384.504108:0:3283:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788201384.507795:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570104448:0@lo:400:kworker.0 00000100:00100000:3.0:1788201384.507896:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201384.507974:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570104064:0@lo:400:kworker.0 00010000:00080000:3.0:1788201384.507993:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624c1e5a300 x1875064570104576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201384.508005:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570104576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201384.508085:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570104448 00000100:00100000:3.0:1788201384.508093:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570104448 00000100:00100000:3.0:1788201384.508151:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788201384.508160:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570104448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201384.508211:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570104448:12345-0@lo:400:kworker.0 Request processed in 53us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201384.508218:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:3.0:1788201384.508243:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201384.508260:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570104448:0@lo:400:kworker.0 00000004:00080000:1.0:1788201384.519241:0:3283:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1788201384.519251:0:3283:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201384.519261:0:3283:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:1.0:1788201384.519272:0:3283:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201384.519313:0:3283:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624ba85b480 x1875064570104704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201384.519338:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570104320:0@lo:400:kworker.0 00000100:00100000:2.0:1788201384.521050:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570104704:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:2.0:1788201384.521144:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201384.521381:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570104704 00000100:00100000:1.0:1788201384.521390:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570104704 00000100:00100000:1.0:1788201384.521428:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788201384.521438:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875064570104704:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:1.0:1788201384.521461:0:6671:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201384.521510:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875064570104704:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 73us (367us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201384.521519:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1788201384.521949:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201384.521956:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201384.521960:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570104704:0@lo:8:ptlrpcd_00_01.0 00000001:00080000:0.0:1788201384.586918:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967375 is committed 00010000:00010000:0.0:1788201384.759256:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201385.526702:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201385.529405:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570104832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201385.529487:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201385.530240:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570104832 00000100:00100000:0.0:1788201385.530251:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570104832 00000100:00100000:0.0:1788201385.530305:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788201385.530314:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570104832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201385.530388:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201385.530452:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570104832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201385.530458:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00010000:00080000:2.0:1788201385.530682:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624b9d61f80 x1875064570104832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201385.530703:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570104832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201385.779412:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201385.779481:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201385.779521:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201385.779657:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559578368 00000100:00100000:3.0:1788201385.779667:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559578368 00000100:00100000:3.0:1788201385.779715:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 124 00000100:00100000:3.0:1788201385.779723:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2342:x1875064559578368:12345-192.168.201.56@tcp:400:kworker.0 00000020:00080000:3.0:1788201385.779739:0:6668:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.56@tcp 00000100:00100000:3.0:1788201385.779804:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2342:x1875064559578368:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 80us (322us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201385.779812:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 124 00000100:00100000:1.0:1788201385.780031:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201385.780050:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559578496 00000100:00100000:1.0:1788201385.780053:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559578496 00000100:00100000:1.0:1788201385.780090:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 161 00000100:00100000:1.0:1788201385.780096:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559578496:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201385.780130:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559578496:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201385.780136:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 161 00000100:00080000:1.0:1788201385.780151:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201385.780383:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559578112 00000100:00100000:2.0:1788201385.780387:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559578112 00000100:00100000:2.0:1788201385.780424:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 428 00000100:00100000:2.0:1788201385.780439:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559578112:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201385.780480:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559578112:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 43us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201385.780486:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 428 00000100:00100000:0.0:1788201385.780866:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559578240 00000100:00100000:0.0:1788201385.780871:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559578240 00000100:00100000:0.0:1788201385.780925:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 263 00000100:00080000:1.0:1788201385.780931:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201385.780933:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559578240:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201385.780982:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559578240:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 50us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201385.780989:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 263 00010000:00010000:2.0:1788201385.782693:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201385.799250:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201385.799434:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559578624 00000100:00100000:0.0:1788201385.799445:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559578624 00000100:00100000:0.0:1788201385.799497:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 125 00000100:00100000:0.0:1788201385.799505:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559578624:12345-192.168.201.56@tcp:8:ptlrpcd_00_01.0 00010000:00020000:0.0:1788201385.799528:0:6668:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201385.799600:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559578624:12345-192.168.201.56@tcp:8:ptlrpcd_00_01.0 Request processed in 95us (360us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201385.799608:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 125 00010000:00010000:3.0:1788201386.806512:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201387.830626:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201388.858399:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201389.622697:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201389.622704:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201389.622708:0:8:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201389.622719:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:0.0:1788201389.622725:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201389.622732:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788201389.622760:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624b9deb800 x1875064570105216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201389.622814:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570105088:0@lo:400:kworker.0 00000100:00100000:0.0:1788201389.622905:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201389.622990:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201389.622997:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570105344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201389.623022:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201389.623061:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570105216:0@lo:8:kworker.0 00000100:00100000:0.0:1788201389.623096:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201389.623144:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570105088 00000100:00100000:0.0:1788201389.623152:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570105088 00000100:00100000:0.0:1788201389.623196:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570105344 00000100:00100000:0.0:1788201389.623200:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570105344 00000100:00100000:0.0:1788201389.623233:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788201389.623243:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570105088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201389.623333:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570105088:12345-0@lo:400:kworker.0 Request processed in 92us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.623366:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788201389.623392:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788201389.623403:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570105344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201389.623445:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570105344:12345-0@lo:400:kworker.0 Request processed in 45us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.623458:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570105472:0@lo:400:kworker.0 00000100:00100000:2.0:1788201389.623497:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570104960:0@lo:400:kworker.0 00000100:00100000:1.0:1788201389.623505:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201389.623545:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.623601:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570105216 00000100:00100000:1.0:1788201389.623607:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570105216 00000100:00100000:1.0:1788201389.623630:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570105472 00000100:00100000:1.0:1788201389.623633:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570105472 00000100:00100000:1.0:1788201389.623659:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788201389.623667:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570105472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201389.623713:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570105472:12345-0@lo:400:kworker.0 Request processed in 47us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.623719:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788201389.623735:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788201389.623739:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875064570105216:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788201389.623757:0:6671:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201389.623793:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875064570105216:12345-0@lo:8:kworker.0 Request processed in 51us (696us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201389.623810:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570104960 00000100:00100000:2.0:1788201389.623815:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570104960 00000100:00100000:1.0:1788201389.623817:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788201389.623854:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1788201389.623862:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3283:x1875064570104960:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788201389.623869:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201389.623876:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201389.623881:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570105216:0@lo:8:kworker.0 00000100:00100000:2.0:1788201389.623904:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3283:x1875064570104960:12345-0@lo:400:kworker.0 Request processed in 42us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201389.623912:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00010000:00080000:1.0:1788201389.623921:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624b9c41500 x1875064570105472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201389.623934:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570105472:0@lo:400:kworker.0 00000100:00080000:2.0:1788201389.623946:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201389.623952:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201389.623985:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570104960:0@lo:400:kworker.0 00000100:00100000:1.0:1788201389.624004:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570105344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201389.624016:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570105088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201389.625964:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00010000:3.0:1788201389.879122:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201390.647301:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201390.647327:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570105600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201390.647436:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.647692:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570105600 00000100:00100000:0.0:1788201390.647713:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570105600 00000100:00100000:0.0:1788201390.647781:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788201390.647791:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570105600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201390.647836:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201390.647892:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570105600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201390.647899:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00080000:1.0:1788201390.648071:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624ba43ce00 x1875064570105600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201390.648091:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570105600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201390.902860:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201390.903899:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201390.903944:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201390.903977:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201390.904387:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201390.904423:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559578880 00000100:00100000:1.0:1788201390.904433:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559578880 00000100:00100000:1.0:1788201390.904511:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 266 00000100:00100000:1.0:1788201390.904522:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559578880:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201390.904611:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559578880:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 91us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201390.904620:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 266 00000100:00080000:2.0:1788201390.904838:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201390.904853:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559579008 00000100:00100000:2.0:1788201390.904857:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559579008 00000100:00100000:2.0:1788201390.904883:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559579136 00000100:00100000:2.0:1788201390.904887:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559579136 00000100:00100000:2.0:1788201390.904919:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 127 00000100:00100000:2.0:1788201390.904925:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875064559579008:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:2.0:1788201390.904945:0:6671:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201390.904982:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875064559579008:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 56us (1037us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201390.905001:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 127 00000100:00100000:2.0:1788201390.905178:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 128 00000100:00100000:2.0:1788201390.905188:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559579136:12345-192.168.201.56@tcp:9:kworker.0 00000020:00000080:2.0:1788201390.905210:0:6671:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb49e 00000100:00080000:2.0:1788201390.905219:0:6671:0:(import.c:65:import_set_state_nolock()) ffff9623824b7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201390.905268:0:6671:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788201390.905619:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+2:2340:x1875064559579136:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 433us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201390.905627:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 128 00010000:00010000:2.0:1788201390.905650:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201390.905657:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201390.905980:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559578752 00000100:00100000:3.0:1788201390.905986:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559578752 00000100:00100000:3.0:1788201390.906043:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 430 00000100:00100000:3.0:1788201390.906052:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559578752:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201390.906084:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559578752:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 34us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201390.906091:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 430 00010000:00010000:3.0:1788201391.926658:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201392.950764:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201393.846686:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:3.0:1788201393.846696:0:7629:0:(genops.c:906:class_export_put()) final put ffff9623824b2800/986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:1.0:1788201393.846781:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9623824b2800/986744c8-ee81-4a47-8d91-97f81ede1f3e for lustre-OST0001 00000020:00000080:1.0:1788201393.847032:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9623824b7800 for lustre-OST0001 00010000:00010000:2.0:1788201393.979273:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201394.742526:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1788201394.742527:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570105728:0@lo:400:kworker.0 00000100:00080000:2.0:1788201394.742535:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201394.742540:0:8:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201394.742547:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:2.0:1788201394.742552:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788201394.742561:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:2.0:1788201394.742587:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624c1e58700 x1875064570105984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201394.742615:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201394.742654:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570105984:0@lo:8:kworker.0 00000100:00100000:0.0:1788201394.742692:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201394.742698:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201394.742703:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570105856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201394.742736:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570106112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201394.742738:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201394.742773:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570105728 00000100:00100000:0.0:1788201394.742781:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570105728 00000100:00100000:0.0:1788201394.742828:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1788201394.742837:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064570105728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201394.742887:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064570105728:12345-0@lo:400:kworker.0 Request processed in 51us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201394.742895:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1788201394.742929:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570105856 00000100:00100000:0.0:1788201394.742933:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570105856 00000100:00100000:3.0:1788201394.743058:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570106240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201394.743090:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201394.743130:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570105984 00000100:00100000:3.0:1788201394.743134:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570105984 00000100:00100000:3.0:1788201394.743183:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570106240 00000100:00100000:3.0:1788201394.743186:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570106240 00000100:00100000:3.0:1788201394.743218:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788201394.743225:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570106240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201394.743262:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570106240:12345-0@lo:400:kworker.0 Request processed in 38us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201394.743268:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788201394.743284:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788201394.743288:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1d5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875064570105984:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788201394.743305:0:6671:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201394.744331:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788201394.744356:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570105856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201394.744409:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570105856:12345-0@lo:400:kworker.0 Request processed in 70us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201394.744428:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788201394.745401:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201394.754286:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201394.754757:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570106112 00000100:00100000:1.0:1788201394.754769:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570106112 00000100:00100000:1.0:1788201394.754843:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788201394.754855:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570106112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201394.755801:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570105856:0@lo:400:kworker.0 00000100:00100000:0.0:1788201394.755815:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570105728:0@lo:400:kworker.0 00000100:00080000:2.0:1788201394.756365:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788201394.756422:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624c1e59880 x1875064570106240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201394.756435:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570106240:0@lo:400:kworker.0 00000100:00100000:1.0:1788201394.762472:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570106112:12345-0@lo:400:kworker.0 Request processed in 7608us (17061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201394.762490:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788201394.762521:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570106112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201394.764597:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1d5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875064570105984:12345-0@lo:8:kworker.0 Request processed in 21296us (21890us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201394.764612:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1788201394.764944:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201394.765121:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201394.765126:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570105984:0@lo:8:kworker.0 00010000:00010000:3.0:1788201395.007538:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201395.771306:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570106368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201395.771397:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201395.771470:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570106368 00000100:00100000:1.0:1788201395.771477:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570106368 00000100:00100000:1.0:1788201395.771518:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788201395.771527:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570106368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201395.771564:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201395.771606:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570106368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201395.771612:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00010000:00080000:1.0:1788201395.771653:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624b9deb800 x1875064570106368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201395.771671:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570106368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201396.022119:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201396.022255:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559579264 00000100:00100000:2.0:1788201396.022266:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559579264 00000100:00100000:2.0:1788201396.022316:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 432 00000100:00100000:2.0:1788201396.022326:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559579264:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201396.022425:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559579264:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 100us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201396.022432:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 432 00010000:00010000:2.0:1788201396.024280:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201396.038332:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201396.038412:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201396.038638:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559579392 00000100:00100000:0.0:1788201396.038649:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559579392 00000100:00100000:0.0:1788201396.038712:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 269 00000100:00100000:0.0:1788201396.038724:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559579392:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201396.038797:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559579392:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 75us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201396.038805:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 269 00000100:00100000:1.0:1788201396.038892:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559579520 00000100:00100000:1.0:1788201396.038897:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559579520 00000100:00100000:1.0:1788201396.038924:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00100000:1.0:1788201396.038943:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875064559579520:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:1.0:1788201396.038961:0:6670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201396.038989:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875064559579520:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 47us (578us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201396.038996:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00080000:3.0:1788201396.039426:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201397.052969:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201398.074215:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788201399.086591:0:18232:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788201399.086595:0:18232:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788201399.086700:0:18232:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9624857c4800 00000020:01000004:0.0:1788201399.086715:0:18232:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788201399.086729:0:18232:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788201399.086745:0:18232:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96248729cd40) 00000020:00000080:0.0:1788201399.086761:0:18232:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1788201399.099727:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788201399.322202:0:18232:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788201399.339187:0:18232:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788201399.355233:0:18232:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788201399.367853:0:18232:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788201399.380545:0:18232:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xe:0x0] (8/32) 00100000:10000000:2.0:1788201399.391790:0:18232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 529: rc = 0 00100000:10000000:2.0:1788201399.393687:0:18232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:2.0:1788201399.393804:0:18232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 529: rc = 0 00100000:10000000:3.0:1788201399.409185:0:18232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 377: rc = 0 00100000:10000000:1.0:1788201399.419964:0:18232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 377: rc = 0 00100000:10000000:3.0:1788201399.421244:0:18232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 377: rc = 0 00100000:10000000:3.0:1788201399.428765:0:18232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 377: rc = 0 00100000:10000000:1.0:1788201399.435502:0:18232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 377: rc = 0 00100000:10000000:3.0:1788201399.439246:0:18232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 377: rc = 0 00000020:00000080:1.0:1788201399.442133:0:18232:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788201399.442144:0:18232:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788201399.442156:0:18232:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3cb52a 00000020:01000004:1.0:1788201399.442165:0:18232:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788201399.442187:0:18232:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.156@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788201399.442190:0:18232:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788201399.442196:0:18232:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788201399.442217:0:18232:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788201399.442221:0:18232:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788201399.478069:0:18232:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788201399.478120:0:18232:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.156@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788201399.478125:0:18232:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788201399.478130:0:18232:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201399.478131:0:18232:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201399.478132:0:18232:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201399.478134:0:18232:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201399.478135:0:18232:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201399.478136:0:18232:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201399.478138:0:18232:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201399.478139:0:18232:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201399.478142:0:18232:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788201399.478145:0:18232:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201399.478146:0:18232:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201399.478147:0:18232:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201399.478148:0:18232:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201399.478149:0:18232:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201399.478150:0:18232:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201399.478151:0:18232:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201399.478152:0:18232:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201399.478153:0:18232:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201399.478178:0:18232:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788201399.478197:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570106496:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201399.478271:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201399.478431:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201399.478468:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570106496 00000100:00100000:0.0:1788201399.478476:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570106496 00000100:00100000:0.0:1788201399.478580:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1788201399.478590:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:18232:x1875064570106496:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201399.478627:0:5819:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788201399.478630:0:5819:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788201399.478633:0:5819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788201399.483675:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:18232:x1875064570106496:12345-0@lo:253:mount.lustre.0 Request processed in 5076us (5393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201399.483690:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1788201399.483775:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570106496:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201399.483791:0:18232:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788201399.483794:0:18232:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201399.483796:0:18232:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201399.483797:0:18232:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201399.483798:0:18232:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201399.483799:0:18232:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201399.483801:0:18232:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201399.483802:0:18232:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201399.483804:0:18232:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201399.483806:0:18232:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201399.483825:0:18232:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9624857c4800 from lustre-OST0000 10000000:01000000:3.0:1788201399.483849:0:18232:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788201399.483852:0:18232:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788201399.483859:0:18232:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962485b40000 local copy 00010000:00010000:3.0:1788201399.483988:0:18232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201399.484196:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570106624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201399.484231:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201399.484310:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201399.487029:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570106624 00000100:00100000:2.0:1788201399.487046:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570106624 00000100:00100000:2.0:1788201399.487183:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1788201399.487194:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:18232:x1875064570106624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201399.487578:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:18232:x1875064570106624:12345-0@lo:501:mount.lustre.0 Request processed in 385us (3345us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201399.487586:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1788201399.487715:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570106624:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788201399.487737:0:18232:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788201399.487885:0:18232:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788201399.487894:0:18232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.487904:0:18232:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201399.487943:0:18232:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9624857c4800 10000000:01000000:0.0:1788201399.487948:0:18232:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788201399.487953:0:18232:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788201399.487955:0:18232:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201399.487959:0:18232:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788201399.487961:0:18232:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201399.487990:0:18232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.487998:0:18232:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.488008:0:18232:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201399.488032:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570106752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201399.488066:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201399.488367:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1eb3000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201399.488476:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570106752 00000100:00100000:1.0:1788201399.488481:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570106752 00000100:00100000:1.0:1788201399.488504:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1788201399.488510:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:18232:x1875064570106752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201399.488520:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201399.488531:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96248e27f800/0xa81c4c9a2f3cb538 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb531 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201399.488561:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96248e27f800/0xa81c4c9a2f3cb538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb531 expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201399.488571:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96248e27f800/0xa81c4c9a2f3cb538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb531 expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201399.488580:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96248e27f800, rc 0) 00000100:00100000:1.0:1788201399.488618:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:18232:x1875064570106752:12345-0@lo:101:mount.lustre.0 Request processed in 108us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.488624:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1788201399.488692:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570106752:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201399.488704:0:18232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.488712:0:18232:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201399.492194:0:18232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 14 count 14 00000040:00080000:2.0:1788201399.493276:0:18232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201399.493592:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:2.0:1788201399.493636:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 128 off8544 00000040:00080000:2.0:1788201399.493667:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 112 off8656 00000040:00080000:2.0:1788201399.493712:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8880 00000040:00080000:2.0:1788201399.493750:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 224 off9104 00000040:00080000:2.0:1788201399.493785:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 80 off9184 00000040:00080000:2.0:1788201399.493834:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9408 00000040:00080000:2.0:1788201399.494180:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 224 off9632 00000040:00080000:2.0:1788201399.494223:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 80 off9712 00000040:00080000:2.0:1788201399.494269:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off9936 00000040:00080000:2.0:1788201399.494300:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 224 off10160 00000040:00080000:2.0:1788201399.494472:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 120 off10280 00000040:00080000:2.0:1788201399.494534:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].13, 224 off10504 00000040:00080000:2.0:1788201399.494541:0:18232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 13 count 14 00000100:00100000:2.0:1788201399.494625:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570106880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201399.494688:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201399.494767:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9d09300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201399.494805:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570106880 00000100:00100000:1.0:1788201399.494813:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570106880 00000100:00100000:1.0:1788201399.494861:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1788201399.495035:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:18232:x1875064570106880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201399.495261:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:18232:x1875064570106880:12345-0@lo:501:mount.lustre.0 Request processed in 391us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.495269:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1788201399.495372:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570106880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201399.495405:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201399.495444:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201399.495517:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9d09300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201399.495550:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570107008 00000100:00100000:0.0:1788201399.495555:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570107008 00000100:00100000:0.0:1788201399.495587:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1788201399.495594:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:18232:x1875064570107008:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201399.496035:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:18232:x1875064570107008:12345-0@lo:503:mount.lustre.0 Request processed in 440us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201399.496042:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1788201399.496129:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107008:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788201399.496685:0:18232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201399.496749:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201399.496791:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201399.496823:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9d09300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201399.496996:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570107136 00000100:00100000:1.0:1788201399.497002:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570107136 00000100:00100000:1.0:1788201399.497067:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1788201399.497075:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:18232:x1875064570107136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201399.497257:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:18232:x1875064570107136:12345-0@lo:502:mount.lustre.0 Request processed in 182us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.497264:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1788201399.497326:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201399.497541:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:2.0:1788201399.497587:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 128 off8544 00000040:00080000:2.0:1788201399.497621:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 112 off8656 00000040:00080000:2.0:1788201399.497671:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8880 00000040:00080000:2.0:1788201399.497708:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 224 off9104 00000040:00080000:2.0:1788201399.497739:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 80 off9184 00000040:00080000:2.0:1788201399.497777:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9408 00000040:00080000:2.0:1788201399.497804:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 224 off9632 00000040:00080000:2.0:1788201399.497829:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 80 off9712 00000040:00080000:2.0:1788201399.497878:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off9936 00000040:00080000:2.0:1788201399.497910:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 224 off10160 00000040:00080000:2.0:1788201399.498020:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 120 off10280 00000100:00100000:2.0:1788201399.498044:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201399.498094:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201399.498336:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9d09300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201399.498486:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570107264 00000100:00100000:3.0:1788201399.498492:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570107264 00000100:00100000:3.0:1788201399.498521:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1788201399.498530:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:18232:x1875064570107264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201399.498697:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:18232:x1875064570107264:12345-0@lo:502:mount.lustre.0 Request processed in 168us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201399.498704:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1788201399.501120:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201399.501267:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].13, 224 off10504 00000040:00080000:2.0:1788201399.501281:0:18232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788201399.502390:0:18233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201399.502400:0:18233:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788201399.502406:0:18233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201399.502409:0:18233:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788201399.502414:0:18233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201399.502434:0:18233:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff962487eb3380) 00000020:00000080:2.0:1788201399.502457:0:18233:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788201399.502463:0:18233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788201399.502518:0:18233:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9624857c4800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788201399.502526:0:18233:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788201399.502533:0:18233:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3cb546 00010000:00010000:2.0:1788201399.507737:0:18233:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00080000:3.0:1788201399.513549:0:18233:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 21474836481 srv lr: 21474836480 lx: 1875064570102016 gen 0 00000001:00080000:3.0:1788201399.513621:0:18233:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: 986744c8-ee81-4a47-8d91-97f81ede1f3e idx: 1 lr: 21474836487 srv lr: 21474836480 lx: 1875064559575808 gen 0 00000001:00000004:3.0:1788201399.513640:0:18233:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 21474836487 00080000:10000000:3.0:1788201399.524153:0:18233:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00000020:00000080:2.0:1788201399.526873:0:18233:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788201399.526885:0:18233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201399.526892:0:18233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201399.526894:0:18233:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788201399.526898:0:18233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201399.526900:0:18233:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788201399.526902:0:18233:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201399.526903:0:18233:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201399.526904:0:18233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201399.526906:0:18233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201399.526908:0:18233:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201399.526910:0:18233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201399.526981:0:18233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201399.526983:0:18233:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201399.526987:0:18233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201399.526989:0:18233:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788201399.526991:0:18233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201399.526994:0:18233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201399.526995:0:18233:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788201399.526997:0:18233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201399.526999:0:18233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201399.527000:0:18233:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788201399.527003:0:18233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788201399.527055:0:18233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201399.527057:0:18233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201399.527058:0:18233:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788201399.527061:0:18233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000020:01000000:0.0:1788201399.528725:0:18232:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788201399.528763:0:18232:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788201399.528789:0:18232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.528802:0:18232:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201399.528810:0:18232:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9624857c4800 from 1 10000000:01000000:0.0:1788201399.528820:0:18232:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201399.529051:0:18232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.529060:0:18232:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.529072:0:18232:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201399.534843:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201399.534927:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201399.534977:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1eb39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201399.536472:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570107392 00000100:00100000:1.0:1788201399.536483:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570107392 00000100:00100000:1.0:1788201399.536549:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:1.0:1788201399.536557:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:18232:x1875064570107392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201399.536572:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201399.536589:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96248e27e200/0xa81c4c9a2f3cb562 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb55b expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201399.536615:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96248e27e200/0xa81c4c9a2f3cb562 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb55b expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201399.536626:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96248e27e200/0xa81c4c9a2f3cb562 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb55b expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201399.536635:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96248e27e200, rc 0) 00000100:00100000:1.0:1788201399.536690:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:18232:x1875064570107392:12345-0@lo:101:mount.lustre.0 Request processed in 134us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.536697:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1788201399.536793:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201399.536811:0:18232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201399.536820:0:18232:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201399.549569:0:18232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 7 count 7 00000040:00080000:3.0:1788201399.550012:0:18232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201399.550266:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:3.0:1788201399.550508:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 112 off8528 00000040:00080000:3.0:1788201399.550563:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 224 off8752 00000040:00080000:3.0:1788201399.550604:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8976 00000040:00080000:3.0:1788201399.550640:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 112 off9088 00000040:00080000:3.0:1788201399.550707:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 224 off9312 00000040:00080000:3.0:1788201399.550716:0:18232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 6 count 7 00000100:00100000:3.0:1788201399.550794:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201399.550858:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201399.550905:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201399.552006:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570107520 00000100:00100000:1.0:1788201399.552016:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570107520 00000100:00100000:1.0:1788201399.552071:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1788201399.552090:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:18232:x1875064570107520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201399.552367:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:18232:x1875064570107520:12345-0@lo:501:mount.lustre.0 Request processed in 287us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.552375:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1788201399.553881:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201399.553935:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201399.553996:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201399.554037:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201399.554484:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570107648 00000100:00100000:1.0:1788201399.554492:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570107648 00000100:00100000:1.0:1788201399.554547:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1788201399.554557:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:18232:x1875064570107648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201399.555512:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:18232:x1875064570107648:12345-0@lo:503:mount.lustre.0 Request processed in 953us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.555529:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1788201399.555632:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107648:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201399.556253:0:18232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201399.557057:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201399.557136:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201399.557488:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201399.557645:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570107776 00000100:00100000:1.0:1788201399.557653:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570107776 00000100:00100000:1.0:1788201399.557737:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1788201399.557747:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:18232:x1875064570107776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201399.558103:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:18232:x1875064570107776:12345-0@lo:502:mount.lustre.0 Request processed in 357us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.558115:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1788201399.558177:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201399.558538:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:0.0:1788201399.558575:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 112 off8528 00000040:00080000:0.0:1788201399.558600:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 224 off8752 00000040:00080000:0.0:1788201399.558619:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8976 00000040:00080000:0.0:1788201399.558636:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 112 off9088 00000100:00100000:0.0:1788201399.558658:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201399.558690:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201399.558741:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1eb3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201399.558766:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570107904 00000100:00100000:1.0:1788201399.558769:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570107904 00000100:00100000:1.0:1788201399.558794:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1788201399.558802:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:18232:x1875064570107904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201399.559003:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:18232:x1875064570107904:12345-0@lo:502:mount.lustre.0 Request processed in 202us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.559008:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1788201399.559051:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570107904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201399.559117:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 224 off9312 00000040:00080000:0.0:1788201399.559125:0:18232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1788201399.559851:0:18237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201399.559859:0:18237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201399.559860:0:18237:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201399.559865:0:18237:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624857c4800 00000020:00000080:3.0:1788201399.559868:0:18237:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201399.559874:0:18237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201399.559877:0:18237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201399.559878:0:18237:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201399.559880:0:18237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201399.559882:0:18237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201399.559889:0:18237:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201399.559893:0:18237:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624857c4800 00000020:00000080:3.0:1788201399.559895:0:18237:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201399.559994:0:18237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201399.559997:0:18237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201399.559998:0:18237:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788201399.560000:0:18237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 7 count 7 00000020:01000000:0.0:1788201399.560044:0:18232:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788201399.560063:0:18232:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201399.560079:0:18232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.560114:0:18232:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201399.560153:0:18232:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788201399.560156:0:18232:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9624857c4800 10000000:01000000:0.0:1788201399.560159:0:18232:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9624857c4800 10000000:01000000:0.0:1788201399.560162:0:18232:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201399.560167:0:18232:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9624857c4800 from 1 10000000:01000000:0.0:1788201399.560170:0:18232:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201399.560196:0:18232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.560203:0:18232:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.560211:0:18232:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201399.560227:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570108032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201399.560263:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201399.560405:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1eb3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201399.563251:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570108032 00000100:00100000:1.0:1788201399.563266:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570108032 00000100:00100000:1.0:1788201399.563398:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1788201399.563409:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:18232:x1875064570108032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201399.563427:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201399.563446:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96248e27ea00/0xa81c4c9a2f3cb570 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb569 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201399.563473:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96248e27ea00/0xa81c4c9a2f3cb570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb569 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201399.563485:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96248e27ea00/0xa81c4c9a2f3cb570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb569 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201399.563501:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96248e27ea00, rc 0) 00000100:00100000:1.0:1788201399.563580:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:18232:x1875064570108032:12345-0@lo:101:mount.lustre.0 Request processed in 172us (3315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.563588:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1788201399.563688:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570108032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201399.563713:0:18232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201399.563722:0:18232:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201399.575798:0:18232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000040:00080000:3.0:1788201399.576360:0:18232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201399.576633:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:3.0:1788201399.576676:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 120 off8536 00000040:00080000:3.0:1788201399.576709:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 168 off8704 00000040:00080000:3.0:1788201399.576757:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8928 00000040:00080000:3.0:1788201399.576795:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 224 off9152 00000040:00080000:3.0:1788201399.576844:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 120 off9272 00000040:00080000:3.0:1788201399.576987:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 168 off9440 00000040:00080000:3.0:1788201399.577026:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 224 off9664 00000040:00080000:3.0:1788201399.577076:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:3.0:1788201399.577128:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 120 off10008 00000040:00080000:3.0:1788201399.577164:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 224 off10232 00000040:00080000:3.0:1788201399.577215:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10456 00000040:00080000:3.0:1788201399.577253:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].13, 88 off10544 00000040:00080000:3.0:1788201399.577287:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].14, 128 off10672 00000040:00080000:3.0:1788201399.577335:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].15, 144 off10816 00000040:00080000:3.0:1788201399.577395:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].16, 160 off10976 00000040:00080000:3.0:1788201399.577428:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].17, 224 off11200 00000040:00080000:3.0:1788201399.577476:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].18, 224 off11424 00000040:00080000:3.0:1788201399.577512:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].19, 80 off11504 00000040:00080000:3.0:1788201399.577546:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].20, 224 off11728 00000040:00080000:3.0:1788201399.577614:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].21, 224 off11952 00000040:00080000:3.0:1788201399.577654:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].22, 88 off12040 00000040:00080000:3.0:1788201399.577686:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].23, 128 off12168 00000040:00080000:3.0:1788201399.577733:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].24, 144 off12312 00000040:00080000:3.0:1788201399.577781:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].25, 128 off12440 00000040:00080000:3.0:1788201399.577815:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].26, 224 off12664 00000040:00080000:3.0:1788201399.577862:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].27, 224 off12888 00000040:00080000:3.0:1788201399.578166:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].28, 80 off12968 00000040:00080000:3.0:1788201399.578194:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].29, 224 off13192 00000040:00080000:3.0:1788201399.578234:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].30, 224 off13416 00000040:00080000:3.0:1788201399.578261:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].31, 88 off13504 00000040:00080000:3.0:1788201399.578288:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].32, 128 off13632 00000040:00080000:3.0:1788201399.578319:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].33, 144 off13776 00000040:00080000:3.0:1788201399.582289:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].34, 128 off13904 00000040:00080000:3.0:1788201399.582512:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].35, 224 off14128 00000040:00080000:3.0:1788201399.583628:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].36, 224 off14352 00000040:00080000:3.0:1788201399.583703:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].37, 80 off14432 00000040:00080000:3.0:1788201399.583743:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].38, 224 off14656 00000040:00080000:3.0:1788201399.583799:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].39, 224 off14880 00000040:00080000:3.0:1788201399.583837:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].40, 120 off15000 00000040:00080000:3.0:1788201399.584457:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].41, 224 off15224 00000040:00080000:3.0:1788201399.584467:0:18232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 41 count 42 00000100:00100000:3.0:1788201399.584695:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570108160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201399.584761:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201399.584816:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201399.584991:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570108160 00000100:00100000:0.0:1788201399.584999:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570108160 00000100:00100000:0.0:1788201399.585051:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1788201399.585062:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:18232:x1875064570108160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201399.585367:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:18232:x1875064570108160:12345-0@lo:501:mount.lustre.0 Request processed in 279us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201399.585376:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1788201399.585527:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570108160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201399.585559:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570108288:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201399.585982:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201399.587232:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201399.587324:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570108288 00000100:00100000:1.0:1788201399.587333:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570108288 00000100:00100000:1.0:1788201399.587401:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:1.0:1788201399.587411:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:18232:x1875064570108288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201399.587767:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:18232:x1875064570108288:12345-0@lo:503:mount.lustre.0 Request processed in 357us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.587775:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1788201399.588004:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570108288:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201399.588588:0:18232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201399.588666:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570108416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201399.588729:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201399.588760:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201399.588901:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570108416 00000100:00100000:1.0:1788201399.588906:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570108416 00000100:00100000:1.0:1788201399.588948:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1788201399.588957:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:18232:x1875064570108416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201399.589234:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:18232:x1875064570108416:12345-0@lo:502:mount.lustre.0 Request processed in 278us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.589241:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1788201399.589521:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570108416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201399.589940:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:3.0:1788201399.589993:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 120 off8536 00000040:00080000:3.0:1788201399.590028:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 168 off8704 00000040:00080000:3.0:1788201399.590076:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8928 00000040:00080000:3.0:1788201399.590130:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 224 off9152 00000040:00080000:3.0:1788201399.590180:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 120 off9272 00000040:00080000:3.0:1788201399.590318:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 168 off9440 00000040:00080000:3.0:1788201399.590535:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 224 off9664 00000040:00080000:3.0:1788201399.590658:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:3.0:1788201399.590694:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 120 off10008 00000040:00080000:3.0:1788201399.590722:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 224 off10232 00000040:00080000:3.0:1788201399.590761:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10456 00000040:00080000:3.0:1788201399.590792:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].13, 88 off10544 00000040:00080000:3.0:1788201399.590821:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].14, 128 off10672 00000040:00080000:3.0:1788201399.590861:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].15, 144 off10816 00000040:00080000:3.0:1788201399.591144:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].16, 160 off10976 00000040:00080000:3.0:1788201399.591174:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].17, 224 off11200 00000040:00080000:3.0:1788201399.591230:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].18, 224 off11424 00000040:00080000:3.0:1788201399.591266:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].19, 80 off11504 00000040:00080000:3.0:1788201399.591297:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].20, 224 off11728 00000040:00080000:3.0:1788201399.591369:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].21, 224 off11952 00000040:00080000:3.0:1788201399.591402:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].22, 88 off12040 00000040:00080000:3.0:1788201399.591429:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].23, 128 off12168 00000040:00080000:3.0:1788201399.591470:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].24, 144 off12312 00000040:00080000:3.0:1788201399.591502:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].25, 128 off12440 00000040:00080000:3.0:1788201399.591530:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].26, 224 off12664 00000040:00080000:3.0:1788201399.591601:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].27, 224 off12888 00000040:00080000:3.0:1788201399.591638:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].28, 80 off12968 00000040:00080000:3.0:1788201399.591681:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].29, 224 off13192 00000040:00080000:3.0:1788201399.591725:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].30, 224 off13416 00000040:00080000:3.0:1788201399.591759:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].31, 88 off13504 00000040:00080000:3.0:1788201399.591790:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].32, 128 off13632 00000040:00080000:3.0:1788201399.591822:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].33, 144 off13776 00000040:00080000:3.0:1788201399.592123:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].34, 128 off13904 00000040:00080000:3.0:1788201399.592167:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].35, 224 off14128 00000040:00080000:3.0:1788201399.592280:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].36, 224 off14352 00000040:00080000:3.0:1788201399.592322:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].37, 80 off14432 00000040:00080000:3.0:1788201399.592550:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].38, 224 off14656 00000040:00080000:3.0:1788201399.592944:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].39, 224 off14880 00000040:00080000:3.0:1788201399.592982:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].40, 120 off15000 00000100:00100000:3.0:1788201399.593032:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570108544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201399.593128:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201399.593233:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba45b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201399.594498:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570108544 00000100:00100000:1.0:1788201399.594508:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570108544 00000100:00100000:1.0:1788201399.594599:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1788201399.594611:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:18232:x1875064570108544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201399.594878:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:18232:x1875064570108544:12345-0@lo:502:mount.lustre.0 Request processed in 269us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.594886:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1788201399.595052:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe6bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570108544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201399.595163:0:18232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].41, 224 off15224 00000040:00080000:0.0:1788201399.595178:0:18232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788201399.600541:0:18240:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788201399.600557:0:18240:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9624909d99c0) 00000020:00000080:3.0:1788201399.600652:0:18240:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788201399.600854:0:18240:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9624857c4800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788201399.600859:0:18240:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9624857c4800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788201399.600862:0:18240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624857c4800 3 00010000:00080000:3.0:1788201399.600956:0:18240:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9624bc8f1800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.156@tcp at head 00010000:00010000:3.0:1788201399.605666:0:18240:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788201399.605783:0:18240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788201399.605820:0:18240:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201399.605834:0:18240:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa81c4c9a2f3cb57e 00000100:00080000:3.0:1788201399.605844:0:18240:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201399.605850:0:18240:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9624bc8f1800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1788201399.605995:0:18240:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624bfe69500 x1875064570108672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201399.606078:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570108672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201399.606159:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201399.606257:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570108672 00000100:00100000:1.0:1788201399.606264:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570108672 00000100:00100000:1.0:1788201399.606299:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201399.606307:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875064570108672:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788201399.606331:0:5825:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:1.0:1788201399.606382:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa81c4c9a2f3cb585 00000004:00100000:1.0:1788201399.606396:0:5825:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201399.606424:0:5825:0:(import.c:65:import_set_state_nolock()) ffff962382b0c000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788201399.607868:0:18240:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201399.608275:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201399.608280:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201399.608283:0:8:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201399.608291:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:2.0:1788201399.608296:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788201399.608303:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:2.0:1788201399.608324:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624c1e59880 x1875064570108928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201399.608801:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570108928:0@lo:8:kworker.0 00000100:00100000:3.0:1788201399.608960:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570108800:0@lo:400:kworker.0 00000100:00100000:3.0:1788201399.608998:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201399.609147:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201399.609213:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570108928 00000100:00100000:3.0:1788201399.609230:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570108928 00000100:00100000:3.0:1788201399.609262:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788201399.609269:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875064570108928:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788201399.609324:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875064570108928:12345-0@lo:8:kworker.0 Request processed in 53us (457us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788201399.609330:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788201399.609519:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875064570108672:12345-0@lo:38:llog_process_th.0 Request processed in 3210us (3357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.609528:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201399.609547:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570108800 00000100:00100000:1.0:1788201399.609551:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570108800 00000100:00100000:1.0:1788201399.609596:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788201399.609603:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570108800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201399.609647:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570108800:12345-0@lo:400:kworker.0 Request processed in 44us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.609653:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788201399.609698:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570108800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201399.612512:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201399.612529:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788201399.612539:0:3281:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788201399.612545:0:3281:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788201399.612549:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9624bc8f1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201399.612560:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570108672:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788201399.612987:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201399.612993:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788201399.612996:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570108928:0@lo:8:kworker.0 00000100:00100000:2.0:1788201399.613304:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570109056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201399.613383:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201399.613437:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570109056 00000100:00100000:2.0:1788201399.613443:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570109056 00000100:00100000:2.0:1788201399.613495:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788201399.613504:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570109056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201399.613552:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570109056:12345-0@lo:400:kworker.0 Request processed in 49us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201399.613558:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1788201399.613651:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201399.613676:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570109056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201399.613711:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570109184:0@lo:400:kworker.0 00000100:00100000:2.0:1788201399.613747:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201399.613781:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570109184 00000100:00100000:2.0:1788201399.613785:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570109184 00000100:00100000:2.0:1788201399.613817:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788201399.613824:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570109184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201399.613858:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570109184:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201399.613981:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1788201399.613998:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788201399.614018:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624c1e58a80 x1875064570109184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201399.614029:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570109184:0@lo:400:kworker.0 00000040:00080000:2.0:1788201399.614853:0:18240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000020:01000000:1.0:1788201399.615148:0:18232:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788201399.615172:0:18232:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201399.615193:0:18232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201399.615204:0:18232:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201399.615329:0:18232:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201399.615331:0:18232:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201399.615333:0:18232:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201399.615334:0:18232:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201399.615335:0:18232:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201399.615336:0:18232:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201399.615338:0:18232:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201399.615402:0:18232:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201399.615404:0:18232:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201399.615408:0:18232:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788201399.615411:0:18232:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201399.615412:0:18232:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201399.615413:0:18232:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201399.615415:0:18232:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201399.615416:0:18232:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201399.615417:0:18232:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201399.615418:0:18232:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201399.615419:0:18232:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201399.615420:0:18232:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201399.615440:0:18232:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788201399.615456:0:18232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9deb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570109312:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201399.615506:0:18232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201399.615850:0:18232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c7ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201399.618641:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570109312 00000100:00100000:0.0:1788201399.618654:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570109312 00000100:00100000:0.0:1788201399.618747:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1788201399.618767:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:18232:x1875064570109312:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201399.618803:0:5820:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788201399.618850:0:5820:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788201399.652437:0:5820:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201399.652460:0:5820:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788201399.652532:0:5841:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201399.652538:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201399.652570:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201399.652591:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962498ac2800/0xa81c4c9a2f3cb46d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99ae1 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201399.652601:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624b9a7c400/0xa81c4c9a2f3cb490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb489 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201399.652609:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201399.652653:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624b9a7c400/0xa81c4c9a2f3cb490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3cb489 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201399.652689:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624b9a7c400/0xa81c4c9a2f3cb490 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb489 expref: 19 pid: 5819 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201399.652704:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e58a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570109440:0@lo:104: 00000100:00100000:2.0:1788201399.652772:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201399.652836:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962498ac2800/0xa81c4c9a2f3cb46d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99ae1 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201399.652846:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962498ac2800/0xa81c4c9a2f3cb46d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99ae1 expref: 9 pid: 5818 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201399.652857:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570109568:192.168.201.56@tcp:104: 00000100:00100000:2.0:1788201399.652915:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c9ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201399.653102:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570109440 00000100:00100000:1.0:1788201399.653110:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570109440 00000100:00100000:1.0:1788201399.653169:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201399.653180:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570109440:12345-0@lo:104: 00010000:00010000:1.0:1788201399.653193:0:5809:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cb490 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201399.653259:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201399.653274:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570109440:12345-0@lo:104: Request processed in 95us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201399.653281:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788201399.653469:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201399.653476:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cb490 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201399.653483:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624904a7a00 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:2.0:1788201399.653487:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3cb490 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201399.653495:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3cb490 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201399.653503:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3cb490 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201399.653508:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201399.653716:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cb490 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201399.653724:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201399.653754:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cb490 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201399.653762:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624904a7a00/0xa81c4c9a2f3cb489 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cb490 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201399.653780:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201399.653782:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201399.653784:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201399.653792:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201399.653804:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570109696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201399.653838:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201399.653902:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e58a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570109440:0@lo:104: 00000100:00100000:3.0:1788201399.656382:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570109696 00000100:00100000:3.0:1788201399.656397:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570109696 00010000:00010000:3.0:1788201399.656434:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624b9a7c400/0xa81c4c9a2f3cb490 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb489 expref: 20 pid: 5819 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201399.656465:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788201399.656475:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+20:3285:x1875064570109696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201399.656488:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201399.656493:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624b9a7c400/0xa81c4c9a2f3cb490 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb489 expref: 20 pid: 5819 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201399.656505:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624b9a7c400/0xa81c4c9a2f3cb490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb489 expref: 20 pid: 5819 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201399.656533:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624b9a7c400/0xa81c4c9a2f3cb490 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb489 expref: 20 pid: 5819 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201399.656549:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201399.657806:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570109696:12345-0@lo:103:ldlm_bl.0 Request processed in 1329us (3963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201399.657817:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788201399.660292:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570109696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201399.660585:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570109568:192.168.201.56@tcp:104: 00010000:00010000:1.0:1788201399.660608:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201399.661685:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201399.662391:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559579648 00000100:00100000:0.0:1788201399.662403:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559579648 00010000:00010000:0.0:1788201399.662444:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962498ac2800/0xa81c4c9a2f3cb46d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99ae1 expref: 10 pid: 5818 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201399.662502:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:0.0:1788201399.662513:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559579648:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201399.662740:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201399.662747:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962498ac2800/0xa81c4c9a2f3cb46d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99ae1 expref: 10 pid: 5818 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.662758:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962498ac2800/0xa81c4c9a2f3cb46d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99ae1 expref: 10 pid: 5818 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.662776:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962498ac2800/0xa81c4c9a2f3cb46d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99ae1 expref: 10 pid: 5818 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.662792:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.662800:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201399.662814:0:5811:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012377394s 00010000:00010000:0.0:1788201399.662819:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.662824:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.662831:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.662836:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.662849:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962485566800 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:0.0:1788201399.662854:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.662871:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201399.667791:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201399.667809:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.667860:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.667878:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962485566800/0xa81c4c9a2f3cb58c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201399.667898:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201399.667975:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:2341:x1875064559579648:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 5460us (6291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201399.667986:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:0.0:1788201399.669839:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:18232:x1875064570109312:12345-0@lo:253:mount.lustre.0 Request processed in 51076us (54325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201399.669852:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1788201399.669982:0:18232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9deb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:18232:1875064570109312:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201399.669998:0:18232:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788201399.670001:0:18232:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201399.670003:0:18232:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201399.670004:0:18232:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201399.670005:0:18232:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201399.670006:0:18232:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201399.670008:0:18232:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201399.670009:0:18232:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201399.670011:0:18232:0:(tgt_mount.c:1204:server_mti_print()) LDD_F_IR_CAPABLE 00000020:01000004:1.0:1788201399.670012:0:18232:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201399.670014:0:18232:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788201399.670029:0:18232:0:(tgt_mount.c:2687:server_calc_timeout()) lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 00080000:10000000:1.0:1788201399.677657:0:18232:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201399.677818:0:18232:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201399.677992:0:18232:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201399.678154:0:18232:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201399.678313:0:18232:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201399.678536:0:18232:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00080000:2.0:1788201399.679683:0:18232:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-OST0000, 2 recoverable clients, last_transno 21474836487 00010000:00080000:2.0:1788201399.680835:0:18244:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-OST0000: started recovery thread pid 18244 00010000:00080000:2.0:1788201399.680846:0:18244:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1788201399.680850:0:18244:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1788201399.680995:0:18232:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788201399.681062:0:18232:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788201399.681076:0:18232:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788201399.681113:0:18232:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788201400.125595:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201400.822902:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201400.823027:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559579776 00000100:00100000:3.0:1788201400.823038:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559579776 00000100:00100000:3.0:1788201400.823141:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 451 00000100:00100000:3.0:1788201400.823154:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:10055:x1875064559579776:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201400.823174:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201400.823196:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624904a6800/0xa81c4c9a2f3cb593 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd99b12 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201400.823222:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624904a6800/0xa81c4c9a2f3cb593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b12 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201400.823233:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624904a6800/0xa81c4c9a2f3cb593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b12 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201400.823241:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624904a6800, rc 0) 00000100:00100000:3.0:1788201400.823296:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559579776:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 146us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201400.823309:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 451 00000100:00100000:0.0:1788201400.827016:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201400.827108:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559579904 00000100:00100000:2.0:1788201400.827119:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559579904 00000100:00100000:2.0:1788201400.827459:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 452 00000100:00100000:2.0:1788201400.827471:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559579904:12345-192.168.201.56@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201400.827499:0:5820:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788201400.827517:0:5820:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201400.827521:0:5820:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788201400.829326:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559579904:12345-192.168.201.56@tcp:256:ll_cfg_requeue.0 Request processed in 1847us (2307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201400.829357:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 452 00000100:00100000:0.0:1788201400.831927:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201400.832016:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559580032 00000100:00100000:3.0:1788201400.832026:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559580032 00000100:00100000:3.0:1788201400.832106:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 132 00000100:00100000:3.0:1788201400.832116:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559580032:12345-192.168.201.56@tcp:8:ll_cfg_requeue.0 00010000:00080000:3.0:1788201400.832149:0:6668:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '986744c8-ee81-4a47-8d91-97f81ede1f3e' at ffff96248591e000, cookie 0xa81c4c9a2f3cb554 00010000:00080000:3.0:1788201400.832155:0:6668:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp recovering/t21474836482 exp ffff96248591e000 cur 532 last 1788201399 00010000:02000400:3.0:1788201400.832163:0:6668:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1788201400.836588:0:6668:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:2.0:1788201400.836750:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff96248591e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 2097152 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788201400.836776:0:6668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00000100:00080000:2.0:1788201400.836975:0:6668:0:(import.c:65:import_set_state_nolock()) ffff96248c8c4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201400.837048:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559580032:12345-192.168.201.56@tcp:8:ll_cfg_requeue.0 Request processed in 4931us (5130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201400.837057:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 132 00000100:00100000:2.0:1788201400.879613:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201400.879709:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559580160 00000100:00100000:0.0:1788201400.879719:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559580160 00000100:00100000:0.0:1788201400.879794:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 165 00000100:00100000:0.0:1788201400.879805:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559580160:12345-192.168.201.56@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788201400.879826:0:6670:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff9624c1e59500 x1875064559580160/t0(0) o400->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:521/0 lens 224/0 e 0 to 0 dl 1788201411 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201400.879857:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559580160:12345-192.168.201.56@tcp:400:ldlm_lock_repla.0 Request processed in 55us (258us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201400.879865:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 165 00010000:00080000:2.0:1788201400.879959:0:18244:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1788201400.887716:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201400.887749:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570109824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201400.887820:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201400.887920:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570109824 00000100:00100000:1.0:1788201400.887928:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570109824 00000100:00100000:1.0:1788201400.887984:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788201400.888009:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570109824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201400.888045:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201400.888106:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570109824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201400.888112:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00010000:00080000:0.0:1788201400.888681:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9deb800 x1875064570109824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201400.888704:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570109824:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1788201401.080209:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201401.080218:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9624902af800 from 10 10000000:01000000:0.0:1788201401.080224:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201401.080272:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201401.080290:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201401.080301:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201401.080329:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570109952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201401.080415:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201401.080455:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623818af480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201401.080531:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570109952 00000100:00100000:3.0:1788201401.080539:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570109952 00000100:00100000:3.0:1788201401.080589:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1788201401.080599:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570109952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201401.080611:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201401.080623:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624904a6c00/0xa81c4c9a2f3cb5a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb59a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201401.080645:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624904a6c00/0xa81c4c9a2f3cb5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb59a expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201401.080655:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624904a6c00/0xa81c4c9a2f3cb5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb59a expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201401.080680:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624904a6c00, rc 0) 00000100:00100000:3.0:1788201401.080726:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570109952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201401.080732:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1788201401.080795:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570109952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201401.080811:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb5a1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201401.080821:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb5a1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201401.080879:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570110080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788201401.080912:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201401.080931:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962487049000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201401.080943:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570110080 00000100:00100000:3.0:1788201401.080947:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570110080 00000100:00100000:3.0:1788201401.080967:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1788201401.080973:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570110080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788201401.080986:0:5820:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201401.081002:0:5820:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201401.081005:0:5820:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788201401.081088:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570110080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201401.081095:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1788201401.081122:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570110080:0@lo:256:ll_cfg_requeue.0 00000100:00080000:3.0:1788201401.081168:0:5822:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff96249852b000 already not connected (conn 29, was 0): DISCONN 00010000:00080000:3.0:1788201401.081181:0:5822:0:(ldlm_lib.c:85:import_set_conn()) imp ffff96249852b000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.201.156@tcp, moved to head 00000100:00080000:3.0:1788201401.081187:0:5822:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201401.081193:0:5822:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1788201401.081215:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96248517f480 x1875064570110208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:3.0:1788201401.081250:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201401.081256:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb5a1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201401.081264:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb5a1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201401.081281:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570110208:0@lo:8:ll_cfg_requeue.0 00000100:00100000:3.0:1788201401.081307:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201401.081338:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570110208 00000100:00100000:3.0:1788201401.081372:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570110208 00000100:00100000:3.0:1788201401.081400:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788201401.081405:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875064570110208:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1788201401.081425:0:6671:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff962485918000, cookie 0xa81c4c9a2f3cb54d 00010000:00080000:3.0:1788201401.081430:0:6671:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t17179869194 exp ffff962485918000 cur 533 last 1788201399 00002000:00100000:3.0:1788201401.081445:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff962485918000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788201401.081449:0:6671:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788201401.081452:0:6671:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1788201401.081584:0:6671:0:(import.c:65:import_set_state_nolock()) ffff962490145000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201401.081634:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570110208:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 228us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201401.081641:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:3.0:1788201401.081659:0:18244:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788201401.081664:0:18244:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 21474836488 00010000:00080000:3.0:1788201401.081668:0:18244:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 21474836488 00010000:00080000:3.0:1788201401.081671:0:18244:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 21474836488 00010000:00080000:3.0:1788201401.081688:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517f480 x1875064570110208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201401.081700:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 6 00000100:00080000:3.0:1788201401.081709:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788201401.081714:0:3281:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788201401.081716:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836481 gen 2 00000100:00080000:3.0:1788201401.081719:0:3281:0:(recover.c:53:ptlrpc_replay_next()) import ffff96249852b000 from lustre-OST0000_UUID committed 21474836481 last 0 00000100:00080000:3.0:1788201401.081723:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788201401.081825:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570110208:0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1788201401.081846:0:18315:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1788201401.081851:0:18315:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:3.0:1788201401.081856:0:18315:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:3.0:1788201401.081895:0:18315:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788201401.081919:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570110336:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788201401.081944:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201401.083176:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570110336 00000100:00100000:0.0:1788201401.083186:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570110336 00000100:00100000:0.0:1788201401.083243:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788201401.083252:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570110336:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788201401.083267:0:6670:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff9624ba199500 x1875064570110336/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:522/0 lens 224/0 e 0 to 0 dl 1788201412 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201401.083297:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570110336:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 47us (1352us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201401.083303:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00010000:00080000:3.0:1788201401.083440:0:18244:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 21474836488 00010000:00080000:3.0:1788201401.083444:0:18244:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00010000:00080000:3.0:1788201401.083449:0:18244:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788201401.083458:0:18244:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788201401.083618:0:18244:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803776 00000100:00100000:0.0:1788201401.142381:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201401.142414:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201401.143008:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559580288 00000100:00100000:3.0:1788201401.143020:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559580288 00000100:00100000:3.0:1788201401.143087:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 455 00000100:00100000:3.0:1788201401.143096:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559580288:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201401.143163:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559580288:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 69us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201401.143170:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 455 00000100:00100000:0.0:1788201401.144808:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559580416 00000100:00100000:0.0:1788201401.144818:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559580416 00000100:00100000:0.0:1788201401.144889:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 272 00000100:00100000:0.0:1788201401.144899:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559580416:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201401.144960:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559580416:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 63us (2544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201401.144966:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 272 00010000:00010000:0.0:1788201401.145423:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201401.145654:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1788201401.151588:0:18319:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788201401.151598:0:18319:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00010000:00080000:0.0:1788201401.151900:0:18244:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:0.0:1788201401.151917:0:18244:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.201.56@tcp: req@ffff9624c1e59500 x1875064559580160/t0(0) o400->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:521/0 lens 224/0 e 0 to 0 dl 1788201411 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788201401.152022:0:18244:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9624ba199500 x1875064570110336/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:522/0 lens 224/0 e 0 to 0 dl 1788201412 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201401.152107:0:18244:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 2 clients 2 recovered and 0 were evicted. 00010000:00080000:2.0:1788201401.155243:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248517f480 x1875064570110336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201417 ref 1 fl Rpc:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201401.155263:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1788201401.155270:0:3281:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff96248517f480 x1875064570110336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201417 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201401.155278:0:3281:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff96248517f480 x1875064570110336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201417 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201401.155286:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:2.0:1788201401.155298:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:2.0:1788201401.155301:0:3281:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201401.160133:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570110336:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788201401.160370:0:6846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064570110592:0@lo:7:osp-pre-0-0.0 00000100:00100000:2.0:1788201401.160435:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201401.160484:0:6846:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9c80cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201401.160513:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570110464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201401.160543:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201401.161503:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570110464 00000100:00100000:1.0:1788201401.161512:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570110464 00000100:00100000:1.0:1788201401.161575:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788201401.161586:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570110464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201401.161623:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 2097152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:1.0:1788201401.161685:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570110464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201401.161692:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00010000:00080000:1.0:1788201401.161820:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e59180 x1875064570110464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201401.161858:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570110464:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1788201401.162725:0:18244:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788201401.162733:0:18244:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00100000:3.0:1788201401.162884:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570110592 00000100:00100000:3.0:1788201401.162891:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570110592 00000100:00100000:3.0:1788201401.162934:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201401.162942:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6846:x1875064570110592:12345-0@lo:7:osp-pre-0-0.0 00002000:00080000:3.0:1788201401.173090:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788201401.173101:0:6671:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x240000400:0x21:0x0] 00000100:00100000:3.0:1788201401.173208:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6846:x1875064570110592:12345-0@lo:7:osp-pre-0-0.0 Request processed in 10262us (12767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201401.173219:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00010000:00080000:0.0:1788201401.173310:0:6846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e5aa00 x1875064570110592/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201417 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201401.173326:0:6846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064570110592:0@lo:7:osp-pre-0-0.0 00000004:00080000:0.0:1788201401.173372:0:6846:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x240000400:0x21:0x0] 00010000:00010000:2.0:1788201402.166429:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201403.190688:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201404.220470:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201404.983535:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570110720:0@lo:400:kworker.0 00000100:00100000:2.0:1788201404.983593:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570111104:0@lo:400:kworker.0 00000100:00100000:3.0:1788201404.983605:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201404.983624:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201404.983659:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201404.983666:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570111232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201404.983682:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570110848:0@lo:400:kworker.0 00000100:00100000:2.0:1788201404.983690:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201404.983711:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201404.983716:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570110976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201404.983728:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570111360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201404.983738:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201404.983750:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201404.983769:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570111104 00000100:00100000:1.0:1788201404.983773:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570110848 00000100:00100000:1.0:1788201404.983780:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570110848 00000100:00100000:2.0:1788201404.983784:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570111104 00000100:00100000:2.0:1788201404.983828:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570111360 00000100:00100000:2.0:1788201404.983831:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570111360 00000100:00100000:3.0:1788201404.984495:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570110720 00000100:00100000:3.0:1788201404.984501:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570110720 00000100:00100000:3.0:1788201404.984536:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1788201404.984545:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570110720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201404.984601:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570110720:12345-0@lo:400:kworker.0 Request processed in 58us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201404.984614:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1788201404.984664:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570110720:0@lo:400:kworker.0 00000100:00100000:3.0:1788201404.986471:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788201404.986573:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788201404.986582:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570110848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201404.986676:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570110848:12345-0@lo:400:kworker.0 Request processed in 95us (2964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201404.986683:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788201404.986738:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570110848:0@lo:400:kworker.0 00000100:00100000:2.0:1788201404.986847:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788201404.986855:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570111360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201404.986893:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570111360:12345-0@lo:400:kworker.0 Request processed in 39us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201404.986899:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788201404.986920:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570111232 00000100:00100000:2.0:1788201404.986926:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570111232 00000100:00100000:2.0:1788201404.986953:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570110976 00000100:00100000:2.0:1788201404.986956:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570110976 00000100:00100000:2.0:1788201404.986976:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788201404.986982:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570111232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201404.987029:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570111232:12345-0@lo:400:kworker.0 Request processed in 47us (3337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201404.987046:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788201404.987069:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788201404.987075:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570110976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201404.987108:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570110976:12345-0@lo:400:kworker.0 Request processed in 33us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201404.987124:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1788201404.987140:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201404.987144:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201404.987146:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788201404.987171:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e59180 x1875064570110976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201404.987184:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570110976:0@lo:400:kworker.0 00010000:00080000:2.0:1788201404.987210:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9d61f80 x1875064570111232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201404.987220:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570111232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201404.988123:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570111360:0@lo:400:kworker.0 00000100:00100000:3.0:1788201404.995654:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570111104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201404.995764:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570111104:12345-0@lo:400:kworker.0 Request processed in 9282us (12138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201404.995787:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788201404.996027:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248517f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570111104:0@lo:400:kworker.0 00000100:00100000:3.0:1788201405.170614:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201405.170661:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201405.170709:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201405.170741:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559580672 00000100:00100000:3.0:1788201405.170751:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559580672 00000100:00100000:3.0:1788201405.170814:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 276 00000100:00100000:3.0:1788201405.170825:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559580672:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201405.170897:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559580672:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201405.170903:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 276 00000100:00100000:3.0:1788201405.170927:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559580800 00000100:00100000:3.0:1788201405.170930:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559580800 00000100:00100000:3.0:1788201405.170957:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 169 00000100:00100000:3.0:1788201405.170963:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559580800:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201405.170996:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559580800:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 23us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201405.171003:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 169 00000100:00080000:3.0:1788201405.171026:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201405.171030:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201405.171184:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559580544 00000100:00100000:0.0:1788201405.171188:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559580544 00000100:00100000:0.0:1788201405.171220:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 457 00000100:00100000:0.0:1788201405.171227:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559580544:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201405.171258:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559580544:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 32us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201405.171264:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 457 00010000:00010000:2.0:1788201405.238488:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201405.961095:0:18587:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788201406.006604:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570111488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201406.006675:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201406.006745:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570111488 00000100:00100000:2.0:1788201406.006762:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570111488 00000100:00100000:2.0:1788201406.006810:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788201406.006818:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570111488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201406.006849:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201406.006887:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570111488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201406.006903:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1788201406.006924:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788201406.006951:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba43ce00 x1875064570111488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201406.006978:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570111488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201406.262516:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201406.523909:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570111616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201406.524160:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.525929:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570111616 00000100:00100000:3.0:1788201406.525952:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570111616 00000100:00080000:2.0:1788201406.526068:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201406.526208:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788201406.526221:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570111616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201406.526272:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:3.0:1788201406.526632:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570111616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 413us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.526639:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00010000:00080000:2.0:1788201406.526708:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba43ce00 x1875064570111616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201406.526728:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570111616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201407.289216:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201408.310542:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201409.334593:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201409.770789:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201409.770936:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559580928 00000100:00100000:1.0:1788201409.770947:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559580928 00000100:00100000:1.0:1788201409.771039:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 89 00000100:00100000:1.0:1788201409.771051:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:16395:x1875064559580928:12345-192.168.201.56@tcp:41:lfs.0 00000004:00000024:1.0:1788201409.771097:0:5826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201409.771177:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:16395:x1875064559580928:12345-192.168.201.56@tcp:41:lfs.0 Request processed in 128us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201409.771185:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 89 00000100:00080000:2.0:1788201409.775488:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201409.778681:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201409.778778:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559581056 00000100:00100000:2.0:1788201409.778789:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559581056 00000100:00100000:2.0:1788201409.778871:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 156 00000100:00100000:2.0:1788201409.778883:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:16395:x1875064559581056:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:2.0:1788201409.778963:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00080000:3.0:1788201409.779028:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201409.779045:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:16395:x1875064559581056:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 165us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201409.779054:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 156 00000100:00100000:0.0:1788201409.781670:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201409.781849:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559581184 00000100:00100000:3.0:1788201409.781859:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559581184 00000100:00100000:3.0:1788201409.781917:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 135 00000100:00100000:3.0:1788201409.781927:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875064559581184:12345-192.168.201.56@tcp:8:lfs.0 00010000:00080000:3.0:1788201409.781962:0:6670:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:3.0:1788201409.781995:0:6670:0:(genops.c:1406:class_connect()) connect: client 986744c8-ee81-4a47-8d91-97f81ede1f3e, cookie 0xa81c4c9a2f3cb5a8 00002000:00100000:3.0:1788201409.782008:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff9624ba083800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201409.782032:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:3.0:1788201409.782291:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201409.782321:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9624ba084800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201409.782722:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559581184:12345-192.168.201.56@tcp:8:lfs.0 Request processed in 793us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201409.782731:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 135 00000100:00100000:3.0:1788201409.787925:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201409.788658:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559581312 00000100:00100000:2.0:1788201409.788673:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559581312 00000100:00100000:2.0:1788201409.788888:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 157 00000100:00100000:2.0:1788201409.788902:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:16395:x1875064559581312:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:2.0:1788201409.788953:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201409.789047:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:16395:x1875064559581312:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 149us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201409.789066:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 157 00000100:00080000:3.0:1788201409.804080:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201410.103227:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570111872:0@lo:400:kworker.0 00000100:00100000:3.0:1788201410.103304:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201410.103402:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570111872 00000100:00100000:3.0:1788201410.103410:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570111872 00000100:00100000:3.0:1788201410.103450:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788201410.103459:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570111872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201410.103517:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570111872:12345-0@lo:400:kworker.0 Request processed in 53us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201410.103525:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788201410.103585:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570111872:0@lo:400:kworker.0 00000100:00100000:3.0:1788201410.103628:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201410.103635:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570112000:0@lo:400:kworker.0 00000100:00100000:3.0:1788201410.103669:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201410.103711:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570111744:0@lo:400:kworker.0 00000100:00100000:2.0:1788201410.103745:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201410.103787:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570111744 00000100:00100000:2.0:1788201410.103794:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570111744 00000100:00100000:2.0:1788201410.103827:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1788201410.103837:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570111744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201410.103872:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570111744:12345-0@lo:400:kworker.0 Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201410.103879:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1788201410.103927:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570111744:0@lo:400:kworker.0 00000100:00100000:2.0:1788201410.107617:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201410.107640:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570112128:0@lo:400:kworker.0 00000100:00100000:2.0:1788201410.107844:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201410.107927:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570112256:0@lo:400:kworker.0 00000100:00100000:2.0:1788201410.107959:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201410.107997:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570112000 00000100:00100000:2.0:1788201410.108004:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570112000 00000100:00100000:2.0:1788201410.108060:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570112256 00000100:00100000:2.0:1788201410.108063:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570112256 00000100:00100000:2.0:1788201410.108087:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788201410.108096:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570112000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201410.108149:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570112000:12345-0@lo:400:kworker.0 Request processed in 54us (4478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201410.108156:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788201410.108186:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788201410.108192:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570112256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201410.108224:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570112256:12345-0@lo:400:kworker.0 Request processed in 33us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201410.108230:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1788201410.108245:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201410.108249:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788201410.108275:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962381a1aa00 x1875064570112256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201410.108290:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570112256:0@lo:400:kworker.0 00000100:00100000:2.0:1788201410.108329:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201410.108337:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570112384:0@lo:400:kworker.0 00010000:00080000:3.0:1788201410.108515:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624904ea680 x1875064570112000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201410.108526:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570112000:0@lo:400:kworker.0 00000100:00100000:2.0:1788201410.108663:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201410.109653:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570112128 00000100:00100000:3.0:1788201410.109662:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570112128 00000100:00100000:3.0:1788201410.109724:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570112384 00000100:00100000:3.0:1788201410.109728:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570112384 00000100:00100000:3.0:1788201410.109751:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788201410.109760:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570112128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201410.109824:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570112128:12345-0@lo:400:kworker.0 Request processed in 65us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201410.109831:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788201410.109862:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788201410.109868:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570112384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201410.109917:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570112384:12345-0@lo:400:kworker.0 Request processed in 49us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201410.109923:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:2.0:1788201410.112525:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201410.112592:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570112384:0@lo:400:kworker.0 00000100:00100000:2.0:1788201410.112636:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570112128:0@lo:400:kworker.0 00000100:00100000:1.0:1788201410.353953:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201410.353994:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201410.354035:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201410.354065:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201410.354093:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559581568 00000100:00100000:1.0:1788201410.354104:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559581568 00000100:00100000:1.0:1788201410.354158:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 280 00000100:00100000:1.0:1788201410.354168:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559581568:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201410.354241:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559581568:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 74us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201410.354263:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 280 00000100:00100000:1.0:1788201410.354293:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559581696 00000100:00100000:1.0:1788201410.354297:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559581696 00000100:00100000:1.0:1788201410.354317:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559581824 00000100:00100000:1.0:1788201410.354320:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559581824 00000100:00100000:1.0:1788201410.354372:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 172 00000100:00100000:1.0:1788201410.354380:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559581696:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201410.354408:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559581696:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201410.354414:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 172 00000100:00100000:1.0:1788201410.354425:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 173 00000100:00100000:1.0:1788201410.354432:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559581824:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201410.354455:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559581824:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201410.354461:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 173 00000100:00100000:3.0:1788201410.354549:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559581440 00000100:00100000:3.0:1788201410.354554:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559581440 00000100:00100000:3.0:1788201410.354593:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 459 00000100:00100000:3.0:1788201410.354600:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559581440:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201410.354627:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559581440:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 28us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201410.354633:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 459 00010000:00010000:3.0:1788201410.358519:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201411.136479:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570112512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201411.136555:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201411.136646:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570112512 00000100:00100000:3.0:1788201411.136654:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570112512 00000100:00100000:3.0:1788201411.136714:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788201411.136725:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570112512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201411.137257:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201411.137316:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570112512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 592us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201411.137324:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00010000:00080000:3.0:1788201411.137474:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248573bb80 x1875064570112512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201411.137494:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248573bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570112512:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201411.383544:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201411.643705:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570112640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201411.643789:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201411.644311:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570112640 00000100:00100000:3.0:1788201411.644321:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570112640 00000100:00100000:3.0:1788201411.644427:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201411.644437:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570112640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201411.644476:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:3.0:1788201411.644530:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570112640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201411.644537:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00010000:00080000:3.0:1788201411.644592:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248cd54a80 x1875064570112640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201411.644610:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570112640:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201412.413571:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201413.430547:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201414.290730:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00010000:00010000:0.0:1788201414.464009:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201415.222701:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570112768:0@lo:400:kworker.0 00000100:00100000:2.0:1788201415.223087:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201415.223188:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570112768 00000100:00100000:3.0:1788201415.223196:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570112768 00000100:00100000:3.0:1788201415.223249:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:3.0:1788201415.223259:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570112768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201415.224445:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570112896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201415.224499:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201415.224533:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201415.224539:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570113024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201415.224568:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201415.224599:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570113024 00000100:00100000:1.0:1788201415.224604:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570113024 00000100:00100000:1.0:1788201415.224653:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788201415.224676:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570113024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201415.224728:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570113024:12345-0@lo:400:kworker.0 Request processed in 54us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201415.224735:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00010000:00080000:1.0:1788201415.224778:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9c63b80 x1875064570113024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201415.224791:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570113024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201415.224862:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570113152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201415.224890:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201415.224923:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570112896 00000100:00100000:1.0:1788201415.224926:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570112896 00000100:00100000:1.0:1788201415.224951:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570113152 00000100:00100000:1.0:1788201415.224953:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570113152 00000100:00100000:1.0:1788201415.224971:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788201415.224978:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570112896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201415.225013:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570112896:12345-0@lo:400:kworker.0 Request processed in 35us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201415.225018:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788201415.225029:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788201415.225035:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570113152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201415.225063:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570113152:12345-0@lo:400:kworker.0 Request processed in 29us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201415.225068:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788201415.225100:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570113152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201415.225121:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570112896:0@lo:400:kworker.0 00000100:00080000:1.0:1788201415.225151:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201415.225155:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201415.235060:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570113408:0@lo:400:kworker.0 00000100:00100000:0.0:1788201415.235135:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201415.235200:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570113408 00000100:00100000:0.0:1788201415.235207:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570113408 00000100:00100000:0.0:1788201415.235268:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788201415.235278:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570113408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201415.235333:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570113408:12345-0@lo:400:kworker.0 Request processed in 55us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201415.235359:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:0.0:1788201415.235399:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201415.235429:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570113408:0@lo:400:kworker.0 00000100:00100000:1.0:1788201415.236108:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201415.236122:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570113280:0@lo:400:kworker.0 00000100:00100000:1.0:1788201415.236170:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201415.236265:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570113280 00000100:00100000:0.0:1788201415.236271:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570113280 00000100:00100000:0.0:1788201415.236383:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788201415.236392:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570113280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201415.236439:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570113280:12345-0@lo:400:kworker.0 Request processed in 48us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201415.236445:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00080000:0.0:1788201415.236477:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9c61880 x1875064570113280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201415.236488:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570113280:0@lo:400:kworker.0 00000100:00100000:3.0:1788201415.236569:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570112768:12345-0@lo:400:kworker.0 Request processed in 13310us (13481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201415.236579:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00080000:1.0:1788201415.239178:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201415.239673:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570112768:0@lo:400:kworker.0 00010000:00010000:1.0:1788201415.479768:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201415.480279:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201415.480320:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201415.480379:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201415.480410:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201415.480439:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559581952 00000100:00100000:0.0:1788201415.480450:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559581952 00000100:00100000:0.0:1788201415.480509:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 461 00000100:00100000:0.0:1788201415.480519:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559581952:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201415.480616:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559581952:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 97us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201415.480624:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 461 00000100:00100000:0.0:1788201415.480661:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559582336 00000100:00100000:0.0:1788201415.480678:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559582336 00000100:00100000:0.0:1788201415.480716:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559582208 00000100:00100000:0.0:1788201415.480746:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559582208 00000100:00100000:0.0:1788201415.480773:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 176 00000100:00100000:0.0:1788201415.480780:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559582336:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201415.480824:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559582336:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 45us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201415.480831:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 176 00000100:00100000:0.0:1788201415.480843:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 177 00000100:00100000:0.0:1788201415.480849:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559582208:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201415.480874:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559582208:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201415.480880:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 177 00000100:00100000:1.0:1788201415.485280:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559582080 00000100:00100000:1.0:1788201415.485299:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559582080 00000100:00100000:1.0:1788201415.485394:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 284 00000100:00100000:1.0:1788201415.485405:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559582080:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201415.485499:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559582080:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 96us (5226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201415.485508:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 284 00000100:00080000:1.0:1788201415.485535:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201415.485539:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201415.485542:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1788201416.114267:0:18886:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00000100:00100000:2.0:1788201416.246826:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570113536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201416.246894:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201416.246992:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570113536 00000100:00100000:1.0:1788201416.247001:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570113536 00000100:00100000:1.0:1788201416.247056:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788201416.247066:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570113536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201416.247106:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201416.247147:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570113536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201416.247154:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00010000:00080000:1.0:1788201416.247187:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248cd54700 x1875064570113536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201416.247214:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570113536:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201416.502513:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201416.758943:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201416.758964:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570113664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201416.759027:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201416.759084:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570113664 00000100:00100000:3.0:1788201416.759091:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570113664 00000100:00100000:3.0:1788201416.759131:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788201416.759153:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570113664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201416.759184:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:3.0:1788201416.759225:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570113664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201416.759232:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00010000:00080000:3.0:1788201416.759277:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624904ea680 x1875064570113664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201416.759294:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570113664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201417.534962:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201417.779183:0:18935:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1788201418.551598:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201419.574818:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201419.580872:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201419.580978:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559582464 00000100:00100000:1.0:1788201419.580990:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559582464 00000100:00100000:1.0:1788201419.581072:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 90 00000100:00100000:1.0:1788201419.581094:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:16859:x1875064559582464:12345-192.168.201.56@tcp:41:lfs.0 00000004:00000024:1.0:1788201419.581145:0:5826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201419.581220:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:16859:x1875064559582464:12345-192.168.201.56@tcp:41:lfs.0 Request processed in 139us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201419.581228:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 90 00000100:00080000:2.0:1788201419.582913:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201419.588866:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201419.590985:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559582592 00000100:00100000:3.0:1788201419.591001:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559582592 00000100:00100000:3.0:1788201419.591103:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 162 00000100:00100000:3.0:1788201419.591116:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:16859:x1875064559582592:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:3.0:1788201419.591154:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3854565376 avail 3852468224 00000100:00100000:3.0:1788201419.591232:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:16859:x1875064559582592:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 120us (2377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201419.591240:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 162 00000100:00080000:2.0:1788201419.591833:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201419.594037:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201419.594186:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559582720 00000100:00100000:1.0:1788201419.594195:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559582720 00000100:00100000:1.0:1788201419.594264:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 163 00000100:00100000:1.0:1788201419.594276:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:16859:x1875064559582720:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:1.0:1788201419.594326:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201419.594421:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:16859:x1875064559582720:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 148us (394us total) trans 0 rc 0/0 00000100:00080000:2.0:1788201419.594675:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201419.594990:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 163 00000100:00100000:1.0:1788201419.683883:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201419.685654:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559582848 00000100:00100000:0.0:1788201419.685667:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559582848 00000100:00100000:0.0:1788201419.685759:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 136 00000100:00100000:0.0:1788201419.685771:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559582848:12345-192.168.201.56@tcp:101:rm.0 00010000:00010000:0.0:1788201419.685790:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201419.685815:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb5af lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b19 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201419.697679:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 5242880, mtime: 0x6a95c9a3, atime: 0x0, ctime: 0x6a95c9a3, blocks: 0x2807 00010000:00010000:1.0:1788201419.697715:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1788201419.697720:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201419.697760:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb5af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b19 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.697788:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb5af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b19 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.697802:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dee00, rc 0) 00000100:00100000:1.0:1788201419.697869:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559582848:12345-192.168.201.56@tcp:101:rm.0 Request processed in 12099us (13999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201419.697878:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 136 00000100:00100000:3.0:1788201419.702102:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201419.702286:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559583104 00000100:00100000:1.0:1788201419.702296:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559583104 00000100:00100000:1.0:1788201419.702576:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 91 00000100:00100000:1.0:1788201419.702587:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:16876:x1875064559583104:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:1.0:1788201419.702641:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201419.704091:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7800/0xa81c4c9a2f3cb4f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99af6 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.704118:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9624a84c1900) 00010000:00010000:1.0:1788201419.704146:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201419.704177:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27fe00/0xa81c4c9a2f3cb5b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.704191:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27fe00/0xa81c4c9a2f3cb5b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.704201:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27fe00/0xa81c4c9a2f3cb5b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.704235:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f400/0xa81c4c9a2f3cb5bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.704243:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f400/0xa81c4c9a2f3cb5bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.704250:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f400/0xa81c4c9a2f3cb5bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.704877:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f200/0xa81c4c9a2f3cb5c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.704887:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f200/0xa81c4c9a2f3cb5c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.704894:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f200/0xa81c4c9a2f3cb5c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201419.709895:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 64 off9152 00000004:00080000:1.0:1788201419.709912:0:5827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 551782569392ns, next at 552782565285ns, rc = 0 00010000:00010000:1.0:1788201419.711142:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb5cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711165:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb5cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711179:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb5cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711187:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb5cb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711211:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb5cb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711217:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb5cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711313:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201419.711417:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f200/0xa81c4c9a2f3cb5c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711425:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f200/0xa81c4c9a2f3cb5c4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711431:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f200/0xa81c4c9a2f3cb5c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711437:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96248e27f200 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201419.711442:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f200/0xa81c4c9a2f3cb5c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711450:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f200/0xa81c4c9a2f3cb5c4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711590:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9624a8490700) 00010000:00010000:1.0:1788201419.711594:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201419.711599:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f200/0xa81c4c9a2f3cb5c4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711605:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f200/0xa81c4c9a2f3cb5c4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711630:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27fe00/0xa81c4c9a2f3cb5b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711643:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27fe00/0xa81c4c9a2f3cb5b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711649:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27fe00/0xa81c4c9a2f3cb5b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711654:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96248e27fe00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201419.711658:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27fe00/0xa81c4c9a2f3cb5b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711663:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27fe00/0xa81c4c9a2f3cb5b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711671:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201419.711673:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201419.711677:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27fe00/0xa81c4c9a2f3cb5b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.711683:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27fe00/0xa81c4c9a2f3cb5b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201419.711694:0:5827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cd1e59f reply state 000000002d74b778 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f400/0xa81c4c9a2f3cb5bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201419.711703:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201419.711842:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:16876:x1875064559583104:12345-192.168.201.56@tcp:36:rm.0 Request processed in 9252us (9756us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788201419.711851:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 91 00010000:00010000:0.0:1788201419.715446:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201419.715469:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb5cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201419.715482:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96248e27f600 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:0.0:1788201419.715487:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb5cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201419.715511:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb5cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201419.717459:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9624a8490700) 00010000:00010000:0.0:1788201419.717463:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201419.717471:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb5cb lrc: 1/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201419.717477:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb5cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201419.717507:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201419.717510:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201419.717512:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201419.726791:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f400/0xa81c4c9a2f3cb5bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.726830:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f400/0xa81c4c9a2f3cb5bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.726839:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f400/0xa81c4c9a2f3cb5bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.726846:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96248e27f400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201419.726851:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f400/0xa81c4c9a2f3cb5bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.726860:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f400/0xa81c4c9a2f3cb5bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.726876:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xee27d887 (ffff9624a8490500) 00010000:00010000:1.0:1788201419.726880:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201419.726885:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f400/0xa81c4c9a2f3cb5bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201419.726892:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f400/0xa81c4c9a2f3cb5bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xee27d887 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201420.349242:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570113920:0@lo:400:kworker.0 00000100:00100000:1.0:1788201420.349384:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201420.349447:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570114432:0@lo:400:kworker.0 00000100:00100000:1.0:1788201420.349471:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201420.349496:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201420.349502:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570114048:0@lo:400:kworker.0 00000100:00100000:1.0:1788201420.349526:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201420.349575:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570114048 00000100:00100000:1.0:1788201420.349582:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570114048 00000100:00100000:1.0:1788201420.349643:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788201420.349652:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570114048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201420.349706:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570114048:12345-0@lo:400:kworker.0 Request processed in 56us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.349712:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788201420.349748:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570113920 00000100:00100000:1.0:1788201420.349751:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570113920 00000100:00100000:1.0:1788201420.349774:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570114432 00000100:00100000:1.0:1788201420.349777:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570114432 00000100:00100000:1.0:1788201420.349795:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788201420.349800:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570113920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201420.349831:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570113920:12345-0@lo:400:kworker.0 Request processed in 30us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.349836:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788201420.349848:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788201420.349853:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570114432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201420.349878:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570114432:12345-0@lo:400:kworker.0 Request processed in 26us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.349884:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:1.0:1788201420.349904:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201420.349908:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201420.349936:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570114048:0@lo:400:kworker.0 00000100:00100000:1.0:1788201420.349946:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570113920:0@lo:400:kworker.0 00000100:00100000:1.0:1788201420.349953:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570114432:0@lo:400:kworker.0 00000100:00100000:3.0:1788201420.350055:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570113792:0@lo:400:kworker.0 00000100:00100000:3.0:1788201420.350088:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.350123:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570114304:0@lo:400:kworker.0 00000100:00100000:3.0:1788201420.350145:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.350164:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201420.350169:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570114176:0@lo:400:kworker.0 00000100:00100000:3.0:1788201420.350199:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.350371:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570114304 00000100:00100000:2.0:1788201420.350382:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570114304 00000100:00100000:2.0:1788201420.350426:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788201420.350434:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570114304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201420.350475:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570114304:12345-0@lo:400:kworker.0 Request processed in 43us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201420.350482:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00010000:00080000:2.0:1788201420.350511:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9f6aa00 x1875064570114304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201420.350521:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570114304:0@lo:400:kworker.0 00000100:00080000:3.0:1788201420.350583:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201420.355157:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570113792 00000100:00100000:1.0:1788201420.355173:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570113792 00000100:00100000:1.0:1788201420.355233:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1788201420.355243:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570113792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201420.355364:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570113792:12345-0@lo:400:kworker.0 Request processed in 97us (5249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.355373:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1788201420.355810:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570114176 00000100:00100000:1.0:1788201420.355816:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570114176 00000100:00100000:1.0:1788201420.355869:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788201420.355877:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570114176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201420.355919:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570114176:12345-0@lo:400:kworker.0 Request processed in 43us (5719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.355926:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:3.0:1788201420.356022:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201420.357771:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570114176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201420.357787:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570113792:0@lo:400:kworker.0 00000001:00080000:0.0:1788201420.409734:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967376 is committed 00000004:00080000:0.0:1788201420.409751:0:5847:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:0.0:1788201420.409892:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570114560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201420.409969:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201420.410039:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570114560 00000100:00100000:0.0:1788201420.410046:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570114560 00000100:00100000:0.0:1788201420.410165:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788201420.410176:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570114560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201420.410203:0:6668:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:15 count 1 00010000:00010000:0.0:1788201420.410229:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.410253:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb5af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b19 expref: 5 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.410284:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788201420.410289:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201420.410295:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.410336:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb5af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b19 expref: 5 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.410381:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb5af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b19 expref: 5 pid: 6671 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201420.410394:0:6668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570114688:192.168.201.56@tcp:104: 00000100:00100000:0.0:1788201420.410838:0:6668:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c7e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201420.414287:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201420.414487:0:6668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570114688:192.168.201.56@tcp:104: 00010000:00010000:0.0:1788201420.414514:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201420.415687:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559583232 00000100:00100000:1.0:1788201420.415696:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559583232 00010000:00010000:1.0:1788201420.415749:0:11284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb5af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b19 expref: 6 pid: 6671 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201420.415840:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00100000:1.0:1788201420.415850:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559583232:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201420.415867:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201420.415874:0:11284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb5af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b19 expref: 6 pid: 6671 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.415888:0:11284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb5af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b19 expref: 6 pid: 6671 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.415929:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a9ff9ce/0xa81c4c9a2f3cb5af lrc: 0/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b19 expref: 6 pid: 6671 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.415950:0:11284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201420.415955:0:11284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201420.415961:0:11284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.415972:0:11284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.416002:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201420.416062:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559583232:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 212us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.416078:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 54 00010000:00010000:0.0:1788201420.416327:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.416338:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.416365:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.416380:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.416405:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201420.416671:0:16319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201420.416679:0:16319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.416689:0:16319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4dfa00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:2.0:1788201420.416694:0:16319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.416704:0:16319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.416730:0:16319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.416750:0:16319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011991be7/0xa81c4c9a2f3cb5d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.416771:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201420.416773:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201420.416775:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201420.418945:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875064570114560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8762us (8967us total) trans 25769803777 rc 0/0 00000100:00100000:0.0:1788201420.418958:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000004:00080000:2.0:1788201420.420179:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962490589500/2, rc 0, transno 25769803777 00000100:00100000:2.0:1788201420.420190:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570114560:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201420.601474:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201420.601590:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559583360 00000100:00100000:1.0:1788201420.601600:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559583360 00000100:00100000:1.0:1788201420.601658:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 463 00000100:00100000:1.0:1788201420.601669:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559583360:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201420.601759:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559583360:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 91us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.601766:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 463 00010000:00010000:0.0:1788201420.601858:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201420.608911:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201420.608982:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201420.609053:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559583616 00000100:00100000:0.0:1788201420.609064:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559583616 00000100:00100000:0.0:1788201420.609132:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 180 00000100:00100000:0.0:1788201420.609143:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559583616:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201420.609222:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559583616:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 81us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201420.609230:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 180 00000100:00100000:3.0:1788201420.609689:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559583488 00000100:00100000:3.0:1788201420.609695:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559583488 00000100:00100000:3.0:1788201420.609755:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 288 00000100:00100000:3.0:1788201420.609764:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2341:x1875064559583488:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201420.609820:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2341:x1875064559583488:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 58us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.609827:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 288 00000100:00100000:2.0:1788201421.366592:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570114816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201421.366677:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201421.366920:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570114816 00000100:00100000:1.0:1788201421.366929:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570114816 00000100:00100000:1.0:1788201421.367001:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788201421.367025:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570114816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201421.367066:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201421.367116:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570114816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201421.367124:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00010000:00080000:2.0:1788201421.367208:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9f69180 x1875064570114816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201421.367229:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570114816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201421.622646:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201421.880903:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570114944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201421.880975:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.881043:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570114944 00000100:00100000:2.0:1788201421.881050:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570114944 00000100:00100000:2.0:1788201421.881091:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788201421.881099:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875064570114944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201421.881130:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201421.881174:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875064570114944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201421.881193:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788201421.881241:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570114944:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788201421.938577:0:18319:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 25769803777 is committed 00010000:00010000:2.0:1788201422.647824:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201423.671023:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201424.696426:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201425.462929:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570115072:0@lo:400:kworker.0 00000100:00100000:1.0:1788201425.463005:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201425.463114:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570115072 00000100:00100000:3.0:1788201425.463122:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570115072 00000100:00100000:3.0:1788201425.463170:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1788201425.463180:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570115072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201425.463270:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570115200:0@lo:400:kworker.0 00000100:00100000:2.0:1788201425.463372:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201425.463415:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570115200 00000100:00100000:2.0:1788201425.463420:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570115200 00000100:00100000:2.0:1788201425.463449:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788201425.463576:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570115200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201425.463619:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570115200:12345-0@lo:400:kworker.0 Request processed in 164us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201425.463627:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788201425.463680:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570115200:0@lo:400:kworker.0 00000100:00100000:3.0:1788201425.468858:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570115072:12345-0@lo:400:kworker.0 Request processed in 5669us (5842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201425.468875:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1788201425.480093:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570115072:0@lo:400:kworker.0 00000100:00100000:0.0:1788201425.482225:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570115456:0@lo:400:kworker.0 00000100:00100000:0.0:1788201425.482300:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201425.482357:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201425.482364:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570115328:0@lo:400:kworker.0 00000100:00100000:0.0:1788201425.482390:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201425.482422:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570115456 00000100:00100000:0.0:1788201425.482429:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570115456 00000100:00100000:0.0:1788201425.482491:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788201425.482512:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570115456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201425.482561:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570115456:12345-0@lo:400:kworker.0 Request processed in 51us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201425.482568:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788201425.482589:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570115328 00000100:00100000:0.0:1788201425.482592:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570115328 00000100:00100000:0.0:1788201425.482617:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788201425.482622:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570115328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201425.482670:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570115328:12345-0@lo:400:kworker.0 Request processed in 47us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201425.482676:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:0.0:1788201425.482691:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201425.482695:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201425.482709:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570115712:0@lo:400:kworker.0 00000100:00100000:0.0:1788201425.482729:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201425.482745:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201425.482750:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570115584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201425.482771:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201425.482794:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570115584 00000100:00100000:0.0:1788201425.482797:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570115584 00000100:00100000:0.0:1788201425.482830:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788201425.482835:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570115584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201425.482869:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570115584:12345-0@lo:400:kworker.0 Request processed in 33us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201425.482875:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1788201425.482890:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201425.482898:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570115712 00000100:00100000:0.0:1788201425.482908:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570115712 00000100:00100000:3.0:1788201425.488392:0:3283:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803777 gen 2 00000004:00080000:3.0:1788201425.488406:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962490589500, transno 25769803777 00000100:00100000:3.0:1788201425.488427:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570115328:0@lo:400:kworker.0 00000100:00100000:3.0:1788201425.488444:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570115456:0@lo:400:kworker.0 00010000:00080000:2.0:1788201425.491116:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0e680 x1875064570115584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201425.491136:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570115584:0@lo:400:kworker.0 00000100:00080000:3.0:1788201425.493127:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201425.502247:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788201425.502262:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570115712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201425.502386:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570115712:12345-0@lo:400:kworker.0 Request processed in 127us (19655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201425.502394:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788201425.502547:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570115712:0@lo:400:kworker.0 00010000:00010000:2.0:1788201425.718605:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201425.728088:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201425.728158:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201425.728379:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201425.728499:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201425.728588:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559584000 00000100:00100000:3.0:1788201425.728596:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559583744 00000100:00100000:3.0:1788201425.728610:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559583744 00000100:00100000:1.0:1788201425.728611:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559584000 00000100:00100000:3.0:1788201425.728698:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 465 00000100:00100000:3.0:1788201425.728737:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559583744:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201425.728844:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559583744:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 112us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201425.728853:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 465 00000100:00080000:3.0:1788201425.728993:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201425.729437:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559584128 00000100:00100000:1.0:1788201425.729445:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559584128 00000100:00100000:1.0:1788201425.729491:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 183 00000100:00100000:1.0:1788201425.729501:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559584000:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201425.729595:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559584000:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 94us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201425.729603:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 183 00000100:00100000:1.0:1788201425.729620:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 184 00000100:00100000:1.0:1788201425.729640:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559584128:12345-192.168.201.56@tcp:400:kworker.0 00000100:00080000:3.0:1788201425.729990:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201425.730279:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559584128:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 651us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201425.730287:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 184 00000100:00100000:0.0:1788201425.731821:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559583872 00000100:00100000:0.0:1788201425.731837:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559583872 00000100:00100000:0.0:1788201425.731961:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 292 00000100:00100000:0.0:1788201425.731973:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2343:x1875064559583872:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201425.732079:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2343:x1875064559583872:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 107us (3919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201425.732087:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 292 00000100:00080000:3.0:1788201425.733729:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201426.486948:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201426.486982:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570115840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201426.487110:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201426.487221:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570115840 00000100:00100000:1.0:1788201426.487239:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570115840 00000100:00100000:1.0:1788201426.487307:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788201426.487317:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570115840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201426.487387:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201426.487456:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570115840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201426.487464:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00010000:00080000:1.0:1788201426.487927:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9f68380 x1875064570115840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201426.487951:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570115840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201426.748754:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201427.001185:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201427.001218:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570115968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201427.001319:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201427.003091:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570115968 00000100:00100000:3.0:1788201427.003112:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570115968 00000100:00080000:2.0:1788201427.003205:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201427.003237:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788201427.003253:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570115968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201427.003303:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201427.003444:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570115968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201427.003452:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788201427.003698:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570115968:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788201427.407181:0:19133:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-ost-single test 5: Fail OST during iozone ====== 14:37:05 (1788201425) 00000100:00100000:3.0:1788201427.702298:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201427.703841:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559584256 00000100:00100000:1.0:1788201427.703855:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559584256 00000100:00080000:3.0:1788201427.703929:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201427.703942:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 168 00000100:00100000:1.0:1788201427.703953:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:17457:x1875064559584256:12345-192.168.201.56@tcp:13:lctl.0 00002000:00000024:1.0:1788201427.703981:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201427.704078:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:17457:x1875064559584256:12345-192.168.201.56@tcp:13:lctl.0 Request processed in 126us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201427.704086:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 168 00000100:00100000:2.0:1788201427.706620:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201427.706813:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559584384 00000100:00100000:1.0:1788201427.706829:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559584384 00000100:00080000:3.0:1788201427.706913:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201427.706928:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 169 00000100:00100000:1.0:1788201427.706942:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:17457:x1875064559584384:12345-192.168.201.56@tcp:13:lctl.0 00002000:00000024:1.0:1788201427.706986:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201427.707918:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:17457:x1875064559584384:12345-192.168.201.56@tcp:13:lctl.0 Request processed in 976us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201427.707929:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 169 00010000:00010000:0.0:1788201427.766797:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201428.053707:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201428.053878:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559584640 00000100:00100000:0.0:1788201428.053890:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559584640 00000100:00100000:0.0:1788201428.053971:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 92 00000100:00100000:0.0:1788201428.053984:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:17463:x1875064559584640:12345-192.168.201.56@tcp:101:iozone.0 00010000:00010000:0.0:1788201428.054008:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201428.054043:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb5d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b20 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.054768:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb5e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.054786:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb5e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.054800:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb5e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.054814:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb5e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.054821:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb5e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.054828:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb5e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201428.055596:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788201428.057937:0:6693:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10:0x0], index 0: 0 00010000:00010000:0.0:1788201428.060606:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de400/0xa81c4c9a2f3cb5ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.060631:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de400/0xa81c4c9a2f3cb5ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.060644:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de400/0xa81c4c9a2f3cb5ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.060687:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb5e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.060713:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb5e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.060720:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb5e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.060727:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201428.060732:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb5e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.060739:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb5e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.060753:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:0.0:1788201428.060757:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201428.060762:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb5e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.060767:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df600/0xa81c4c9a2f3cb5e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201428.060785:0:6693:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d29dbdcb reply state 00000000447f899d transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb5e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201428.060795:0:6693:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201428.060841:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb5d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b20 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.060856:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de400/0xa81c4c9a2f3cb5ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b20 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.060874:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9624a8e9f300) 00010000:00010000:0.0:1788201428.060876:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201428.060879:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4de400, rc 0) 00000100:00100000:0.0:1788201428.060971:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:17463:x1875064559584640:12345-192.168.201.56@tcp:101:iozone.0 Request processed in 6989us (7275us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788201428.060979:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 92 00000100:00100000:3.0:1788201428.066338:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:2.0:1788201428.066534:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb5e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.066548:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb5e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.066556:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb5e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.066563:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4de200 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201428.066581:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb5e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.066597:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb5e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.066616:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd178b560 (ffff9624a8e9f800) 00010000:00010000:2.0:1788201428.066619:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201428.066624:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb5e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.066630:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb5e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201428.067387:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559584768 00000100:00100000:0.0:1788201428.067403:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559584768 00000100:00100000:0.0:1788201428.067464:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 138 00000100:00100000:0.0:1788201428.067475:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559584768:12345-192.168.201.56@tcp:101:iozone.0 00010000:00010000:0.0:1788201428.067494:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201428.067517:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000965d80f5/0xa81c4c9a2f3cb5fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b27 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201428.089018:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201428.089069:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1788201428.089077:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201428.089452:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965d80f5/0xa81c4c9a2f3cb5fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b27 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.089494:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000965d80f5/0xa81c4c9a2f3cb5fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b27 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.089514:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4dec00, rc 0) 00000100:00100000:1.0:1788201428.089621:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559584768:12345-192.168.201.56@tcp:101:iozone.0 Request processed in 22146us (23292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201428.089632:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 138 00000100:00100000:2.0:1788201428.096004:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201428.096290:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559585024 00000100:00100000:0.0:1788201428.096304:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559585024 00000100:00100000:0.0:1788201428.096648:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 93 00000100:00100000:0.0:1788201428.096662:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:17463:x1875064559585024:12345-192.168.201.56@tcp:36:iozone.0 00010000:00010000:0.0:1788201428.096752:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201428.096791:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de400/0xa81c4c9a2f3cb5ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b20 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.096813:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9624a8e9f300) 00010000:00010000:0.0:1788201428.096824:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201428.099474:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb603 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.099525:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb603 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.099542:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb603 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201428.099695:0:5826:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967378 00000004:00010000:0.0:1788201428.099758:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ec9c392 reply state 00000000dd87ebc2 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb603 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201428.099770:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201428.099929:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:17463:x1875064559585024:12345-192.168.201.56@tcp:36:iozone.0 Request processed in 3264us (3936us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788201428.099940:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 93 00000020:00080000:0.0:1788201428.099949:0:5826:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788201428.104494:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:2.0:1788201428.104846:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb603 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.104866:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb603 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.104913:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb603 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.104923:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:2.0:1788201428.104930:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb603 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.104941:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb603 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.104967:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9624a8e9f900) 00010000:00010000:2.0:1788201428.104972:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201428.104977:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb603 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.104985:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb603 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201428.114601:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559585152 00000100:00100000:1.0:1788201428.114624:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559585152 00000100:00100000:1.0:1788201428.114756:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 94 00000100:00100000:1.0:1788201428.114772:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:17463:x1875064559585152:12345-192.168.201.56@tcp:101:iozone.0 00010000:00010000:1.0:1788201428.114812:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201428.114847:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb60a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b2e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.115042:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb60a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b2e expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.115093:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb60a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b2e expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.115121:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9624a8490000) 00010000:00010000:1.0:1788201428.115125:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201428.115130:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96248e27f600, rc 0) 00000100:00100000:1.0:1788201428.115237:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:17463:x1875064559585152:12345-192.168.201.56@tcp:101:iozone.0 Request processed in 469us (10759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201428.115245:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 94 00000100:00100000:3.0:1788201428.119566:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201428.119768:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559585280 00000100:00100000:0.0:1788201428.119794:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559585280 00000100:00100000:0.0:1788201428.119868:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 139 00000100:00100000:0.0:1788201428.119881:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:17463:x1875064559585280:12345-192.168.201.56@tcp:101:iozone.0 00010000:00010000:0.0:1788201428.119909:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201428.119936:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb611 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b35 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.119981:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000965d80f5/0xa81c4c9a2f3cb5fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b27 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.119992:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201428.119998:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201428.120024:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb611 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b35 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.120075:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000965d80f5/0xa81c4c9a2f3cb5fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b27 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.120091:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000965d80f5/0xa81c4c9a2f3cb5fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b27 expref: 7 pid: 6671 timeout: 660 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201428.120108:0:6668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba471f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570116096:192.168.201.56@tcp:104: 00000100:00100000:0.0:1788201428.120245:0:6668:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624c1c7e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201428.124119:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201428.124420:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559585408 00000100:00100000:1.0:1788201428.124437:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559585408 00010000:00010000:1.0:1788201428.124500:0:5812:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000965d80f5/0xa81c4c9a2f3cb5fc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b27 expref: 8 pid: 6671 timeout: 660 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201428.124548:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:1.0:1788201428.124573:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba172d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559585408:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201428.124606:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201428.124614:0:5812:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000965d80f5/0xa81c4c9a2f3cb5fc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b27 expref: 8 pid: 6671 timeout: 660 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.124634:0:5812:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000965d80f5/0xa81c4c9a2f3cb5fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b27 expref: 8 pid: 6671 timeout: 660 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.124675:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201428.124680:0:5812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201428.124708:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b35 expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.124721:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb611 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b35 expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.124782:0:5812:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb611 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b35 expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201428.124803:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5812:1875064570116224:192.168.201.56@tcp:105: 00000100:00100000:1.0:1788201428.125177:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624ba849f00 going to sleep for 11 seconds 00010000:00010000:2.0:1788201428.126263:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000965d80f5/0xa81c4c9a2f3cb5fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b27 expref: 8 pid: 6671 timeout: 660 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201428.126296:0:6668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba471f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875064570116096:192.168.201.56@tcp:104: 00010000:00010000:2.0:1788201428.126335:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb611 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b35 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.126370:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4df600, rc 0) 00000100:00100000:2.0:1788201428.126446:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:17463:x1875064559585280:12345-192.168.201.56@tcp:101:iozone.0 Request processed in 6567us (6895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201428.126553:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 139 00000100:00100000:1.0:1788201428.129160:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5812:1875064570116224:192.168.201.56@tcp:105: 00010000:00010000:1.0:1788201428.129196:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201428.129271:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba172d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559585408:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 4712us (5170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201428.129285:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:3.0:1788201428.131625:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201428.131713:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559585536 00000100:00100000:0.0:1788201428.131729:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559585536 00002000:00010000:0.0:1788201428.131780:0:6674:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/16 (0->18446744073709551615) 00002000:00100000:0.0:1788201428.131786:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba171500 with x1875064559585536 ext(0->18446744073709551615) 00002000:00010000:0.0:1788201428.131801:0:6674:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba171500. 00000100:00100000:0.0:1788201428.131847:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:0.0:1788201428.131859:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559585536:12345-192.168.201.56@tcp:10:iozone.0 00002000:00010000:0.0:1788201428.132331:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788201428.132337:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb mtime from disk: 0 -> 1788201428 00002000:00010000:0.0:1788201428.132390:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788201428.132393:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb ctime from disk: 0 -> 1788201428 00002000:00010000:0.0:1788201428.132395:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788201428.132500:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2342:x1875064559585536:12345-192.168.201.56@tcp:10:iozone.0 Request processed in 643us (885us total) trans 25769803778 rc 0/0 00000100:00100000:0.0:1788201428.132509:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 38 00002000:00010000:0.0:1788201428.132535:0:6674:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/16 (0->18446744073709551615) 00002000:00100000:0.0:1788201428.132538:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba171500 with x1875064559585536 ext(0->18446744073709551615) 00002000:00010000:0.0:1788201428.132543:0:6674:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba171500. 00000100:00100000:3.0:1788201428.135825:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201428.135938:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559585792 00000100:00100000:2.0:1788201428.135953:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559585792 00000100:00100000:2.0:1788201428.136036:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:2.0:1788201428.136051:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:17463:x1875064559585792:12345-192.168.201.56@tcp:35:iozone.0 00000100:00100000:3.0:1788201428.137206:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:17463:x1875064559585792:12345-192.168.201.56@tcp:35:iozone.0 Request processed in 1154us (1392us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788201428.137239:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:3.0:1788201428.140155:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201428.140292:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559585920 00000100:00100000:0.0:1788201428.140305:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559585920 00000100:00100000:0.0:1788201428.140696:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 95 00000100:00100000:0.0:1788201428.140709:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:17463:x1875064559585920:12345-192.168.201.56@tcp:101:iozone.0 00010000:00010000:0.0:1788201428.140744:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201428.140773:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de400/0xa81c4c9a2f3cb618 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b3c expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.140866:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb61f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.140897:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb61f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.140911:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb61f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.140928:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb626 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.140936:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.140943:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141084:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb62d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141110:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb62d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141118:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb62d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201428.141165:0:6693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 0 00000004:00200000:0.0:1788201428.141170:0:6693:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201428.141194:0:6693:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb62d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141207:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb62d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141217:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb61f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141224:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb61f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141232:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb61f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141239:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4dea00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201428.141244:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb61f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141252:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb61f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141266:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:0.0:1788201428.141270:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201428.141283:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb61f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141290:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb61f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141309:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141315:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb626 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141321:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb626 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141327:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4dfc00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201428.141331:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb626 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141337:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb626 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141402:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd178b560 (ffff9624a8e9f300) 00010000:00010000:0.0:1788201428.141405:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201428.141408:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb626 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141422:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfc00/0xa81c4c9a2f3cb626 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141462:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de400/0xa81c4c9a2f3cb618 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b3c expref: 14 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141490:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb62d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b3c expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.141498:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9624a8490000) 00010000:00010000:0.0:1788201428.141501:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201428.141505:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4df200, rc 0) 00000100:00100000:0.0:1788201428.141618:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:17463:x1875064559585920:12345-192.168.201.56@tcp:101:iozone.0 Request processed in 912us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201428.141627:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 95 00000100:00100000:2.0:1788201428.145056:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201428.145384:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559586176 00000100:00100000:0.0:1788201428.145397:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559586176 00000100:00100000:0.0:1788201428.145479:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 96 00000100:00100000:0.0:1788201428.145491:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:17463:x1875064559586176:12345-192.168.201.56@tcp:36:iozone.0 00010000:00010000:0.0:1788201428.145576:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788201428.145617:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb62d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b3c expref: 13 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.145646:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27f600/0xa81c4c9a2f3cb60a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b2e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.145659:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9624a8490000) 00010000:00010000:0.0:1788201428.145671:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201428.145700:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb634 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.145714:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb634 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.145734:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb634 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.145753:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dee00/0xa81c4c9a2f3cb63b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.145760:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dee00/0xa81c4c9a2f3cb63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.145767:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dee00/0xa81c4c9a2f3cb63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.145982:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb642 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.145991:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb642 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.145998:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb642 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201428.146831:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 64 off9216 00000004:00080000:0.0:1788201428.146846:0:6693:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 560219502956ns, next at 561219498472ns, rc = 0 00010000:00010000:0.0:1788201428.147223:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb649 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147237:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb649 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147248:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb649 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147269:0:6693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb649 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147277:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb649 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147284:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb649 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147406:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201428.147441:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb642 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147448:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb642 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147456:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb642 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147464:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4dfa00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201428.147470:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb642 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147478:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb642 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147491:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9624a8e9fd00) 00010000:00010000:0.0:1788201428.147495:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201428.147500:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb642 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147518:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dfa00/0xa81c4c9a2f3cb642 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147543:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb634 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147550:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb634 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147556:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb634 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147746:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4de600 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201428.147750:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb634 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147757:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb634 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147766:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:0.0:1788201428.147769:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201428.147773:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb634 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.147778:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de600/0xa81c4c9a2f3cb634 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201428.147789:0:6693:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000559c294d reply state 00000000e1887872 transno 4294967381 ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dee00/0xa81c4c9a2f3cb63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201428.147800:0:6693:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201428.148039:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:17463:x1875064559586176:12345-192.168.201.56@tcp:36:iozone.0 Request processed in 2544us (2994us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1788201428.148050:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 96 00010000:00010000:0.0:1788201428.152080:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dee00/0xa81c4c9a2f3cb63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.152105:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dee00/0xa81c4c9a2f3cb63b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.152115:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dee00/0xa81c4c9a2f3cb63b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.152123:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4dee00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201428.152129:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dee00/0xa81c4c9a2f3cb63b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.152138:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dee00/0xa81c4c9a2f3cb63b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.152161:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd178b560 (ffff9624a8e9fe00) 00010000:00010000:0.0:1788201428.152165:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201428.152171:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dee00/0xa81c4c9a2f3cb63b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.152179:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dee00/0xa81c4c9a2f3cb63b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.152326:0:16319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201428.152336:0:16319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb649 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.152370:0:16319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4dec00 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:2.0:1788201428.152382:0:16319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb649 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.152389:0:16319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb649 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.152399:0:16319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9624a8e9fd00) 00010000:00010000:2.0:1788201428.152402:0:16319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201428.152405:0:16319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb649 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.152620:0:16319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb649 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.152639:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201428.152641:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201428.152642:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201428.153817:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201428.153991:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559586432 00000100:00100000:0.0:1788201428.154005:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559586432 00000100:00100000:0.0:1788201428.154095:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 97 00000100:00100000:0.0:1788201428.154109:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:17463:x1875064559586432:12345-192.168.201.56@tcp:101:iozone.0 00010000:00010000:0.0:1788201428.154152:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201428.154176:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb650 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b43 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.154401:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb657 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.154764:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb657 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.154781:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb657 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.154802:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb65e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.154809:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb65e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.154817:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb65e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201428.156766:0:5826:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11:0x0], index 0: 0 00010000:00010000:0.0:1788201428.157284:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb665 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.157303:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb665 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.157317:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb665 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.157706:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb657 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.157716:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb657 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.157723:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb657 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.157730:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201428.157734:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb657 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.157742:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb657 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.157756:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:0.0:1788201428.157760:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201428.157765:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb657 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.157771:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb657 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201428.157789:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099a3198c reply state 00000000822c48ac transno 4294967382 ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb65e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201428.157800:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201428.157847:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dea00/0xa81c4c9a2f3cb650 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b43 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.158210:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb665 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b43 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.158220:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9624a8e9f300) 00010000:00010000:0.0:1788201428.158222:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201428.158225:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4df200, rc 0) 00000100:00100000:0.0:1788201428.158574:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:17463:x1875064559586432:12345-192.168.201.56@tcp:101:iozone.0 Request processed in 4466us (4766us total) trans 4294967382 rc 0/0 00000100:00100000:0.0:1788201428.158594:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 97 00000100:00100000:3.0:1788201428.164284:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:0.0:1788201428.164370:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb65e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.164392:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb65e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.164401:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb65e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.164420:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4de200 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:0.0:1788201428.164427:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb65e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.164437:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb65e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.164459:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd178b560 (ffff9624a8e9fc00) 00010000:00010000:0.0:1788201428.164463:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201428.164470:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb65e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.164499:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4de200/0xa81c4c9a2f3cb65e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201428.165522:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559586688 00000100:00100000:0.0:1788201428.165538:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559586688 00000100:00100000:0.0:1788201428.165678:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 37 00000100:00100000:0.0:1788201428.165691:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:17463:x1875064559586688:12345-192.168.201.56@tcp:35:iozone.0 00000100:00100000:0.0:1788201428.166287:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:17463:x1875064559586688:12345-192.168.201.56@tcp:35:iozone.0 Request processed in 596us (2017us total) trans 4294967383 rc 0/0 00000100:00100000:0.0:1788201428.166298:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 37 00000100:00100000:2.0:1788201428.170158:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201428.170337:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559586944 00000100:00100000:3.0:1788201428.170390:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559586944 00000100:00100000:3.0:1788201428.170640:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 98 00000100:00100000:3.0:1788201428.170653:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:17463:x1875064559586944:12345-192.168.201.56@tcp:101:iozone.0 00010000:00010000:3.0:1788201428.170689:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201428.170721:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7000/0xa81c4c9a2f3cb673 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b4a expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.170864:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6600/0xa81c4c9a2f3cb67a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.171010:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb665 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b43 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.171020:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6600/0xa81c4c9a2f3cb67a lrc: 4/0,1 mode: --/CW res: [0x200000402:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.171177:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb665 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b43 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.171194:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb665 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b43 expref: 16 pid: 5826 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201428.171212:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba114700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6693:1875064570116352:192.168.201.56@tcp:104: 00000100:00100000:3.0:1788201428.171446:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623827c4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201428.187552:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba114700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6693:1875064570116352:192.168.201.56@tcp:104: 00010000:00010000:3.0:1788201428.187604:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6600/0xa81c4c9a2f3cb67a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201428.189765:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201428.190098:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559587072 00000100:00100000:1.0:1788201428.190113:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559587072 00010000:00010000:1.0:1788201428.190170:0:11284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb665 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b43 expref: 17 pid: 5826 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201428.190226:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:1.0:1788201428.190239:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624902bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2342:x1875064559587072:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201428.190258:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201428.190266:0:11284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb665 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b43 expref: 17 pid: 5826 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.190305:0:11284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb665 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b43 expref: 17 pid: 5826 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.190335:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df200/0xa81c4c9a2f3cb665 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b43 expref: 17 pid: 5826 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.190384:0:11284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9624a8e9f300) 00010000:00010000:1.0:1788201428.190390:0:11284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6600/0xa81c4c9a2f3cb67a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.190401:0:11284:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6600/0xa81c4c9a2f3cb67a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.190476:0:11284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6600/0xa81c4c9a2f3cb67a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.190512:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201428.190612:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624902bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559587072:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 375us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201428.190621:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 56 00010000:00010000:2.0:1788201428.193984:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6600/0xa81c4c9a2f3cb67a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.194012:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6600/0xa81c4c9a2f3cb67a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201428.194049:0:6693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x10:0x0]: returning size 0 00010000:00010000:2.0:1788201428.194306:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a7000/0xa81c4c9a2f3cb673 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b4a expref: 17 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.194337:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624904a6600/0xa81c4c9a2f3cb67a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b4a expref: 16 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.194384:0:6693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9624a8e9f300) 00010000:00010000:2.0:1788201428.194388:0:6693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201428.194392:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624904a6600, rc 0) 00000100:00100000:2.0:1788201428.194479:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:17463:x1875064559586944:12345-192.168.201.56@tcp:101:iozone.0 Request processed in 23828us (24335us total) trans 4294967384 rc 0/0 00000100:00100000:2.0:1788201428.194490:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 98 00000100:00100000:2.0:1788201428.204184:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201428.204285:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559587200 00000100:00100000:3.0:1788201428.204299:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559587200 00000100:00100000:3.0:1788201428.204468:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 99 00000100:00100000:3.0:1788201428.204483:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:17463:x1875064559587200:12345-192.168.201.56@tcp:44:iozone.0 00000001:00080000:0.0:1788201428.242018:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967383 is committed 00000004:00080000:0.0:1788201428.242048:0:5847:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:0.0:1788201428.242078:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967384 is committed 00000100:00100000:2.0:1788201428.242822:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:17463:x1875064559587200:12345-192.168.201.56@tcp:44:iozone.0 Request processed in 38335us (38646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201428.242837:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 99 00000100:00100000:1.0:1788201428.242978:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570116480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201428.243054:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201428.243115:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570116480 00000100:00100000:2.0:1788201428.243125:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570116480 00000100:00100000:2.0:1788201428.243278:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788201428.243292:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570116480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201428.243460:0:8088:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:16 count 1 00010000:00010000:2.0:1788201428.243499:0:8088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.243526:0:8088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b35 expref: 6 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.243537:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201428.243542:0:8088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201428.243547:0:8088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.243940:0:8088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b35 expref: 6 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201428.243961:0:8088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb611 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b35 expref: 6 pid: 6668 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201428.243976:0:8088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8088:1875064570116608:192.168.201.56@tcp:104: 00000100:00100000:2.0:1788201428.244054:0:8088:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623818af300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201428.245919:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201428.246052:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559587328 00000100:00100000:1.0:1788201428.246070:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559587328 00000100:00100000:0.0:1788201428.246136:0:8088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8088:1875064570116608:192.168.201.56@tcp:104: 00000100:00100000:1.0:1788201428.246154:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 141 00000100:00100000:1.0:1788201428.246168:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2341:x1875064559587328:12345-192.168.201.56@tcp:16:iozone.0 00010000:00010000:0.0:1788201428.246297:0:8088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201428.248792:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2341:x1875064559587328:12345-192.168.201.56@tcp:16:iozone.0 Request processed in 2611us (2870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201428.248806:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 141 00000100:00100000:0.0:1788201428.253125:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201428.253387:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559587456 00000100:00100000:3.0:1788201428.253401:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559587456 00010000:00010000:3.0:1788201428.253458:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb611 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b35 expref: 7 pid: 6668 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201428.253512:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:3.0:1788201428.253525:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2342:x1875064559587456:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201428.253548:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201428.253554:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb611 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b35 expref: 7 pid: 6668 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.253591:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b35 expref: 7 pid: 6668 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.253625:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000112755c7/0xa81c4c9a2f3cb611 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b35 expref: 7 pid: 6668 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.253673:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201428.253680:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788201428.253687:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.253698:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.253736:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201428.253826:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559587456:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 302us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201428.253834:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:3.0:1788201428.253959:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:0.0:1788201428.254104:0:8088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.254115:0:8088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.254137:0:8088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.254145:0:8088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201428.254171:0:8088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201428.254183:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559587584 00000100:00100000:1.0:1788201428.254195:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559587584 00000100:00100000:1.0:1788201428.254235:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 100 00000100:00100000:1.0:1788201428.254243:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:17463:x1875064559587584:12345-192.168.201.56@tcp:101:iozone.0 00010000:00010000:1.0:1788201428.254265:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201428.254286:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27fe00/0xa81c4c9a2f3cb68f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b51 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.254389:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27fe00/0xa81c4c9a2f3cb68f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b51 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.254405:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27fe00/0xa81c4c9a2f3cb68f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b51 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.254430:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9624a8e9f300) 00010000:00010000:1.0:1788201428.254434:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201428.254438:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96248e27fe00, rc 0) 00000100:00100000:1.0:1788201428.254476:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:17463:x1875064559587584:12345-192.168.201.56@tcp:101:iozone.0 Request processed in 234us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201428.254483:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 100 00000100:00100000:0.0:1788201428.254785:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570116480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11496us (11730us total) trans 25769803779 rc 0/0 00000100:00100000:0.0:1788201428.254795:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000004:00080000:1.0:1788201428.254999:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9624ba114700/2, rc 0, transno 25769803779 00000100:00100000:1.0:1788201428.255008:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570116480:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201428.255784:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201428.255797:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.255810:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962485566600 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:3.0:1788201428.255815:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.255827:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.255847:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.255870:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d53888/0xa81c4c9a2f3cb688 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201428.255897:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201428.255899:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201428.255901:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201428.257526:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201428.257607:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559587712 00000100:00100000:1.0:1788201428.257620:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559587712 00000100:00100000:1.0:1788201428.257756:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 142 00000100:00100000:1.0:1788201428.257768:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:17463:x1875064559587712:12345-192.168.201.56@tcp:101:iozone.0 00010000:00010000:1.0:1788201428.257793:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201428.257821:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ddba4a2/0xa81c4c9a2f3cb696 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b58 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201428.257880:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201428.257911:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1788201428.257917:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201428.257930:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ddba4a2/0xa81c4c9a2f3cb696 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b58 expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.257947:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007ddba4a2/0xa81c4c9a2f3cb696 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b58 expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201428.257962:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96248e27f200, rc 0) 00000100:00100000:1.0:1788201428.258042:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:17463:x1875064559587712:12345-192.168.201.56@tcp:101:iozone.0 Request processed in 276us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201428.258049:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 142 00000100:00100000:2.0:1788201428.263007:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201428.263152:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559587840 00000100:00100000:0.0:1788201428.263165:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559587840 00002000:00100000:0.0:1788201428.263230:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (0->4095) req@ffff9624ba438e00 x1875064559587840/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:549/0 lens 4584/0 e 0 to 0 dl 1788201439 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201428.263239:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba438e00 with x1875064559587840 ext(0->4095) 00002000:00010000:0.0:1788201428.263245:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba438e00 00000100:00100000:0.0:1788201428.263306:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:0.0:1788201428.263321:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+7:2341:x1875064559587840:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201428.264312:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559587840:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 985us (1306us total) trans 25769803780 rc 0/0 00000100:00100000:0.0:1788201428.264328:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 39 00002000:00100000:0.0:1788201428.264380:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (0->4095) req@ffff9624ba438e00 x1875064559587840/t25769803780(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:549/0 lens 4584/448 e 0 to 0 dl 1788201439 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201428.264416:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba438e00 with x1875064559587840 ext(0->4095) 00002000:00010000:0.0:1788201428.264424:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba438e00 00000100:00100000:0.0:1788201428.434025:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201428.434230:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559587968 00000100:00100000:2.0:1788201428.434246:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559587968 00002000:00100000:2.0:1788201428.434319:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (4096->1052671) req@ffff96248c9c4700 x1875064559587968/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:549/0 lens 488/0 e 0 to 0 dl 1788201439 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201428.434416:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4700 with x1875064559587968 ext(4096->1052671) 00002000:00010000:2.0:1788201428.434424:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4700 00000100:00100000:2.0:1788201428.434453:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 40 00000100:00100000:2.0:1788201428.434466:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559587968:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201428.467574:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:2343:x1875064559587968:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33101us (33555us total) trans 25769803781 rc 0/0 00000100:00100000:0.0:1788201428.467595:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 40 00002000:00100000:0.0:1788201428.467608:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (4096->1052671) req@ffff96248c9c4700 x1875064559587968/t25769803781(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:549/0 lens 488/448 e 0 to 0 dl 1788201439 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201428.467617:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4700 with x1875064559587968 ext(4096->1052671) 00002000:00010000:0.0:1788201428.467624:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4700 00000100:00100000:2.0:1788201428.778900:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201428.779091:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559588096 00000100:00100000:0.0:1788201428.779102:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559588096 00002000:00100000:0.0:1788201428.779164:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1052672->2101247) req@ffff9624ba43a680 x1875064559588096/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:549/0 lens 488/0 e 0 to 0 dl 1788201439 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201428.779175:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43a680 with x1875064559588096 ext(1052672->2101247) 00002000:00010000:0.0:1788201428.779181:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43a680 00000100:00100000:0.0:1788201428.779223:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 41 00000100:00100000:0.0:1788201428.779234:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:2344:x1875064559588096:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:0.0:1788201428.801439:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201428.815851:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:2344:x1875064559588096:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36603us (36946us total) trans 25769803782 rc 0/0 00000100:00100000:1.0:1788201428.815872:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 41 00002000:00100000:1.0:1788201428.815890:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1052672->2101247) req@ffff9624ba43a680 x1875064559588096/t25769803782(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:549/0 lens 488/448 e 0 to 0 dl 1788201439 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201428.815901:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43a680 with x1875064559588096 ext(1052672->2101247) 00002000:00010000:1.0:1788201428.815908:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43a680 00000100:00100000:2.0:1788201429.103253:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201429.103999:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559588224 00000100:00100000:0.0:1788201429.104016:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559588224 00002000:00100000:0.0:1788201429.104109:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (2101248->3149823) req@ffff9624ba43ad80 x1875064559588224/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:550/0 lens 488/0 e 0 to 0 dl 1788201440 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201429.104143:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43ad80 with x1875064559588224 ext(2101248->3149823) 00002000:00010000:0.0:1788201429.104149:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43ad80 00000100:00080000:3.0:1788201429.104252:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201429.104309:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:0.0:1788201429.104323:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:2344:x1875064559588224:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201429.133919:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2344:x1875064559588224:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29582us (30661us total) trans 25769803783 rc 0/0 00000100:00100000:2.0:1788201429.133938:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 42 00002000:00100000:2.0:1788201429.133957:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (2101248->3149823) req@ffff9624ba43ad80 x1875064559588224/t25769803783(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:550/0 lens 488/448 e 0 to 0 dl 1788201440 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201429.133969:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43ad80 with x1875064559588224 ext(2101248->3149823) 00002000:00010000:2.0:1788201429.133987:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43ad80 00000100:00100000:3.0:1788201429.325664:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201429.325930:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559588352 00000100:00100000:1.0:1788201429.325944:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559588352 00002000:00100000:1.0:1788201429.326016:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (3149824->4198399) req@ffff9624bb8bb100 x1875064559588352/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:550/0 lens 488/0 e 0 to 0 dl 1788201440 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201429.326064:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8bb100 with x1875064559588352 ext(3149824->4198399) 00002000:00010000:1.0:1788201429.326072:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8bb100 00000100:00100000:1.0:1788201429.326116:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:1.0:1788201429.326128:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+15:2343:x1875064559588352:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201429.344496:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2343:x1875064559588352:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18354us (18831us total) trans 25769803784 rc 0/0 00000100:00100000:1.0:1788201429.344515:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 43 00002000:00100000:1.0:1788201429.344532:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (3149824->4198399) req@ffff9624bb8bb100 x1875064559588352/t25769803784(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:550/0 lens 488/448 e 0 to 0 dl 1788201440 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201429.344545:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8bb100 with x1875064559588352 ext(3149824->4198399) 00002000:00010000:1.0:1788201429.344553:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8bb100 00000100:00100000:0.0:1788201429.505460:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201429.506811:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559588480 00000100:00100000:1.0:1788201429.506830:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559588480 00002000:00100000:1.0:1788201429.506902:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (4198400->5246975) req@ffff96248c9c7100 x1875064559588480/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:550/0 lens 488/0 e 0 to 0 dl 1788201440 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201429.506916:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c7100 with x1875064559588480 ext(4198400->5246975) 00002000:00010000:1.0:1788201429.506923:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c7100 00000100:00100000:1.0:1788201429.507019:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 44 00000100:00100000:1.0:1788201429.507032:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+17:2343:x1875064559588480:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201429.533367:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:2343:x1875064559588480:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26299us (27886us total) trans 25769803785 rc 0/0 00000100:00100000:1.0:1788201429.533386:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 44 00002000:00100000:1.0:1788201429.533417:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (4198400->5246975) req@ffff96248c9c7100 x1875064559588480/t25769803785(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:550/0 lens 488/448 e 0 to 0 dl 1788201440 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201429.533428:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c7100 with x1875064559588480 ext(4198400->5246975) 00002000:00010000:1.0:1788201429.533436:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c7100 00000100:00100000:3.0:1788201429.766498:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201429.766674:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559588608 00000100:00100000:1.0:1788201429.766689:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559588608 00002000:00100000:1.0:1788201429.766758:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (5246976->6295551) req@ffff9624bb8baa00 x1875064559588608/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:550/0 lens 488/0 e 0 to 0 dl 1788201440 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201429.766772:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8baa00 with x1875064559588608 ext(5246976->6295551) 00002000:00010000:1.0:1788201429.766780:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8baa00 00000100:00100000:1.0:1788201429.766827:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:1.0:1788201429.766839:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+19:2344:x1875064559588608:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201429.800748:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:2344:x1875064559588608:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33892us (34250us total) trans 25769803786 rc 0/0 00000100:00100000:1.0:1788201429.800771:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 45 00002000:00100000:1.0:1788201429.800790:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (5246976->6295551) req@ffff9624bb8baa00 x1875064559588608/t25769803786(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:550/0 lens 488/448 e 0 to 0 dl 1788201440 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201429.800804:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8baa00 with x1875064559588608 ext(5246976->6295551) 00002000:00010000:1.0:1788201429.800812:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8baa00 00010000:00010000:2.0:1788201429.814732:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201430.094580:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201430.094720:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559588736 00000100:00100000:0.0:1788201430.094735:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559588736 00002000:00100000:0.0:1788201430.094808:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (6295552->7344127) req@ffff9624ba439c00 x1875064559588736/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:551/0 lens 488/0 e 0 to 0 dl 1788201441 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201430.094821:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba439c00 with x1875064559588736 ext(6295552->7344127) 00002000:00010000:0.0:1788201430.094827:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba439c00 00000100:00100000:0.0:1788201430.094873:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00100000:0.0:1788201430.094884:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+21:2341:x1875064559588736:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201430.130871:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+23:2341:x1875064559588736:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35960us (36278us total) trans 25769803787 rc 0/0 00000100:00100000:1.0:1788201430.130892:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 46 00002000:00100000:1.0:1788201430.130911:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (6295552->7344127) req@ffff9624ba439c00 x1875064559588736/t25769803787(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:551/0 lens 488/448 e 0 to 0 dl 1788201441 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201430.130951:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba439c00 with x1875064559588736 ext(6295552->7344127) 00002000:00010000:1.0:1788201430.130960:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba439c00 00000100:00100000:0.0:1788201430.436992:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201430.438450:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559588864 00000100:00100000:3.0:1788201430.438471:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559588864 00002000:00100000:3.0:1788201430.438564:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (7344128->8392703) req@ffff96248c9c6a00 x1875064559588864/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:551/0 lens 488/0 e 0 to 0 dl 1788201441 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201430.438578:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c6a00 with x1875064559588864 ext(7344128->8392703) 00002000:00010000:3.0:1788201430.438585:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c6a00 00000100:00100000:3.0:1788201430.438631:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:3.0:1788201430.438642:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+23:2344:x1875064559588864:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201430.480749:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:2344:x1875064559588864:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 42091us (43757us total) trans 25769803788 rc 0/0 00000100:00100000:2.0:1788201430.480769:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 47 00002000:00100000:2.0:1788201430.480787:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (7344128->8392703) req@ffff96248c9c6a00 x1875064559588864/t25769803788(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:551/0 lens 488/448 e 0 to 0 dl 1788201441 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201430.480800:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c6a00 with x1875064559588864 ext(7344128->8392703) 00002000:00010000:2.0:1788201430.480808:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c6a00 00000100:00100000:1.0:1788201430.582757:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201430.582932:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570116864:0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.583065:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201430.583158:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201430.583165:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570116992:0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.583196:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201430.584770:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201430.584803:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570117120:0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.584897:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201430.584973:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570116864 00000100:00100000:0.0:1788201430.584982:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570116864 00000100:00100000:0.0:1788201430.585044:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570117120 00000100:00100000:0.0:1788201430.585046:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570117120 00000100:00100000:0.0:1788201430.585080:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788201430.585089:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570116864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.585157:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570116864:12345-0@lo:400:kworker.0 Request processed in 68us (2092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201430.585182:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788201430.585201:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788201430.585208:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570117120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.585247:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570117120:12345-0@lo:400:kworker.0 Request processed in 40us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201430.585254:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788201430.585279:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570116992 00000100:00100000:0.0:1788201430.585283:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570116992 00000100:00100000:0.0:1788201430.585317:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788201430.585322:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875064570116992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.585387:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875064570116992:12345-0@lo:400:kworker.0 Request processed in 65us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201430.585393:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:0.0:1788201430.585418:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201430.585423:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201430.585456:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570117120:0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.585494:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570116992:0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.585507:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570116864:0@lo:400:kworker.0 00000100:00100000:1.0:1788201430.588666:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570116736:0@lo:400:kworker.0 00000100:00100000:1.0:1788201430.589395:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201430.589567:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570116736 00000100:00100000:3.0:1788201430.589605:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570116736 00000100:00100000:3.0:1788201430.589694:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1788201430.589707:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570116736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.589810:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570116736:12345-0@lo:400:kworker.0 Request processed in 105us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201430.589818:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1788201430.589951:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570116736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201430.591425:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201430.591469:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570117376:0@lo:400:kworker.0 00000100:00100000:2.0:1788201430.591570:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201430.591636:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570117376 00000100:00100000:2.0:1788201430.591646:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570117376 00000100:00100000:0.0:1788201430.591759:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201430.591770:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570117248:0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.591812:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201430.591870:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201430.591891:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570117248 00000100:00100000:0.0:1788201430.591903:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570117248 00000100:00100000:0.0:1788201430.591949:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788201430.591961:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570117248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.592038:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570117248:12345-0@lo:400:kworker.0 Request processed in 65us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201430.592046:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1788201430.592070:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201430.592102:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba43aa00 x1875064570117248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201430.592119:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570117248:0@lo:400:kworker.0 00000100:00100000:2.0:1788201430.592500:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788201430.592512:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570117376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201430.592625:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570117376:12345-0@lo:400:kworker.0 Request processed in 117us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201430.592632:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788201430.596994:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570117376:0@lo:400:kworker.0 00000100:00100000:2.0:1788201430.683726:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201430.683864:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559588992 00000100:00100000:1.0:1788201430.683877:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559588992 00002000:00100000:1.0:1788201430.683952:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (8392704->9441279) req@ffff9624ba43a300 x1875064559588992/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:551/0 lens 488/0 e 0 to 0 dl 1788201441 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201430.683965:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43a300 with x1875064559588992 ext(8392704->9441279) 00002000:00010000:1.0:1788201430.683971:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43a300 00000100:00100000:1.0:1788201430.684031:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 48 00000100:00100000:1.0:1788201430.684043:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+25:2343:x1875064559588992:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201430.729450:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+27:2343:x1875064559588992:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 45388us (45721us total) trans 25769803789 rc 0/0 00000100:00100000:3.0:1788201430.729470:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 48 00002000:00100000:3.0:1788201430.729491:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (8392704->9441279) req@ffff9624ba43a300 x1875064559588992/t25769803789(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:551/0 lens 488/448 e 0 to 0 dl 1788201441 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201430.729505:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43a300 with x1875064559588992 ext(8392704->9441279) 00002000:00010000:3.0:1788201430.729515:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43a300 00000100:00100000:1.0:1788201430.837877:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201430.837932:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201430.837985:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201430.838095:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559589248 00000100:00100000:0.0:1788201430.838108:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559589248 00000100:00100000:2.0:1788201430.838141:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559589376 00000100:00100000:2.0:1788201430.838146:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559589376 00000100:00100000:2.0:1788201430.838198:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 187 00000100:00100000:2.0:1788201430.838211:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559589376:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201430.838225:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559589120 00000100:00100000:3.0:1788201430.838230:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559589120 00000100:00100000:3.0:1788201430.838263:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 467 00000100:00100000:3.0:1788201430.838269:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559589120:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201430.838314:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559589376:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 106us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201430.838334:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 187 00000100:00080000:1.0:1788201430.838335:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201430.838379:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201430.844099:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 296 00000100:00100000:0.0:1788201430.844136:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559589248:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201430.847019:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559589120:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 8729us (9138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201430.847041:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 467 00010000:00010000:1.0:1788201430.847390:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201430.851553:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559589248:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 7405us (13589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201430.851575:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 296 00000100:00100000:2.0:1788201431.056945:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201431.057152:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559589504 00000100:00100000:1.0:1788201431.057165:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559589504 00000100:00080000:0.0:1788201431.057249:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1788201431.057261:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (9441280->10489855) req@ffff9624ba439180 x1875064559589504/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:552/0 lens 488/0 e 0 to 0 dl 1788201442 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201431.057275:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba439180 with x1875064559589504 ext(9441280->10489855) 00002000:00010000:1.0:1788201431.057282:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba439180 00000100:00100000:1.0:1788201431.057382:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:1.0:1788201431.057395:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+27:2341:x1875064559589504:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201431.088643:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+29:2341:x1875064559589504:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31228us (31690us total) trans 25769803790 rc 0/0 00000100:00100000:1.0:1788201431.088664:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 49 00002000:00100000:1.0:1788201431.088685:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (9441280->10489855) req@ffff9624ba439180 x1875064559589504/t25769803790(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:552/0 lens 488/448 e 0 to 0 dl 1788201442 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201431.088699:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba439180 with x1875064559589504 ext(9441280->10489855) 00002000:00010000:1.0:1788201431.088706:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba439180 00000100:00100000:2.0:1788201431.431566:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201431.431708:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559589632 00000100:00100000:0.0:1788201431.431722:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559589632 00002000:00100000:0.0:1788201431.431790:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (10489856->11538431) req@ffff9624ba43aa00 x1875064559589632/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:552/0 lens 488/0 e 0 to 0 dl 1788201442 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201431.431803:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43aa00 with x1875064559589632 ext(10489856->11538431) 00002000:00010000:0.0:1788201431.431809:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43aa00 00000100:00100000:0.0:1788201431.431859:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 50 00000100:00100000:0.0:1788201431.431871:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+29:2343:x1875064559589632:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201431.469019:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+31:2343:x1875064559589632:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37131us (37450us total) trans 25769803791 rc 0/0 00000100:00100000:1.0:1788201431.469040:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 50 00002000:00100000:1.0:1788201431.469059:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (10489856->11538431) req@ffff9624ba43aa00 x1875064559589632/t25769803791(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:552/0 lens 488/448 e 0 to 0 dl 1788201442 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201431.469072:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43aa00 with x1875064559589632 ext(10489856->11538431) 00002000:00010000:1.0:1788201431.469080:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43aa00 00000100:00100000:0.0:1788201431.608572:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201431.608607:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570117504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201431.608710:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201431.611283:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570117504 00000100:00100000:1.0:1788201431.611304:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570117504 00000100:00100000:1.0:1788201431.611421:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788201431.611435:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570117504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201431.611490:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201431.611643:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570117504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 213us (2933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201431.611651:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00010000:00080000:0.0:1788201431.611993:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9f68000 x1875064570117504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201431.612020:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570117504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201431.805474:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201431.805642:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559589760 00000100:00100000:1.0:1788201431.805655:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559589760 00002000:00100000:1.0:1788201431.805727:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (11538432->12587007) req@ffff9624ba43b100 x1875064559589760/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:552/0 lens 488/0 e 0 to 0 dl 1788201442 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201431.805741:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43b100 with x1875064559589760 ext(11538432->12587007) 00002000:00010000:1.0:1788201431.805748:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43b100 00000100:00100000:1.0:1788201431.805854:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:1.0:1788201431.805865:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+31:2343:x1875064559589760:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201431.843487:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+33:2343:x1875064559589760:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37604us (38008us total) trans 25769803792 rc 0/0 00000100:00100000:1.0:1788201431.843529:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 51 00002000:00100000:1.0:1788201431.843551:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (11538432->12587007) req@ffff9624ba43b100 x1875064559589760/t25769803792(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:552/0 lens 488/448 e 0 to 0 dl 1788201442 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201431.843563:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43b100 with x1875064559589760 ext(11538432->12587007) 00002000:00010000:1.0:1788201431.843571:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43b100 00010000:00010000:0.0:1788201431.862690:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201432.068887:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201432.068971:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559589888 00000100:00100000:3.0:1788201432.068981:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559589888 00002000:00100000:3.0:1788201432.069034:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (12587008->13635583) req@ffff9624ba438a80 x1875064559589888/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:553/0 lens 488/0 e 0 to 0 dl 1788201443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201432.069065:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba438a80 with x1875064559589888 ext(12587008->13635583) 00002000:00010000:3.0:1788201432.069071:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba438a80 00000100:00100000:3.0:1788201432.069101:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 52 00000100:00100000:3.0:1788201432.069109:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+33:2342:x1875064559589888:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201432.120740:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201432.120771:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570117632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201432.120871:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201432.120962:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570117632 00000100:00100000:0.0:1788201432.120973:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570117632 00000100:00100000:0.0:1788201432.121061:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788201432.121072:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875064570117632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201432.121102:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 90767360 pending 46006272 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201432.121153:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875064570117632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201432.121160:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1788201432.121186:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201432.121232:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570117632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201432.123528:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+35:2342:x1875064559589888:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 54387us (54619us total) trans 25769803793 rc 0/0 00000100:00100000:3.0:1788201432.123552:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 52 00002000:00100000:3.0:1788201432.123576:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (12587008->13635583) req@ffff9624ba438a80 x1875064559589888/t25769803793(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:553/0 lens 488/448 e 0 to 0 dl 1788201443 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201432.123593:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba438a80 with x1875064559589888 ext(12587008->13635583) 00002000:00010000:3.0:1788201432.123602:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba438a80 00000001:00080000:2.0:1788201432.281029:0:18319:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 25769803781 is committed 00000001:00080000:2.0:1788201432.281051:0:18319:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 25769803779 is committed 00000001:00080000:2.0:1788201432.281062:0:18319:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 25769803792 is committed 00000001:00080000:2.0:1788201432.281104:0:18319:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 25769803793 is committed 00000100:00100000:1.0:1788201432.309705:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201432.326311:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559590016 00000100:00100000:0.0:1788201432.326333:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559590016 00002000:00100000:1.0:1788201432.327712:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (13635584->14684159) req@ffff9624b9f68e00 x1875064559590016/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:553/0 lens 488/0 e 0 to 0 dl 1788201443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201432.327730:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68e00 with x1875064559590016 ext(13635584->14684159) 00002000:00010000:1.0:1788201432.327739:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68e00 00000100:00100000:1.0:1788201432.327819:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:1.0:1788201432.327847:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559590016:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201432.401634:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559590016:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 73772us (91927us total) trans 25769803794 rc 0/0 00000100:00100000:2.0:1788201432.401675:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 53 00002000:00100000:2.0:1788201432.401696:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (13635584->14684159) req@ffff9624b9f68e00 x1875064559590016/t25769803794(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:553/0 lens 488/448 e 0 to 0 dl 1788201443 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201432.401709:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68e00 with x1875064559590016 ext(13635584->14684159) 00002000:00010000:2.0:1788201432.401717:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68e00 00000100:00100000:1.0:1788201432.617915:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201432.619397:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559590144 00000100:00100000:0.0:1788201432.619416:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559590144 00002000:00100000:0.0:1788201432.619495:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (14684160->15732735) req@ffff9624b9f6a680 x1875064559590144/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:553/0 lens 488/0 e 0 to 0 dl 1788201443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201432.619543:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6a680 with x1875064559590144 ext(14684160->15732735) 00002000:00010000:0.0:1788201432.619550:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6a680 00000100:00100000:0.0:1788201432.619595:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00100000:0.0:1788201432.619606:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559590144:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201432.649479:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559590144:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29856us (31559us total) trans 25769803795 rc 0/0 00000100:00100000:0.0:1788201432.649499:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 54 00002000:00100000:0.0:1788201432.662534:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (14684160->15732735) req@ffff9624b9f6a680 x1875064559590144/t25769803795(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:553/0 lens 488/448 e 0 to 0 dl 1788201443 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201432.662558:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6a680 with x1875064559590144 ext(14684160->15732735) 00002000:00010000:0.0:1788201432.662568:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6a680 00010000:00010000:2.0:1788201432.887482:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201432.898793:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201432.898972:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559590272 00000100:00100000:1.0:1788201432.899008:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559590272 00002000:00100000:1.0:1788201432.899085:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (15732736->16781311) req@ffff9624bb8b9180 x1875064559590272/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:553/0 lens 488/0 e 0 to 0 dl 1788201443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201432.899098:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b9180 with x1875064559590272 ext(15732736->16781311) 00002000:00010000:1.0:1788201432.899105:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b9180 00000100:00100000:1.0:1788201432.899154:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:1.0:1788201432.899167:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559590272:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201432.926307:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559590272:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27111us (27500us total) trans 25769803796 rc 0/0 00000100:00100000:2.0:1788201432.926333:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 55 00002000:00100000:2.0:1788201432.926379:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (15732736->16781311) req@ffff9624bb8b9180 x1875064559590272/t25769803796(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:553/0 lens 488/448 e 0 to 0 dl 1788201443 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201432.926392:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b9180 with x1875064559590272 ext(15732736->16781311) 00002000:00010000:2.0:1788201432.926400:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b9180 00000100:00100000:3.0:1788201433.184653:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201433.185021:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559590400 00000100:00100000:1.0:1788201433.185037:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559590400 00002000:00100000:1.0:1788201433.185138:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (16781312->17829887) req@ffff9624bb8b8000 x1875064559590400/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:554/0 lens 488/0 e 0 to 0 dl 1788201444 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201433.185151:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b8000 with x1875064559590400 ext(16781312->17829887) 00002000:00010000:1.0:1788201433.185159:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b8000 00000100:00100000:1.0:1788201433.185208:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:1.0:1788201433.185221:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559590400:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201433.186440:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201433.217273:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559590400:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32038us (32623us total) trans 25769803797 rc 0/0 00000100:00100000:1.0:1788201433.217293:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 56 00002000:00100000:1.0:1788201433.217311:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (16781312->17829887) req@ffff9624bb8b8000 x1875064559590400/t25769803797(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:554/0 lens 488/448 e 0 to 0 dl 1788201444 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201433.217324:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b8000 with x1875064559590400 ext(16781312->17829887) 00002000:00010000:1.0:1788201433.217335:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b8000 00000100:00100000:3.0:1788201433.475336:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201433.475470:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559590528 00000100:00100000:2.0:1788201433.475484:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559590528 00002000:00100000:2.0:1788201433.475568:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (17829888->18878463) req@ffff9624bb8b9c00 x1875064559590528/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:554/0 lens 488/0 e 0 to 0 dl 1788201444 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201433.475581:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b9c00 with x1875064559590528 ext(17829888->18878463) 00002000:00010000:2.0:1788201433.475587:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b9c00 00000100:00100000:2.0:1788201433.475632:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:2.0:1788201433.475644:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559590528:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201433.517606:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559590528:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 41945us (42266us total) trans 25769803798 rc 0/0 00000100:00100000:1.0:1788201433.517644:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 57 00002000:00100000:1.0:1788201433.517664:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (17829888->18878463) req@ffff9624bb8b9c00 x1875064559590528/t25769803798(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:554/0 lens 488/448 e 0 to 0 dl 1788201444 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201433.517677:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b9c00 with x1875064559590528 ext(17829888->18878463) 00002000:00010000:1.0:1788201433.517686:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b9c00 00000100:00100000:3.0:1788201433.804241:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201433.806075:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559590656 00000100:00100000:0.0:1788201433.806094:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559590656 00002000:00100000:0.0:1788201433.806176:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (18878464->19927039) req@ffff9624ba85b100 x1875064559590656/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:554/0 lens 488/0 e 0 to 0 dl 1788201444 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201433.806189:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85b100 with x1875064559590656 ext(18878464->19927039) 00002000:00010000:0.0:1788201433.806197:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85b100 00000100:00100000:0.0:1788201433.806253:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:0.0:1788201433.806267:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559590656:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201433.850040:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559590656:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 43756us (45795us total) trans 25769803799 rc 0/0 00000100:00100000:1.0:1788201433.850060:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 58 00002000:00100000:1.0:1788201433.850079:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (18878464->19927039) req@ffff9624ba85b100 x1875064559590656/t25769803799(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:554/0 lens 488/448 e 0 to 0 dl 1788201444 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201433.850093:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85b100 with x1875064559590656 ext(18878464->19927039) 00002000:00010000:1.0:1788201433.850101:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85b100 00010000:00010000:1.0:1788201433.913903:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201434.165667:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201434.165781:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559590784 00000100:00100000:1.0:1788201434.165806:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559590784 00002000:00100000:1.0:1788201434.165875:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (19927040->20975615) req@ffff962492c26300 x1875064559590784/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:555/0 lens 488/0 e 0 to 0 dl 1788201445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201434.165887:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c26300 with x1875064559590784 ext(19927040->20975615) 00002000:00010000:1.0:1788201434.165893:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c26300 00000100:00100000:1.0:1788201434.165932:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:1.0:1788201434.165943:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559590784:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201434.197279:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559590784:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31312us (31601us total) trans 25769803800 rc 0/0 00000100:00100000:1.0:1788201434.197319:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 59 00002000:00100000:1.0:1788201434.197359:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (19927040->20975615) req@ffff962492c26300 x1875064559590784/t25769803800(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:555/0 lens 488/448 e 0 to 0 dl 1788201445 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201434.197372:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c26300 with x1875064559590784 ext(19927040->20975615) 00002000:00010000:1.0:1788201434.197380:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c26300 00000100:00100000:0.0:1788201434.467500:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201434.468632:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559590912 00000100:00100000:1.0:1788201434.468650:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559590912 00002000:00100000:1.0:1788201434.468728:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (20975616->22024191) req@ffff962492c24a80 x1875064559590912/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:555/0 lens 488/0 e 0 to 0 dl 1788201445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201434.468741:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c24a80 with x1875064559590912 ext(20975616->22024191) 00002000:00010000:1.0:1788201434.468748:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c24a80 00000100:00100000:1.0:1788201434.468970:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:1.0:1788201434.468984:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559590912:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201434.528738:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559590912:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 59736us (61253us total) trans 25769803801 rc 0/0 00000100:00100000:1.0:1788201434.528760:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 60 00002000:00100000:1.0:1788201434.528780:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (20975616->22024191) req@ffff962492c24a80 x1875064559590912/t25769803801(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:555/0 lens 488/448 e 0 to 0 dl 1788201445 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201434.528794:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c24a80 with x1875064559590912 ext(20975616->22024191) 00002000:00010000:1.0:1788201434.528803:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c24a80 00000100:00100000:2.0:1788201434.766141:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201434.766491:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559591040 00000100:00100000:1.0:1788201434.766504:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559591040 00002000:00100000:1.0:1788201434.766569:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (22024192->23072767) req@ffff9624ba43bb80 x1875064559591040/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:555/0 lens 488/0 e 0 to 0 dl 1788201445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201434.766588:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43bb80 with x1875064559591040 ext(22024192->23072767) 00002000:00010000:1.0:1788201434.766595:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43bb80 00000100:00100000:1.0:1788201434.766636:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:1.0:1788201434.766647:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559591040:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201434.787449:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559591040:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20783us (21317us total) trans 25769803802 rc 0/0 00000100:00100000:1.0:1788201434.787479:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 61 00002000:00100000:1.0:1788201434.787502:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (22024192->23072767) req@ffff9624ba43bb80 x1875064559591040/t25769803802(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:555/0 lens 488/448 e 0 to 0 dl 1788201445 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201434.787514:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43bb80 with x1875064559591040 ext(22024192->23072767) 00002000:00010000:1.0:1788201434.787522:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43bb80 00010000:00010000:0.0:1788201434.935029:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201435.112816:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201435.114678:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559591168 00000100:00100000:0.0:1788201435.114701:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559591168 00002000:00100000:0.0:1788201435.114964:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (23072768->24121343) req@ffff9624ba85a680 x1875064559591168/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:556/0 lens 488/0 e 0 to 0 dl 1788201446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201435.114978:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85a680 with x1875064559591168 ext(23072768->24121343) 00002000:00010000:0.0:1788201435.114985:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85a680 00000100:00100000:0.0:1788201435.115115:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:0.0:1788201435.115129:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559591168:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201435.115922:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201435.154518:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559591168:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39371us (41772us total) trans 25769803803 rc 0/0 00000100:00100000:0.0:1788201435.154539:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 62 00002000:00100000:0.0:1788201435.154559:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (23072768->24121343) req@ffff9624ba85a680 x1875064559591168/t25769803803(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:556/0 lens 488/448 e 0 to 0 dl 1788201446 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201435.154572:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85a680 with x1875064559591168 ext(23072768->24121343) 00002000:00010000:0.0:1788201435.154580:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85a680 00000100:00100000:2.0:1788201435.451894:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201435.452030:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559591296 00000100:00100000:1.0:1788201435.452043:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559591296 00002000:00100000:1.0:1788201435.452117:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (24121344->25169919) req@ffff9624ba439880 x1875064559591296/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:556/0 lens 488/0 e 0 to 0 dl 1788201446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201435.452132:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba439880 with x1875064559591296 ext(24121344->25169919) 00002000:00010000:1.0:1788201435.452140:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba439880 00000100:00100000:1.0:1788201435.452180:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:1.0:1788201435.452191:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559591296:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201435.483088:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559591296:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30882us (31193us total) trans 25769803804 rc 0/0 00000100:00100000:0.0:1788201435.483108:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 63 00002000:00100000:0.0:1788201435.483128:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (24121344->25169919) req@ffff9624ba439880 x1875064559591296/t25769803804(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:556/0 lens 488/448 e 0 to 0 dl 1788201446 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201435.483140:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba439880 with x1875064559591296 ext(24121344->25169919) 00002000:00010000:0.0:1788201435.483147:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba439880 00000100:00100000:3.0:1788201435.704571:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570118016:0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.704673:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.704751:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201435.704758:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570117888:0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.704802:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201435.704822:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570118400:0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.704875:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201435.705092:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570117888 00000100:00100000:2.0:1788201435.705103:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570117888 00000100:00100000:2.0:1788201435.705177:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570118400 00000100:00100000:2.0:1788201435.705181:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570118400 00000100:00100000:2.0:1788201435.705226:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788201435.705250:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570117888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201435.705324:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570117888:12345-0@lo:400:kworker.0 Request processed in 87us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201435.705332:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788201435.705375:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788201435.705384:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570118400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201435.705414:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570118400:12345-0@lo:400:kworker.0 Request processed in 33us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201435.705421:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:2.0:1788201435.705441:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201435.705492:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570117888:0@lo:400:kworker.0 00000100:00100000:2.0:1788201435.705505:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570118400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201435.705844:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570118144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201435.705890:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201435.705924:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201435.705943:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570117760:0@lo:400:kworker.0 00000100:00100000:1.0:1788201435.705981:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201435.706020:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570118272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201435.706047:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201435.706081:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570118016 00000100:00100000:1.0:1788201435.706086:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570118016 00000100:00100000:1.0:1788201435.706130:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570118272 00000100:00100000:1.0:1788201435.706133:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570118272 00000100:00100000:1.0:1788201435.706170:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788201435.706179:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570118016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201435.706244:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570118016:12345-0@lo:400:kworker.0 Request processed in 56us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201435.706252:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788201435.706267:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788201435.706274:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570118272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201435.706330:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570118272:12345-0@lo:400:kworker.0 Request processed in 56us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201435.706337:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:1.0:1788201435.706395:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201435.706399:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788201435.706422:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c87ea00 x1875064570118272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201435.706435:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570118272:0@lo:400:kworker.0 00000100:00100000:0.0:1788201435.706737:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570118144 00000100:00100000:0.0:1788201435.706743:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570118144 00000100:00100000:0.0:1788201435.706805:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788201435.706813:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570118144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201435.706864:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570118144:12345-0@lo:400:kworker.0 Request processed in 53us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.706870:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788201435.706908:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570118144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.708395:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570117760 00000100:00100000:3.0:1788201435.708409:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570117760 00000100:00100000:3.0:1788201435.708489:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1788201435.708501:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570117760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.708597:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570117760:12345-0@lo:400:kworker.0 Request processed in 98us (2615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201435.708602:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:0.0:1788201435.708743:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570117760:0@lo:400:kworker.0 00000100:00100000:2.0:1788201435.709410:0:3283:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803779 gen 2 00000004:00080000:2.0:1788201435.709419:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9624ba114700, transno 25769803779 00000100:00100000:2.0:1788201435.709441:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570118016:0@lo:400:kworker.0 00000100:00080000:1.0:1788201435.709657:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201435.834524:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201435.834831:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559591424 00000100:00100000:1.0:1788201435.834846:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559591424 00002000:00100000:1.0:1788201435.834944:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (25169920->26218495) req@ffff9624ba43b800 x1875064559591424/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:556/0 lens 488/0 e 0 to 0 dl 1788201446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201435.834980:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43b800 with x1875064559591424 ext(25169920->26218495) 00002000:00010000:1.0:1788201435.834988:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43b800 00000100:00100000:1.0:1788201435.835042:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 64 00000100:00100000:1.0:1788201435.835055:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559591424:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201435.902085:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559591424:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 67013us (67559us total) trans 25769803805 rc 0/0 00000100:00100000:1.0:1788201435.902105:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 64 00002000:00100000:1.0:1788201435.902126:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (25169920->26218495) req@ffff9624ba43b800 x1875064559591424/t25769803805(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:556/0 lens 488/448 e 0 to 0 dl 1788201446 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201435.902138:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43b800 with x1875064559591424 ext(25169920->26218495) 00002000:00010000:1.0:1788201435.902147:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43b800 00000100:00100000:3.0:1788201435.955090:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201435.955151:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201435.955195:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201435.955397:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559591680 00000100:00100000:0.0:1788201435.955410:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559591680 00000100:00100000:0.0:1788201435.955515:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 300 00000100:00100000:0.0:1788201435.955529:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559591680:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201435.955691:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559591680:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 164us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.955700:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 300 00000100:00100000:2.0:1788201435.955855:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559591552 00000100:00100000:2.0:1788201435.955860:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559591552 00000100:00100000:2.0:1788201435.955904:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 469 00000100:00100000:2.0:1788201435.955911:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559591552:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201435.955952:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559591552:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 41us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201435.955959:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 469 00000100:00080000:1.0:1788201435.956133:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201435.956152:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559591808 00000100:00100000:1.0:1788201435.956156:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559591808 00000100:00100000:1.0:1788201435.956218:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 190 00000100:00100000:1.0:1788201435.956227:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559591808:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201435.956272:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559591808:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 46us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201435.956279:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 190 00000100:00080000:2.0:1788201435.956786:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201435.958883:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201436.243883:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201436.244108:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559591936 00000100:00100000:1.0:1788201436.244122:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559591936 00002000:00100000:1.0:1788201436.244197:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (26218496->27267071) req@ffff9624b9c41500 x1875064559591936/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:557/0 lens 488/0 e 0 to 0 dl 1788201447 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201436.244248:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c41500 with x1875064559591936 ext(26218496->27267071) 00002000:00010000:1.0:1788201436.244256:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c41500 00000100:00100000:1.0:1788201436.244300:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 65 00000100:00100000:1.0:1788201436.244313:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559591936:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201436.290295:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559591936:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 45907us (46351us total) trans 25769803806 rc 0/0 00000100:00100000:3.0:1788201436.290315:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 65 00002000:00100000:3.0:1788201436.290334:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (26218496->27267071) req@ffff9624b9c41500 x1875064559591936/t25769803806(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:557/0 lens 488/448 e 0 to 0 dl 1788201447 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201436.290363:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c41500 with x1875064559591936 ext(26218496->27267071) 00002000:00010000:3.0:1788201436.290371:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c41500 00000100:00100000:0.0:1788201436.535306:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201436.538077:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559592064 00000100:00100000:1.0:1788201436.538101:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559592064 00002000:00100000:1.0:1788201436.538187:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (27267072->28315647) req@ffff962492c24700 x1875064559592064/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:557/0 lens 488/0 e 0 to 0 dl 1788201447 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201436.538203:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c24700 with x1875064559592064 ext(27267072->28315647) 00002000:00010000:1.0:1788201436.538210:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c24700 00000100:00100000:1.0:1788201436.538266:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 66 00000100:00100000:1.0:1788201436.538279:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559592064:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201436.562254:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559592064:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23960us (27021us total) trans 25769803807 rc 0/0 00000100:00100000:1.0:1788201436.562273:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 66 00002000:00100000:1.0:1788201436.562289:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (27267072->28315647) req@ffff962492c24700 x1875064559592064/t25769803807(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:557/0 lens 488/448 e 0 to 0 dl 1788201447 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201436.562301:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c24700 with x1875064559592064 ext(27267072->28315647) 00002000:00010000:1.0:1788201436.562309:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c24700 00000100:00100000:3.0:1788201436.727072:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570118528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201436.727181:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201436.727730:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570118528 00000100:00100000:1.0:1788201436.727743:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570118528 00000100:00100000:1.0:1788201436.727815:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788201436.727827:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570118528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201436.727891:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201436.727962:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570118528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201436.727971:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00010000:00080000:3.0:1788201436.728105:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9f6b100 x1875064570118528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201436.728130:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570118528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201436.779963:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201436.780182:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559592192 00000100:00100000:2.0:1788201436.780196:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559592192 00002000:00100000:2.0:1788201436.780276:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (28315648->29364223) req@ffff962492cb9180 x1875064559592192/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:557/0 lens 488/0 e 0 to 0 dl 1788201447 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201436.780288:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb9180 with x1875064559592192 ext(28315648->29364223) 00002000:00010000:2.0:1788201436.780296:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb9180 00000100:00100000:2.0:1788201436.780335:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 67 00000100:00100000:2.0:1788201436.780381:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559592192:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201436.827863:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559592192:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 47460us (47893us total) trans 25769803808 rc 0/0 00000100:00100000:0.0:1788201436.827891:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 67 00002000:00100000:0.0:1788201436.827930:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (28315648->29364223) req@ffff962492cb9180 x1875064559592192/t25769803808(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:557/0 lens 488/448 e 0 to 0 dl 1788201447 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201436.827944:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb9180 with x1875064559592192 ext(28315648->29364223) 00002000:00010000:0.0:1788201436.827953:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb9180 00010000:00010000:2.0:1788201436.982629:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201437.073287:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201437.073591:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559592320 00000100:00100000:2.0:1788201437.073605:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559592320 00002000:00100000:2.0:1788201437.073688:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (29364224->30412799) req@ffff962492cb8700 x1875064559592320/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:558/0 lens 488/0 e 0 to 0 dl 1788201448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201437.073701:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb8700 with x1875064559592320 ext(29364224->30412799) 00002000:00010000:2.0:1788201437.073708:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb8700 00000100:00100000:2.0:1788201437.073743:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 68 00000100:00100000:2.0:1788201437.073756:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559592320:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201437.075333:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201437.115553:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559592320:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 41775us (42256us total) trans 25769803809 rc 0/0 00000100:00100000:0.0:1788201437.115597:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 68 00002000:00100000:0.0:1788201437.115624:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (29364224->30412799) req@ffff962492cb8700 x1875064559592320/t25769803809(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:558/0 lens 488/448 e 0 to 0 dl 1788201448 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201437.115638:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb8700 with x1875064559592320 ext(29364224->30412799) 00002000:00010000:0.0:1788201437.115649:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb8700 00000100:00100000:1.0:1788201437.238815:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201437.238850:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570118656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201437.238966:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201437.239073:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570118656 00000100:00100000:1.0:1788201437.239084:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570118656 00000100:00100000:1.0:1788201437.239163:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788201437.239174:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570118656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201437.239204:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 99287040 pending 54525952 free 3845128192 avail 3843031040 00000100:00100000:1.0:1788201437.239642:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570118656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 468us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201437.239651:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1788201437.239679:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201437.240503:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570118656:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788201437.386267:0:18319:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 25769803808 is committed 00000001:00080000:1.0:1788201437.386312:0:18319:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 25769803809 is committed 00000100:00100000:1.0:1788201437.401864:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201437.401983:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559592448 00000100:00100000:3.0:1788201437.401993:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559592448 00002000:00100000:3.0:1788201437.402050:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (30412800->31461375) req@ffff9624b9f6bb80 x1875064559592448/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:558/0 lens 488/0 e 0 to 0 dl 1788201448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201437.402062:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6bb80 with x1875064559592448 ext(30412800->31461375) 00002000:00010000:3.0:1788201437.402069:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6bb80 00000100:00100000:3.0:1788201437.402106:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 69 00000100:00100000:3.0:1788201437.402117:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559592448:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201437.439056:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559592448:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36927us (37184us total) trans 25769803810 rc 0/0 00000100:00100000:1.0:1788201437.439072:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 69 00002000:00100000:1.0:1788201437.439088:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (30412800->31461375) req@ffff9624b9f6bb80 x1875064559592448/t25769803810(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:558/0 lens 488/448 e 0 to 0 dl 1788201448 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201437.439099:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6bb80 with x1875064559592448 ext(30412800->31461375) 00002000:00010000:1.0:1788201437.439106:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6bb80 00000100:00100000:1.0:1788201437.697024:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201437.697099:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559592576 00000100:00100000:3.0:1788201437.697110:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559592576 00002000:00100000:3.0:1788201437.697162:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (31461376->32509951) req@ffff9624b9f6b100 x1875064559592576/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:558/0 lens 488/0 e 0 to 0 dl 1788201448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201437.697173:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6b100 with x1875064559592576 ext(31461376->32509951) 00002000:00010000:3.0:1788201437.697178:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6b100 00000100:00100000:3.0:1788201437.697220:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00100000:3.0:1788201437.697229:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559592576:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201437.718006:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559592576:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20767us (20986us total) trans 25769803811 rc 0/0 00000100:00100000:3.0:1788201437.718021:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 70 00002000:00100000:3.0:1788201437.718036:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (31461376->32509951) req@ffff9624b9f6b100 x1875064559592576/t25769803811(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:558/0 lens 488/448 e 0 to 0 dl 1788201448 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201437.718047:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6b100 with x1875064559592576 ext(31461376->32509951) 00002000:00010000:3.0:1788201437.718055:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6b100 00000020:01000004:2.0:1788201437.853590:0:19233:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788201437.853656:0:19233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.853671:0:19233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.853678:0:19233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.853685:0:19233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.853762:0:19233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201437.853768:0:19233:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788201437.853791:0:19233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201437.853795:0:19233:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201437.853801:0:19233:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201437.853827:0:19233:0:(import.c:65:import_set_state_nolock()) ffff9624bc8f1800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788201437.856176:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570118784:0@lo:39:umount.0 00000100:00100000:3.0:1788201437.856282:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201437.856661:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570118784 00000100:00100000:2.0:1788201437.856669:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570118784 00000100:00100000:2.0:1788201437.856736:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788201437.856746:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875064570118784:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201437.856776:0:5825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb585 00000100:00080000:2.0:1788201437.856785:0:5825:0:(import.c:65:import_set_state_nolock()) ffff962382b0c000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788201437.856824:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788201437.863426:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201437.863444:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.863458:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4de000 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201437.863462:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.863473:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201437.863481:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201437.863487:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201437.863490:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788201437.863494:0:5813:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788201437.863547:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.863554:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201437.863598:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.863605:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624ba4de000/0xa81c4c9a2f3cb569 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb570 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.863622:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201437.863624:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201437.863626:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201437.863657:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201437.863679:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570118912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201437.863747:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201437.863808:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570118912 00000100:00100000:1.0:1788201437.863816:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570118912 00000100:00100000:1.0:1788201437.863864:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201437.863872:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570118912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201437.863884:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201437.863913:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96248e27ea00/0xa81c4c9a2f3cb570 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb569 expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.863925:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201437.863957:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3284:x1875064570118912:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201437.863964:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201437.867058:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570118912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201437.870303:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+1:3281:x1875064570118784:12345-0@lo:39:umount.0 Request processed in 13549us (14011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201437.870318:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000020:00000080:2.0:1788201437.870334:0:5825:0:(genops.c:906:class_export_put()) final put ffff962382b0c800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:2.0:1788201437.870525:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201437.870658:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9624bc8f1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788201437.870672:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570118784:0@lo:39:umount.0 00000100:00080000:2.0:1788201437.870702:0:19233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201437.870706:0:19233:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201437.870711:0:19233:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201437.873772:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff962382b0c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788201437.873850:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff962382b0c000 for lustre-MDT0000 00010000:00010000:2.0:1788201437.874987:0:19233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.875080:0:19233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.875088:0:19233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.875094:0:19233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.875118:0:19233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201437.875125:0:19233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.875131:0:19233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.875136:0:19233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.875142:0:19233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.875171:0:19233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788201437.875176:0:19233:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788201437.875332:0:19233:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788201437.875336:0:19233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:2.0:1788201437.875363:0:19233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788201437.875370:0:19233:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:1.0:1788201437.878271:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201437.878287:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.878299:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df000 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201437.878302:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.878312:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201437.878320:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201437.878365:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201437.878368:0:5814:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788201437.878371:0:5814:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788201437.878431:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.878438:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201437.878467:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.878474:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624ba4df000/0xa81c4c9a2f3cb531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb538 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.878490:0:5814:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201437.878493:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.878498:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df800 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:1.0:1788201437.878501:0:5814:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.878507:0:5814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201437.878513:0:5814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201437.878519:0:5814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788201437.878521:0:5814:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788201437.878528:0:5814:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788201437.878541:0:5814:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.878547:0:5814:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201437.878553:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.878559:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624ba4df800/0xa81c4c9a2f3cb55b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa81c4c9a2f3cb562 expref: -99 pid: 18232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.878568:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201437.878570:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201437.878571:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201437.878589:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570119168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201437.878652:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201437.878705:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201437.878710:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570119040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201437.878734:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201437.878764:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570119168 00000100:00100000:1.0:1788201437.878771:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570119168 00000100:00100000:1.0:1788201437.878808:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570119040 00000100:00100000:1.0:1788201437.878810:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570119040 00000100:00100000:1.0:1788201437.878828:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201437.878836:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570119168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201437.878850:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201437.878864:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96248e27e200/0xa81c4c9a2f3cb562 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb55b expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.878876:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201437.878927:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3283:x1875064570119168:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201437.878935:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201437.878950:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201437.878955:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:3283:x1875064570119040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201437.878962:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201437.878972:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96248e27f800/0xa81c4c9a2f3cb538 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb531 expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201437.878981:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201437.879200:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3283:x1875064570119040:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201437.879207:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201437.879251:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570119040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201437.879261:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570119168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201437.879285:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000080:2.0:1788201437.884813:0:19233:0:(ofd_obd.c:1269:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:2.0:1788201437.884864:0:19233:0:(ofd_obd.c:1283:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:1.0:1788201437.973553:0:18319:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 25769803810 is committed 00000001:00080000:1.0:1788201437.973582:0:18319:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 25769803811 is committed 00000020:00000080:1.0:1788201437.994971:0:19233:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788201437.994995:0:19233:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff96248591e000 986744c8-ee81-4a47-8d91-97f81ede1f3e 192.168.201.56@tcp 5 (0 0 1) 0 0 0 0: 0000000000000000 25769803811 stale:0 00000020:00080000:1.0:1788201437.995175:0:19233:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff962485918000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 25769803779 stale:0 00000020:00080000:1.0:1788201437.995180:0:19233:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff962487eb3380) has exports, disconnecting them 00000020:00080000:1.0:1788201437.995186:0:19233:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.201.56@tcp (ffff96248591e000), last request at 1788201437 00000020:00000080:1.0:1788201437.995213:0:19233:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb554 00000020:00010000:1.0:1788201437.995223:0:19233:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96248591e000: total 0 00000100:00080000:1.0:1788201437.995228:0:19233:0:(import.c:65:import_set_state_nolock()) ffff96248c8c4000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201437.995305:0:19233:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.56@tcp (ffff96248591e000): rc 0 00000020:00080000:1.0:1788201437.995309:0:19233:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff962485918000), last request at 1788201437 00000020:00000080:1.0:1788201437.995320:0:19233:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb54d 00000100:00080000:1.0:1788201437.995326:0:19233:0:(import.c:65:import_set_state_nolock()) ffff962490145000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788201437.995577:0:16319:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96248591e000: total 0 00010000:00010000:2.0:1788201437.995618:0:16319:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96248591e000, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1788201437.995650:0:16319:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 0 -> 32509952 00002000:00010000:2.0:1788201437.995653:0:16319:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb mtime from disk: 0 -> 1788201437 00002000:00010000:2.0:1788201437.995656:0:16319:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb ctime from disk: 0 -> 1788201437 00002000:00010000:2.0:1788201437.995659:0:16319:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 1 -> 65549 00010000:00010000:2.0:1788201437.995685:0:16319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ddba4a2/0xa81c4c9a2f3cb696 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b58 expref: 2 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201437.995708:0:16319:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96248591e000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788201437.997123:0:16319:0:(genops.c:906:class_export_put()) final put ffff96248591e000/986744c8-ee81-4a47-8d91-97f81ede1f3e 00010000:00010000:2.0:1788201437.997151:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201437.997154:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201437.997156:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201437.997172:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248591e000/986744c8-ee81-4a47-8d91-97f81ede1f3e for lustre-OST0000 00000020:00000080:2.0:1788201437.997755:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96248c8c4000 for lustre-OST0000 00010000:00010000:0.0:1788201437.997902:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788201437.998158:0:19233:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff962485918000): rc 0 00000020:00000080:1.0:1788201437.998162:0:19233:0:(genops.c:906:class_export_put()) final put ffff962485918000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:1.0:1788201437.998283:0:19233:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff962487eb3380) has no exports 00000020:00000080:2.0:1788201438.000520:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff962485918000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788201438.000589:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff962490145000 for lustre-OST0000 00000020:01000000:1.0:1788201438.004294:0:19233:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9624bfdfd060 - data ffff96248c0eb360/ffff962381146000 00000020:01000000:0.0:1788201438.004881:0:19233:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96249023d000 - data ffff962493ac35e8/ffff962381b70c00 00010000:00010000:1.0:1788201438.006697:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788201438.017663:0:19233:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788201438.058591:0:19233:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb546 00000020:00000080:2.0:1788201438.058619:0:19233:0:(genops.c:906:class_export_put()) final put ffff9624b9a30000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788201438.058638:0:19233:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9624857c4800 from lustre-OST0000, refs=2 00000020:00000080:0.0:1788201438.058668:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9624b9a30000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1788201438.059071:0:19233:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624857c4800 2 00000020:01000004:2.0:1788201438.059077:0:19233:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9624857c4800 from lustre-OST0000 00000020:00000080:2.0:1788201438.059106:0:19233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201438.059120:0:19233:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788201438.059123:0:19233:0:(genops.c:906:class_export_put()) final put ffff96248ce2c800/lustre-OST0000_UUID 00000020:00000080:2.0:1788201438.059126:0:19233:0:(genops.c:865:class_export_destroy()) destroying export ffff96248ce2c800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788201438.059135:0:19233:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788201438.059184:0:19233:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788201438.059190:0:19233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788201438.059193:0:19233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201438.059199:0:19233:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201438.059207:0:19233:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff962490143000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201438.059213:0:19233:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9624909d99c0) has exports, disconnecting them 00000020:00080000:2.0:1788201438.059217:0:19233:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff962490143000), last request at 1788201399 00000020:00000080:2.0:1788201438.059222:0:19233:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb57e 00000020:00080000:2.0:1788201438.059233:0:19233:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff962490143000): rc 0 00000020:00000080:2.0:1788201438.059238:0:19233:0:(genops.c:906:class_export_put()) final put ffff962490143000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788201438.059271:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff962490143000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788201438.066816:0:19233:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788201438.066826:0:19233:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201438.066831:0:19233:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788201438.066841:0:19233:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201438.067020:0:19233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201438.067031:0:19233:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788201438.067038:0:19233:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624857c4800 1 00000020:00000080:0.0:1788201438.067045:0:19233:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb52a 00000020:00000080:0.0:1788201438.067054:0:19233:0:(genops.c:906:class_export_put()) final put ffff962382b0a000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788201438.067060:0:19233:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788201438.067068:0:19233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201438.067073:0:19233:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201438.067076:0:19233:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff96248729cd40) has no exports 00000020:00000080:1.0:1788201438.067222:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9624bc8f1800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788201438.067230:0:8:0:(genops.c:906:class_export_put()) final put ffff96248f026800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788201438.067233:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96248f026800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788201438.067248:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788201438.067333:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff962382b0a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788201438.096978:0:19233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201438.096998:0:19233:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788201438.097012:0:19233:0:(genops.c:906:class_export_put()) final put ffff9624857c5000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788201438.097018:0:19233:0:(genops.c:865:class_export_destroy()) destroying export ffff9624857c5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788201438.097029:0:19233:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788201438.097163:0:19233:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9624857c4000 00000020:02000400:1.0:1788201438.097241:0:19233:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:0.0:1788201438.152243:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201438.152299:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559592704 00000100:00100000:0.0:1788201438.152307:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559592704 00000100:00100000:0.0:1788201438.152368:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 71 00000100:00100000:0.0:1788201438.152385:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0+-99:2341:x1875064559592704:12345-192.168.201.56@tcp:4:iozone.0 00000020:00080000:0.0:1788201438.152394:0:17700:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.201.56@tcp 00000100:00100000:0.0:1788201438.152462:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0+-99:2341:x1875064559592704:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 77us (228us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201438.152470:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 71 00000100:00100000:1.0:1788201438.205869:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201438.206109:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559592832 00000100:00100000:2.0:1788201438.206120:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559592832 00000100:00100000:2.0:1788201438.206217:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 143 00000100:00100000:2.0:1788201438.206227:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559592832:12345-192.168.201.56@tcp:8:ptlrpcd_00_00.0 00010000:00020000:2.0:1788201438.206249:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201438.206383:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875064559592832:12345-192.168.201.56@tcp:8:ptlrpcd_00_00.0 Request processed in 155us (524us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201438.206399:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 143 00010000:00010000:2.0:1788201439.033535:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201440.055287:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201440.822576:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570119552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201440.822646:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201440.822823:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570119424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.822860:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201440.822934:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788201440.822942:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570119296:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.822973:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201440.822995:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570119808:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.823027:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570119424 00000100:00100000:2.0:1788201440.823035:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570119424 00000100:00100000:2.0:1788201440.823085:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788201440.823095:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570119424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.823163:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570119424:12345-0@lo:400:kworker.0 Request processed in 69us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201440.823170:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788201440.823193:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570119296 00000100:00100000:2.0:1788201440.823197:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570119296 00000100:00100000:2.0:1788201440.823224:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1788201440.823231:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570119296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.823276:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3285:x1875064570119296:12345-0@lo:400:kworker.0 Request processed in 45us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201440.823281:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1788201440.823627:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201440.823636:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570119680:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.823826:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201440.823909:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201440.823954:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570119680 00000100:00100000:0.0:1788201440.823959:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570119680 00000100:00100000:0.0:1788201440.823998:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788201440.824008:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570119680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.824802:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570119424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.824827:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570119296:0@lo:400:kworker.0 00000100:00100000:3.0:1788201440.824938:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570119552 00000100:00100000:3.0:1788201440.824943:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570119552 00000100:00100000:3.0:1788201440.824970:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570119808 00000100:00100000:3.0:1788201440.824973:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570119808 00000100:00100000:3.0:1788201440.825007:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788201440.825016:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570119808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201440.825069:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570119808:12345-0@lo:400:kworker.0 Request processed in 54us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201440.825076:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788201440.825094:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788201440.825098:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1875064570119552:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788201440.825104:0:6671:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788201440.825136:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1875064570119552:12345-0@lo:400:kworker.0 Request processed in 36us (2489us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201440.825142:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788201440.825520:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570119680:12345-0@lo:400:kworker.0 Request processed in 1432us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201440.825530:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:3.0:1788201440.825709:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201440.825714:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201440.825739:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570119680:0@lo:400:kworker.0 00000100:00080000:3.0:1788201440.825751:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788201440.825756:0:3282:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201440.825775:0:3282:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:00080000:2.0:1788201440.827510:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962492cbb800 x1875064570119808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201440.827542:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570119808:0@lo:400:kworker.0 00000004:00080000:3.0:1788201440.834907:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1788201440.834917:0:3282:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201440.834927:0:3282:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 533 00000100:00080000:3.0:1788201440.834938:0:3282:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1788201440.834978:0:3282:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962492cba680 x1875064570119936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201440.835006:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570119552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201440.835047:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570119936:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:3.0:1788201440.835115:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201440.835180:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570119936 00000100:00100000:3.0:1788201440.835188:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570119936 00000100:00100000:3.0:1788201440.835224:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788201440.835233:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875064570119936:12345-0@lo:8:ptlrpcd_00_00.0 00010000:00020000:3.0:1788201440.835252:0:6668:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201440.835708:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875064570119936:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 472us (590us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201440.835717:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1788201440.835763:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201440.835769:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201440.835773:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570119936:0@lo:8:ptlrpcd_00_00.0 00010000:00010000:2.0:1788201441.079245:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201441.085125:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201441.085177:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201441.085211:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201441.085254:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201441.085257:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559593088 00000100:00100000:0.0:1788201441.085269:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559593088 00000100:00100000:0.0:1788201441.085382:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 303 00000100:00100000:0.0:1788201441.085393:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559593088:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201441.085474:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559593088:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 82us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201441.085478:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559592960 00000100:00100000:0.0:1788201441.085484:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 303 00000100:00100000:3.0:1788201441.085484:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559592960 00000100:00100000:3.0:1788201441.085532:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 471 00000100:00100000:3.0:1788201441.085541:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559592960:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201441.085592:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559592960:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 52us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201441.085601:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 471 00000100:00100000:3.0:1788201441.085641:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559593344 00000100:00100000:3.0:1788201441.085644:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559593344 00000100:00100000:0.0:1788201441.085726:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559593216 00000100:00100000:0.0:1788201441.085731:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559593216 00000100:00100000:0.0:1788201441.085760:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 192 00000100:00100000:0.0:1788201441.085773:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559593344:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201441.085808:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559593344:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 42us (597us total) trans 0 rc 0/0 00000100:00080000:1.0:1788201441.085857:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201441.085862:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201441.086204:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 146 00000100:00100000:3.0:1788201441.086212:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875064559593216:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:3.0:1788201441.086231:0:6671:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201441.086263:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875064559593216:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 50us (1010us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201441.086270:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 146 00000100:00100000:0.0:1788201441.095842:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 192 00000100:00100000:0.0:1788201441.851999:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201441.852022:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570120064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201441.852099:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201441.852412:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570120064 00000100:00100000:1.0:1788201441.852421:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570120064 00000100:00100000:1.0:1788201441.852474:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788201441.852484:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570120064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201441.852518:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201441.852574:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570120064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201441.852581:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00010000:00080000:3.0:1788201441.852661:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624c1e5a680 x1875064570120064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201441.852678:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570120064:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201442.107524:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201443.128108:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201444.150579:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201445.179099:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201445.942555:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570120192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201445.942761:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201445.942909:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570120320:0@lo:400:kworker.0 00000100:00100000:1.0:1788201445.942960:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201445.943009:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570120320 00000100:00100000:1.0:1788201445.943017:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570120320 00000100:00100000:1.0:1788201445.943064:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788201445.943074:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570120320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201445.943125:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570120320:12345-0@lo:400:kworker.0 Request processed in 52us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201445.943132:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788201445.943176:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570120320:0@lo:400:kworker.0 00000100:00100000:2.0:1788201445.943748:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570120192 00000100:00100000:2.0:1788201445.943756:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570120192 00000100:00100000:2.0:1788201445.943791:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1788201445.943797:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570120192:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788201445.946523:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201445.946532:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788201445.946536:0:36:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201445.946544:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 572 00000100:00080000:3.0:1788201445.946549:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201445.946556:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1788201445.946707:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962492cbad80 x1875064570120448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201445.946801:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570120576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201445.946906:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201445.946959:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201445.946966:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570120704:0@lo:400:kworker.0 00000100:00100000:3.0:1788201445.946992:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201445.947023:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570120704 00000100:00100000:3.0:1788201445.947031:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570120704 00000100:00100000:3.0:1788201445.947762:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788201445.947776:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570120704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201445.947841:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570120704:12345-0@lo:400:kworker.0 Request processed in 69us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201445.947848:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00010000:00080000:3.0:1788201445.947898:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962492cbb100 x1875064570120704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201445.947915:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570120704:0@lo:400:kworker.0 00000100:00100000:1.0:1788201445.949763:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570120448:0@lo:8:kworker.0 00000100:00100000:1.0:1788201445.949833:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201445.949893:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201445.949929:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570120576 00000100:00100000:1.0:1788201445.949936:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570120576 00000100:00100000:1.0:1788201445.950003:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788201445.950012:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570120576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201445.950232:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570120576:12345-0@lo:400:kworker.0 Request processed in 220us (3325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201445.950254:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:1.0:1788201445.950288:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201445.950749:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570120448 00000100:00100000:3.0:1788201445.950755:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570120448 00000100:00100000:3.0:1788201445.950780:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788201445.950786:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570120448:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788201445.950804:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201445.950849:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570120448:12345-0@lo:8:kworker.0 Request processed in 61us (1015us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201445.950855:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788201445.950916:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570120576:0@lo:400:kworker.0 00000100:00080000:1.0:1788201445.951627:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201445.951635:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201445.951639:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570120448:0@lo:8:kworker.0 00000100:00100000:2.0:1788201445.953825:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570120192:12345-0@lo:400:kworker.0 Request processed in 10019us (11055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201445.953941:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1788201445.954688:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570120192:0@lo:400:kworker.0 00010000:00010000:1.0:1788201446.198696:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201446.223279:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201446.223330:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201446.223406:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201446.223451:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201446.223482:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559593728 00000100:00100000:1.0:1788201446.223492:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559593728 00000100:00100000:0.0:1788201446.223500:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559593472 00000100:00100000:0.0:1788201446.223504:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559593472 00000100:00100000:1.0:1788201446.223529:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559593856 00000100:00100000:1.0:1788201446.223532:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559593856 00000100:00100000:0.0:1788201446.223542:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 473 00000100:00100000:0.0:1788201446.223551:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559593472:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201446.223563:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 194 00000100:00100000:1.0:1788201446.223569:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559593856:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201446.223631:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2342:x1875064559593856:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 61us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201446.223639:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 194 00000100:00100000:1.0:1788201446.223657:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 148 00000100:00100000:1.0:1788201446.223661:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1d5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875064559593728:12345-192.168.201.56@tcp:8:kworker.0 00000100:00100000:0.0:1788201446.223673:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559593472:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 123us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201446.223680:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 473 00010000:00020000:1.0:1788201446.223682:0:6670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201446.223704:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1d5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875064559593728:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 42us (374us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201446.223710:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 148 00000100:00080000:1.0:1788201446.223896:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201446.224208:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559593600 00000100:00100000:2.0:1788201446.224213:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559593600 00000100:00100000:2.0:1788201446.224260:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 306 00000100:00100000:2.0:1788201446.224278:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559593600:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201446.224314:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559593600:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 47us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201446.224320:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 306 00000100:00080000:1.0:1788201446.225002:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201446.968364:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201446.968390:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570120832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201446.968483:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201446.968664:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570120832 00000100:00100000:1.0:1788201446.968673:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570120832 00000100:00100000:1.0:1788201446.968731:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788201446.968741:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570120832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201446.968780:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201446.968851:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570120832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201446.968857:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00080000:3.0:1788201446.969064:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624ba43f100 x1875064570120832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201446.969106:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570120832:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201447.225235:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201448.247567:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201449.270547:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201450.296239:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201451.063512:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201451.063519:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788201451.063530:0:36:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201451.063539:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 578 00000100:00080000:3.0:1788201451.063544:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201451.063552:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1788201451.063574:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962492cb9500 x1875064570121216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201451.063623:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570121344:0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.063691:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201451.063761:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201451.063768:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570121088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.063790:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201451.063929:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570121472:0@lo:400:kworker.0 00000100:00100000:0.0:1788201451.063962:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201451.063998:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201451.064004:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570120960:0@lo:400:kworker.0 00000100:00100000:0.0:1788201451.064034:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201451.064201:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570121472 00000100:00100000:3.0:1788201451.064210:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570121472 00000100:00100000:3.0:1788201451.064283:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788201451.064292:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570121472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.064370:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570121472:12345-0@lo:400:kworker.0 Request processed in 79us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201451.064377:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00010000:00080000:3.0:1788201451.064418:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962492cbbb80 x1875064570121472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201451.064431:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570121472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.064595:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570121216:0@lo:8:kworker.0 00000100:00100000:1.0:1788201451.064625:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.064666:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570121344 00000100:00100000:1.0:1788201451.064670:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570121344 00000100:00100000:1.0:1788201451.064700:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570121088 00000100:00100000:1.0:1788201451.064703:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570121088 00000100:00100000:1.0:1788201451.064724:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788201451.064731:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570121344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.064774:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570121344:12345-0@lo:400:kworker.0 Request processed in 43us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.064780:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788201451.064793:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788201451.064799:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570121088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.064826:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570121088:12345-0@lo:400:kworker.0 Request processed in 28us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.064831:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788201451.064860:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570121216 00000100:00100000:1.0:1788201451.064864:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570121216 00000100:00100000:1.0:1788201451.064884:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788201451.064888:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570121216:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788201451.064916:0:8088:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201451.064951:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3281:x1875064570121216:12345-0@lo:8:kworker.0 Request processed in 61us (324us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201451.064957:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1788201451.064991:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201451.064996:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201451.064999:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570121216:0@lo:8:kworker.0 00000100:00100000:1.0:1788201451.065030:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570121088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.065043:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570121344:0@lo:400:kworker.0 00000100:00080000:0.0:1788201451.065237:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201451.065250:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201451.065497:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570120960 00000100:00100000:2.0:1788201451.065510:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570120960 00000100:00100000:2.0:1788201451.065550:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:2.0:1788201451.065558:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570120960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201451.065613:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3282:x1875064570120960:12345-0@lo:400:kworker.0 Request processed in 57us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201451.065619:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1788201451.065703:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570120960:0@lo:400:kworker.0 00000100:00100000:0.0:1788201451.318269:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201451.318317:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201451.318363:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201451.318559:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201451.318598:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559594240 00000100:00100000:0.0:1788201451.318607:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559594240 00000100:00100000:0.0:1788201451.318637:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559594368 00000100:00100000:0.0:1788201451.318640:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559594368 00000100:00100000:0.0:1788201451.318676:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 150 00000100:00100000:0.0:1788201451.318685:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875064559594240:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:0.0:1788201451.318706:0:6670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201451.318761:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875064559594240:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 77us (397us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201451.318769:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 150 00000100:00100000:0.0:1788201451.318784:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 151 00000100:00100000:0.0:1788201451.318790:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559594368:12345-192.168.201.56@tcp:9:kworker.0 00000020:00000080:0.0:1788201451.318814:0:6670:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb5a8 00000100:00080000:0.0:1788201451.318822:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9624ba084800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201451.318861:0:6670:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788201451.319041:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559593984 00000100:00100000:2.0:1788201451.319046:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559593984 00000100:00100000:2.0:1788201451.319077:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 475 00000100:00100000:2.0:1788201451.319084:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559593984:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201451.319116:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559593984:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 33us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201451.319123:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 475 00000100:00100000:0.0:1788201451.320427:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+2:2340:x1875064559594368:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 1626us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201451.320439:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 151 00000100:00080000:0.0:1788201451.320472:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201451.320488:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201451.321172:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559594112 00000100:00100000:0.0:1788201451.321192:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559594112 00000100:00100000:0.0:1788201451.321249:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 309 00000100:00100000:0.0:1788201451.321258:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559594112:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201451.321306:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559594112:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 49us (2988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201451.321329:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 309 00000100:00080000:0.0:1788201451.321381:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201451.325148:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201452.086644:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570121600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201452.086734:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201452.086871:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570121600 00000100:00100000:1.0:1788201452.086880:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570121600 00000100:00100000:1.0:1788201452.086938:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788201452.086949:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570121600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201452.087001:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201452.087051:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570121600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201452.087058:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00080000:1.0:1788201452.087109:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624ba43f100 x1875064570121600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201452.087127:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570121600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201452.342492:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201453.370289:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201454.390512:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201455.226730:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:1.0:1788201455.226753:0:7629:0:(genops.c:906:class_export_put()) final put ffff9624ba083800/986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:3.0:1788201455.226814:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9624ba083800/986744c8-ee81-4a47-8d91-97f81ede1f3e for lustre-OST0001 00000020:00000080:3.0:1788201455.226858:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9624ba084800 for lustre-OST0001 00010000:00010000:0.0:1788201455.414565:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201456.183590:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570121728:0@lo:400:kworker.0 00000100:00100000:2.0:1788201456.183667:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201456.185157:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570121728 00000100:00100000:3.0:1788201456.185167:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570121728 00000100:00100000:3.0:1788201456.185219:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1788201456.185231:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064570121728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.191750:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570121856:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.191898:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201456.197031:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:3284:x1875064570121728:12345-0@lo:400:kworker.0 Request processed in 11792us (13353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201456.197046:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1788201456.198863:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570121856 00000100:00100000:3.0:1788201456.198878:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570121856 00000100:00100000:2.0:1788201456.199763:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570121728:0@lo:400:kworker.0 00000100:00080000:1.0:1788201456.199999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201456.200005:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201456.200009:0:36:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201456.200014:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 583 00000100:00080000:1.0:1788201456.200019:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201456.200024:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201456.200058:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624bfe69180 x1875064570121984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201456.200091:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570121984:0@lo:8:kworker.0 00000100:00100000:1.0:1788201456.200166:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201456.200215:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570121984 00000100:00100000:1.0:1788201456.200220:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570121984 00000100:00100000:1.0:1788201456.200252:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788201456.200259:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570121984:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788201456.200278:0:6670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201456.200318:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570121984:12345-0@lo:8:kworker.0 Request processed in 57us (151us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201456.200324:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1788201456.200377:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201456.200381:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201456.200384:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570121984:0@lo:8:kworker.0 00000100:00100000:1.0:1788201456.200422:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfe69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570122112:0@lo:400:kworker.0 00000100:00100000:1.0:1788201456.200452:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201456.204936:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570122112 00000100:00100000:1.0:1788201456.204941:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201456.204965:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570122240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201456.205017:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570122112 00000100:00100000:1.0:1788201456.205026:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201456.205108:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788201456.205120:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570121856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201456.205155:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788201456.205167:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570122112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.205183:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570121856:12345-0@lo:400:kworker.0 Request processed in 65us (13285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.205191:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:0.0:1788201456.205218:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201456.205254:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570121856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201456.205367:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570122112:12345-0@lo:400:kworker.0 Request processed in 204us (4913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201456.205375:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788201456.205899:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfe69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570122112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201456.210565:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570122240 00000100:00100000:2.0:1788201456.210773:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570122240 00000100:00100000:2.0:1788201456.210936:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788201456.210948:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570122240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201456.211042:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570122240:12345-0@lo:400:kworker.0 Request processed in 97us (6016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201456.211049:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00010000:00080000:0.0:1788201456.211365:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9624bfd2f800 x1875064570122240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201456.211382:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570122240:0@lo:400:kworker.0 00000100:00080000:1.0:1788201456.215535:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201456.448685:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201456.448725:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201456.448796:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201456.448826:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559594496 00000100:00100000:1.0:1788201456.448836:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559594496 00000100:00100000:1.0:1788201456.448888:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 477 00000100:00100000:1.0:1788201456.448897:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559594496:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201456.448978:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559594496:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 69us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201456.448987:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 477 00000100:00100000:1.0:1788201456.449019:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559594624 00000100:00100000:1.0:1788201456.449022:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559594624 00000100:00100000:1.0:1788201456.449065:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 312 00000100:00100000:1.0:1788201456.449072:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559594624:12345-192.168.201.56@tcp:400:kworker.0 00010000:00010000:3.0:1788201456.449104:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201456.449114:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559594624:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 43us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201456.449121:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 312 00000100:00100000:1.0:1788201456.449150:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559594752 00000100:00100000:1.0:1788201456.449154:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559594752 00000100:00100000:1.0:1788201456.449183:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 153 00000100:00100000:1.0:1788201456.449198:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875064559594752:12345-192.168.201.56@tcp:8:kworker.0 00010000:00020000:1.0:1788201456.449215:0:6670:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.56@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201456.449251:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875064559594752:12345-192.168.201.56@tcp:8:kworker.0 Request processed in 61us (454us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201456.449258:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 153 00000100:00080000:3.0:1788201456.457548:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201457.206621:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201457.206644:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570122368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201457.206714:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201457.206838:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570122368 00000100:00100000:1.0:1788201457.206847:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570122368 00000100:00100000:1.0:1788201457.206906:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788201457.206916:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570122368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201457.206950:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201457.207000:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570122368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201457.207007:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00010000:00080000:1.0:1788201457.207048:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96248cd54380 x1875064570122368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201457.207066:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570122368:0@lo:13:osp-pre-1-0.0 00000020:01000004:0.0:1788201457.212646:0:19667:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788201457.212650:0:19667:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788201457.212784:0:19667:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9624b9a36000 00000020:01000004:0.0:1788201457.212799:0:19667:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788201457.212813:0:19667:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788201457.212826:0:19667:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96248729b380) 00000020:00000080:0.0:1788201457.212850:0:19667:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788201457.279314:0:19667:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788201457.282230:0:19667:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788201457.291742:0:19667:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788201457.293199:0:19667:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788201457.294289:0:19667:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xf:0x0] (8/32) 00100000:10000000:0.0:1788201457.295677:0:19667:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 529: rc = 0 00100000:10000000:0.0:1788201457.295758:0:19667:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:0.0:1788201457.295834:0:19667:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 529: rc = 0 00100000:10000000:0.0:1788201457.299217:0:19667:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 377: rc = 0 00100000:10000000:0.0:1788201457.300240:0:19667:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 377: rc = 0 00100000:10000000:0.0:1788201457.307692:0:19667:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 377: rc = 0 00100000:10000000:0.0:1788201457.309280:0:19667:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 377: rc = 0 00100000:10000000:0.0:1788201457.312793:0:19667:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 377: rc = 0 00100000:10000000:2.0:1788201457.315064:0:19667:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 377: rc = 0 00000020:00000080:2.0:1788201457.326409:0:19667:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788201457.326422:0:19667:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788201457.326434:0:19667:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3cb6a4 00000020:01000004:2.0:1788201457.326443:0:19667:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788201457.326464:0:19667:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.156@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788201457.326467:0:19667:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788201457.326474:0:19667:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788201457.326495:0:19667:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788201457.326499:0:19667:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788201457.357589:0:19667:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788201457.357640:0:19667:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.156@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788201457.357649:0:19667:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788201457.357651:0:19667:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201457.357652:0:19667:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201457.357653:0:19667:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201457.357654:0:19667:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201457.357655:0:19667:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201457.357656:0:19667:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201457.357658:0:19667:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201457.357660:0:19667:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201457.357664:0:19667:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788201457.357666:0:19667:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201457.357668:0:19667:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201457.357669:0:19667:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201457.357670:0:19667:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201457.357670:0:19667:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201457.357672:0:19667:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201457.357672:0:19667:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201457.357673:0:19667:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201457.357674:0:19667:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201457.357701:0:19667:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788201457.357722:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570122496:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201457.357802:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201457.357857:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff96238394f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201457.358223:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570122496 00000100:00100000:0.0:1788201457.358231:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570122496 00000100:00100000:0.0:1788201457.358296:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1788201457.358305:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:19667:x1875064570122496:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201457.358361:0:5820:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788201457.358364:0:5820:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788201457.358368:0:5820:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788201457.396195:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:19667:x1875064570122496:12345-0@lo:253:mount.lustre.0 Request processed in 37880us (38381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201457.396212:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1788201457.396301:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570122496:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201457.396319:0:19667:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788201457.396323:0:19667:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201457.396324:0:19667:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201457.396326:0:19667:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201457.396327:0:19667:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201457.396328:0:19667:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201457.396329:0:19667:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201457.396331:0:19667:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201457.396333:0:19667:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201457.396334:0:19667:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201457.396386:0:19667:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9624b9a36000 from lustre-OST0000 10000000:01000000:3.0:1788201457.396414:0:19667:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788201457.396417:0:19667:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788201457.396440:0:19667:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962485b40000 local copy 00010000:00010000:3.0:1788201457.396452:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201457.396683:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570122624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201457.396720:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201457.396828:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624936566c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201457.396923:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570122624 00000100:00100000:1.0:1788201457.396930:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570122624 00000100:00100000:1.0:1788201457.397004:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1788201457.397012:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:19667:x1875064570122624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201457.397555:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:19667:x1875064570122624:12345-0@lo:501:mount.lustre.0 Request processed in 542us (833us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201457.397563:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1788201457.397618:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570122624:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788201457.397635:0:19667:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788201457.397759:0:19667:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788201457.397767:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.397777:0:19667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff962493611c00/0xa81c4c9a2f3caaf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3caafe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201457.397801:0:19667:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9624b9a36000 10000000:01000000:3.0:1788201457.397805:0:19667:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788201457.397809:0:19667:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788201457.397811:0:19667:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201457.397815:0:19667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788201457.397818:0:19667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201457.397840:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624904a6000/0xa81c4c9a2f3cb6ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.397847:0:19667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624904a6000/0xa81c4c9a2f3cb6ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.397855:0:19667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624904a6000/0xa81c4c9a2f3cb6ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201457.397942:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570122752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201457.397968:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201457.398036:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624936566c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201457.398193:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570122752 00000100:00100000:0.0:1788201457.398199:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570122752 00000100:00100000:0.0:1788201457.398276:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1788201457.398285:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+16:19667:x1875064570122752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201457.398307:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201457.398320:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624ba4df800/0xa81c4c9a2f3cb6b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb6ab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201457.399968:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624ba4df800/0xa81c4c9a2f3cb6b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb6ab expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201457.399990:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624ba4df800/0xa81c4c9a2f3cb6b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb6ab expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201457.399999:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4df800, rc 0) 00000100:00100000:1.0:1788201457.400460:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:19667:x1875064570122752:12345-0@lo:101:mount.lustre.0 Request processed in 2174us (2488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201457.400470:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1788201457.400562:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570122752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201457.400582:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624904a6000/0xa81c4c9a2f3cb6ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb6b2 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.400592:0:19667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624904a6000/0xa81c4c9a2f3cb6ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb6b2 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201457.407777:0:19667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000040:00080000:3.0:1788201457.408990:0:19667:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201457.409453:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:3.0:1788201457.409498:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 128 off8544 00000040:00080000:3.0:1788201457.409529:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 112 off8656 00000040:00080000:3.0:1788201457.409573:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8880 00000040:00080000:3.0:1788201457.409613:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9104 00000040:00080000:3.0:1788201457.409649:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 80 off9184 00000040:00080000:3.0:1788201457.409696:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9408 00000040:00080000:3.0:1788201457.409732:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9632 00000040:00080000:3.0:1788201457.409765:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 80 off9712 00000040:00080000:3.0:1788201457.409808:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off9936 00000040:00080000:3.0:1788201457.409842:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].11, 224 off10160 00000040:00080000:3.0:1788201457.410006:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].12, 120 off10280 00000040:00080000:3.0:1788201457.410089:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].13, 224 off10504 00000040:00080000:3.0:1788201457.410207:0:19667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 14 00000100:00100000:3.0:1788201457.410299:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570122880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201457.410446:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201457.410547:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff96238394f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201457.410589:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570122880 00000100:00100000:1.0:1788201457.410604:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570122880 00000100:00100000:1.0:1788201457.410707:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1788201457.410717:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:19667:x1875064570122880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201457.411025:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:19667:x1875064570122880:12345-0@lo:501:mount.lustre.0 Request processed in 309us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201457.411032:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1788201457.411125:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570122880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201457.411157:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201457.411197:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201457.411648:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff96238394f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201457.411731:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570123008 00000100:00100000:2.0:1788201457.411736:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570123008 00000100:00100000:2.0:1788201457.411760:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1788201457.411766:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:19667:x1875064570123008:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201457.412264:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:19667:x1875064570123008:12345-0@lo:503:mount.lustre.0 Request processed in 495us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201457.412271:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:3.0:1788201457.412383:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123008:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201457.412895:0:19667:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201457.412962:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201457.413005:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201457.413028:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623812b80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201457.413199:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570123136 00000100:00100000:2.0:1788201457.413205:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570123136 00000100:00100000:2.0:1788201457.413229:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1788201457.413236:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:19667:x1875064570123136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201457.413771:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:19667:x1875064570123136:12345-0@lo:502:mount.lustre.0 Request processed in 533us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201457.413779:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1788201457.413845:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201457.414258:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:3.0:1788201457.414307:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 128 off8544 00000040:00080000:3.0:1788201457.414336:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 112 off8656 00000040:00080000:2.0:1788201457.414564:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8880 00000040:00080000:2.0:1788201457.414605:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9104 00000040:00080000:2.0:1788201457.414639:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 80 off9184 00000040:00080000:2.0:1788201457.414689:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9408 00000040:00080000:2.0:1788201457.414724:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9632 00000040:00080000:2.0:1788201457.414759:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 80 off9712 00000040:00080000:2.0:1788201457.414822:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off9936 00000040:00080000:2.0:1788201457.414937:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].11, 224 off10160 00000040:00080000:2.0:1788201457.414989:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].12, 120 off10280 00000100:00100000:2.0:1788201457.415031:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201457.415229:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201457.415325:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff962382c06780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201457.415494:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570123264 00000100:00100000:1.0:1788201457.415501:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570123264 00000100:00100000:1.0:1788201457.415547:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1788201457.415554:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:19667:x1875064570123264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201457.415742:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:19667:x1875064570123264:12345-0@lo:502:mount.lustre.0 Request processed in 187us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201457.415750:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1788201457.415841:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201457.415932:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].13, 224 off10504 00000040:00080000:3.0:1788201457.415944:0:19667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788201457.417014:0:19669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201457.417025:0:19669:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788201457.417032:0:19669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201457.417035:0:19669:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788201457.417053:0:19669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201457.417068:0:19669:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9624909db380) 00000020:00000080:3.0:1788201457.417209:0:19669:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788201457.417217:0:19669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201457.417288:0:19669:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9624b9a36000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788201457.417297:0:19669:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201457.417312:0:19669:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa81c4c9a2f3cb6c0 00010000:00010000:2.0:1788201457.422319:0:19669:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00080000:1.0:1788201457.441789:0:19669:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 25769803779 srv lr: 25769803776 lx: 1875064570116480 gen 0 00000001:00080000:1.0:1788201457.441852:0:19669:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: 986744c8-ee81-4a47-8d91-97f81ede1f3e idx: 1 lr: 25769803811 srv lr: 25769803776 lx: 1875064559592576 gen 0 00000001:00000004:1.0:1788201457.441870:0:19669:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 25769803811 00080000:10000000:2.0:1788201457.458505:0:19669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x10:0x0] (8/8/4) registered 00000020:00000080:2.0:1788201457.460919:0:19669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788201457.460931:0:19669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201457.460937:0:19669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201457.460939:0:19669:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788201457.460943:0:19669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201457.460945:0:19669:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788201457.460947:0:19669:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201457.460949:0:19669:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201457.460950:0:19669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201457.460952:0:19669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201457.460954:0:19669:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201457.460956:0:19669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201457.460958:0:19669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201457.460960:0:19669:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201457.460963:0:19669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201457.460965:0:19669:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788201457.460967:0:19669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201457.460969:0:19669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201457.460971:0:19669:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788201457.460973:0:19669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201457.460975:0:19669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201457.460976:0:19669:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788201457.460979:0:19669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788201457.461184:0:19669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201457.461189:0:19669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201457.461196:0:19669:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788201457.461200:0:19669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 14 count 14 00000020:01000000:3.0:1788201457.468183:0:19667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788201457.468225:0:19667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788201457.468251:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624904a6000/0xa81c4c9a2f3cb6ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb6b2 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.468263:0:19667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624904a6000/0xa81c4c9a2f3cb6ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb6b2 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201457.468318:0:19667:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9624b9a36000 from 1 10000000:01000000:3.0:1788201457.468321:0:19667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201457.468380:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624904a6e00/0xa81c4c9a2f3cb6d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.468389:0:19667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624904a6e00/0xa81c4c9a2f3cb6d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.468400:0:19667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624904a6e00/0xa81c4c9a2f3cb6d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201457.468426:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201457.468492:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201457.468529:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623812b80c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788201457.468611:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201457.468625:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570123392 00000100:00100000:2.0:1788201457.468632:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570123392 00000100:00100000:2.0:1788201457.468686:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:2.0:1788201457.468696:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+17:19667:x1875064570123392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201457.468710:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201457.468722:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962485567a00/0xa81c4c9a2f3cb6dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb6d5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201457.468744:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962485567a00/0xa81c4c9a2f3cb6dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb6d5 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201457.468754:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962485567a00/0xa81c4c9a2f3cb6dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb6d5 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201457.468764:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962485567a00, rc 0) 00000100:00100000:2.0:1788201457.468813:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:19667:x1875064570123392:12345-0@lo:101:mount.lustre.0 Request processed in 118us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201457.468819:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1788201457.469047:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201457.469062:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624904a6e00/0xa81c4c9a2f3cb6d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb6dc expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.469072:0:19667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624904a6e00/0xa81c4c9a2f3cb6d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb6dc expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201457.482830:0:19667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 7 count 7 00000040:00080000:2.0:1788201457.491407:0:19667:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201457.493026:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:3.0:1788201457.493125:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 112 off8528 00000040:00080000:3.0:1788201457.493179:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 224 off8752 00000040:00080000:3.0:1788201457.493218:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8976 00000040:00080000:3.0:1788201457.493255:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 112 off9088 00000040:00080000:3.0:1788201457.493334:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 224 off9312 00000040:00080000:3.0:1788201457.493382:0:19667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 6 count 7 00000100:00100000:3.0:1788201457.493498:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201457.493859:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201457.493908:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9623812b80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201457.494507:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570123520 00000100:00100000:2.0:1788201457.494516:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570123520 00000100:00100000:2.0:1788201457.494568:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1788201457.494579:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:19667:x1875064570123520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201457.497794:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:19667:x1875064570123520:12345-0@lo:501:mount.lustre.0 Request processed in 3208us (4215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201457.497809:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1788201457.507443:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201457.507598:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201457.507695:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201457.507730:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9f62a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201457.507982:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570123648 00000100:00100000:3.0:1788201457.507990:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570123648 00000100:00100000:3.0:1788201457.508044:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:3.0:1788201457.508054:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:19667:x1875064570123648:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201457.508442:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:19667:x1875064570123648:12345-0@lo:503:mount.lustre.0 Request processed in 389us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201457.508449:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1788201457.508870:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123648:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201457.512018:0:19667:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201457.512130:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201457.512217:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201457.512263:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624916a1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201457.512325:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570123776 00000100:00100000:2.0:1788201457.512332:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570123776 00000100:00100000:2.0:1788201457.512438:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1788201457.512447:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:19667:x1875064570123776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201457.512682:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:19667:x1875064570123776:12345-0@lo:502:mount.lustre.0 Request processed in 235us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201457.512689:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1788201457.515103:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201457.515460:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:1.0:1788201457.515521:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 112 off8528 00000040:00080000:1.0:1788201457.515571:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 224 off8752 00000040:00080000:1.0:1788201457.515607:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8976 00000040:00080000:1.0:1788201457.515641:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 112 off9088 00000100:00100000:1.0:1788201457.515700:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201457.515780:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201457.515826:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624b9f62a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201457.516153:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570123904 00000100:00100000:2.0:1788201457.516160:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570123904 00000100:00100000:2.0:1788201457.516218:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1788201457.516227:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:19667:x1875064570123904:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201457.516473:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:19667:x1875064570123904:12345-0@lo:502:mount.lustre.0 Request processed in 245us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201457.516480:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1788201457.516651:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570123904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201457.517120:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 224 off9312 00000040:00080000:1.0:1788201457.517134:0:19667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:2.0:1788201457.536295:0:19673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201457.536313:0:19673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201457.536316:0:19673:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788201457.536326:0:19673:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624b9a36000 00000020:00000080:2.0:1788201457.536328:0:19673:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201457.536337:0:19673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201457.541017:0:19673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201457.541025:0:19673:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788201457.541038:0:19673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201457.541043:0:19673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201457.541045:0:19673:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788201457.541050:0:19673:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624b9a36000 00000020:00000080:2.0:1788201457.541053:0:19673:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201457.541190:0:19673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201457.541194:0:19673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201457.541196:0:19673:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788201457.541213:0:19673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 7 count 7 00000020:01000000:0.0:1788201457.543183:0:19667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788201457.543221:0:19667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201457.543243:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624904a6e00/0xa81c4c9a2f3cb6d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb6dc expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201457.543257:0:19667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624904a6e00/0xa81c4c9a2f3cb6d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb6dc expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201457.543304:0:19667:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788201457.543307:0:19667:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9624b9a36000 10000000:01000000:0.0:1788201457.543311:0:19667:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9624b9a36000 10000000:01000000:0.0:1788201457.543315:0:19667:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201457.543320:0:19667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9624b9a36000 from 1 10000000:01000000:0.0:1788201457.543322:0:19667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201457.543383:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4df200/0xa81c4c9a2f3cb6e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201457.543393:0:19667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624ba4df200/0xa81c4c9a2f3cb6e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201457.543416:0:19667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624ba4df200/0xa81c4c9a2f3cb6e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201457.543440:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570124032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201457.543504:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201457.543548:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624a8d4b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201457.553781:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570124032 00000100:00100000:3.0:1788201457.553797:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570124032 00000100:00100000:3.0:1788201457.553851:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1788201457.553873:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:19667:x1875064570124032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201457.553893:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201457.553911:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624904a7200/0xa81c4c9a2f3cb6ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb6e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.553940:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624904a7200/0xa81c4c9a2f3cb6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb6e3 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.553965:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624904a7200/0xa81c4c9a2f3cb6ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb6e3 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.553974:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624904a7200, rc 0) 00000100:00100000:3.0:1788201457.554785:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:19667:x1875064570124032:12345-0@lo:101:mount.lustre.0 Request processed in 911us (11276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201457.554794:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1788201457.555522:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570124032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201457.555545:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624ba4df200/0xa81c4c9a2f3cb6e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb6ea expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201457.555558:0:19667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624ba4df200/0xa81c4c9a2f3cb6e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb6ea expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201457.570153:0:19667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000040:00080000:0.0:1788201457.570974:0:19667:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201457.571238:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:0.0:1788201457.571279:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 120 off8536 00000040:00080000:0.0:1788201457.571313:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 168 off8704 00000040:00080000:0.0:1788201457.571388:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8928 00000040:00080000:0.0:1788201457.571428:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 224 off9152 00000040:00080000:0.0:1788201457.571472:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 120 off9272 00000040:00080000:0.0:1788201457.571505:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 168 off9440 00000040:00080000:0.0:1788201457.571537:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 224 off9664 00000040:00080000:0.0:1788201457.571580:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:0.0:1788201457.571615:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 120 off10008 00000040:00080000:0.0:1788201457.571647:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 224 off10232 00000040:00080000:3.0:1788201457.583106:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10456 00000040:00080000:3.0:1788201457.583167:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].13, 88 off10544 00000040:00080000:3.0:1788201457.583199:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].14, 128 off10672 00000040:00080000:3.0:1788201457.583245:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].15, 144 off10816 00000040:00080000:3.0:1788201457.583280:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].16, 160 off10976 00000040:00080000:3.0:1788201457.583311:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].17, 224 off11200 00000040:00080000:3.0:1788201457.583531:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].18, 224 off11424 00000040:00080000:3.0:1788201457.583574:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].19, 80 off11504 00000040:00080000:3.0:1788201457.583610:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].20, 224 off11728 00000040:00080000:3.0:1788201457.583723:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].21, 224 off11952 00000040:00080000:3.0:1788201457.583767:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].22, 88 off12040 00000040:00080000:3.0:1788201457.583798:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].23, 128 off12168 00000040:00080000:3.0:1788201457.583842:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].24, 144 off12312 00000040:00080000:3.0:1788201457.583947:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].25, 128 off12440 00000040:00080000:3.0:1788201457.583981:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].26, 224 off12664 00000040:00080000:3.0:1788201457.584027:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].27, 224 off12888 00000040:00080000:3.0:1788201457.584062:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].28, 80 off12968 00000040:00080000:3.0:1788201457.584119:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].29, 224 off13192 00000040:00080000:3.0:1788201457.584169:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].30, 224 off13416 00000040:00080000:3.0:1788201457.584205:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].31, 88 off13504 00000040:00080000:3.0:1788201457.584237:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].32, 128 off13632 00000040:00080000:3.0:1788201457.584269:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].33, 144 off13776 00000040:00080000:3.0:1788201457.584333:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].34, 128 off13904 00000040:00080000:3.0:1788201457.585966:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].35, 224 off14128 00000040:00080000:3.0:1788201457.586085:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].36, 224 off14352 00000040:00080000:3.0:1788201457.586125:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].37, 80 off14432 00000040:00080000:3.0:1788201457.586161:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].38, 224 off14656 00000040:00080000:3.0:1788201457.586211:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].39, 224 off14880 00000040:00080000:3.0:1788201457.586247:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].40, 120 off15000 00000040:00080000:3.0:1788201457.586374:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].41, 224 off15224 00000040:00080000:3.0:1788201457.586383:0:19667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 41 count 42 00000100:00100000:3.0:1788201457.587100:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570124160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201457.587172:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201457.587270:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff96238394f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201457.587314:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570124160 00000100:00100000:0.0:1788201457.587322:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570124160 00000100:00100000:0.0:1788201457.587666:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1788201457.587675:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:19667:x1875064570124160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201457.588069:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:19667:x1875064570124160:12345-0@lo:501:mount.lustre.0 Request processed in 394us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201457.588086:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1788201457.588172:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570124160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201457.588211:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570124288:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201457.588252:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201457.588284:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff96238394f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201457.590554:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570124288 00000100:00100000:2.0:1788201457.590567:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570124288 00000100:00100000:2.0:1788201457.590626:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1788201457.590635:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:19667:x1875064570124288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201457.591156:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:19667:x1875064570124288:12345-0@lo:503:mount.lustre.0 Request processed in 521us (2903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201457.591164:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1788201457.591438:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570124288:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201457.592189:0:19667:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201457.592275:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570124416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201457.592332:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201457.592403:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624a8d4b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201457.593774:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570124416 00000100:00100000:2.0:1788201457.593784:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570124416 00000100:00100000:2.0:1788201457.593840:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1788201457.593850:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:19667:x1875064570124416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201457.595034:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:19667:x1875064570124416:12345-0@lo:502:mount.lustre.0 Request processed in 1181us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201457.595043:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1788201457.595153:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570124416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201457.595970:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:0.0:1788201457.596034:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 120 off8536 00000040:00080000:0.0:1788201457.596065:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 168 off8704 00000040:00080000:0.0:1788201457.596126:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8928 00000040:00080000:0.0:1788201457.596163:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 224 off9152 00000040:00080000:0.0:1788201457.596201:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 120 off9272 00000040:00080000:0.0:1788201457.596227:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 168 off9440 00000040:00080000:0.0:1788201457.596251:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 224 off9664 00000040:00080000:0.0:1788201457.596290:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:0.0:1788201457.596320:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 120 off10008 00000040:00080000:0.0:1788201457.597929:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 224 off10232 00000040:00080000:0.0:1788201457.598023:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10456 00000040:00080000:0.0:1788201457.598053:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].13, 88 off10544 00000040:00080000:0.0:1788201457.598121:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].14, 128 off10672 00000040:00080000:0.0:1788201457.598166:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].15, 144 off10816 00000040:00080000:0.0:1788201457.598194:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].16, 160 off10976 00000040:00080000:0.0:1788201457.598219:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].17, 224 off11200 00000040:00080000:0.0:1788201457.598266:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].18, 224 off11424 00000040:00080000:0.0:1788201457.598298:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].19, 80 off11504 00000040:00080000:0.0:1788201457.598330:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].20, 224 off11728 00000040:00080000:0.0:1788201457.599588:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].21, 224 off11952 00000040:00080000:0.0:1788201457.599645:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].22, 88 off12040 00000040:00080000:0.0:1788201457.599742:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].23, 128 off12168 00000040:00080000:0.0:1788201457.599791:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].24, 144 off12312 00000040:00080000:0.0:1788201457.599818:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].25, 128 off12440 00000040:00080000:0.0:1788201457.599841:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].26, 224 off12664 00000040:00080000:0.0:1788201457.600650:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].27, 224 off12888 00000040:00080000:0.0:1788201457.600798:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].28, 80 off12968 00000040:00080000:0.0:1788201457.600829:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].29, 224 off13192 00000040:00080000:1.0:1788201457.602209:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].30, 224 off13416 00000040:00080000:1.0:1788201457.602257:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].31, 88 off13504 00000040:00080000:1.0:1788201457.602286:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].32, 128 off13632 00000040:00080000:1.0:1788201457.602317:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].33, 144 off13776 00000040:00080000:1.0:1788201457.602769:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].34, 128 off13904 00000040:00080000:1.0:1788201457.602817:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].35, 224 off14128 00000040:00080000:1.0:1788201457.602931:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].36, 224 off14352 00000040:00080000:1.0:1788201457.602968:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].37, 80 off14432 00000040:00080000:1.0:1788201457.602999:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].38, 224 off14656 00000040:00080000:1.0:1788201457.603039:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].39, 224 off14880 00000040:00080000:1.0:1788201457.603081:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].40, 120 off15000 00000100:00100000:1.0:1788201457.603135:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570124544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201457.603223:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201457.603309:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624916a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201457.603941:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570124544 00000100:00100000:3.0:1788201457.603948:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570124544 00000100:00100000:3.0:1788201457.604026:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1788201457.604035:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:19667:x1875064570124544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201457.604288:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:19667:x1875064570124544:12345-0@lo:502:mount.lustre.0 Request processed in 253us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201457.604297:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1788201457.604394:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570124544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201457.604507:0:19667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].41, 224 off15224 00000040:00080000:1.0:1788201457.604522:0:19667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788201457.606003:0:19676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788201457.606022:0:19676:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff962487eb3380) 00000020:00000080:2.0:1788201457.606046:0:19676:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788201457.606275:0:19676:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9624b9a36000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788201457.606280:0:19676:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9624b9a36000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788201457.606282:0:19676:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624b9a36000 3 00010000:00080000:2.0:1788201457.606314:0:19676:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96248c8c4000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.156@tcp at head 00010000:00010000:3.0:1788201457.621320:0:19676:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788201457.622140:0:19676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788201457.622180:0:19676:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201457.622193:0:19676:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa81c4c9a2f3cb6f8 00000100:00080000:3.0:1788201457.622206:0:19676:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201457.622232:0:19676:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96248c8c4000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1788201457.622271:0:19676:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962492cba680 x1875064570124672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201457.622304:0:19676:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788201457.623886:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570124672:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201457.623976:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201457.624044:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570124672 00000100:00100000:1.0:1788201457.624051:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570124672 00000100:00100000:1.0:1788201457.624096:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201457.624103:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875064570124672:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788201457.624149:0:5825:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 589 last 0 00000020:00000080:1.0:1788201457.624182:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa81c4c9a2f3cb6ff 00000004:00100000:1.0:1788201457.624196:0:5825:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201457.624227:0:5825:0:(import.c:65:import_set_state_nolock()) ffff962382b0e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201457.624273:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875064570124672:12345-0@lo:38:llog_process_th.0 Request processed in 169us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201457.624280:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201457.624318:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201457.624325:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788201457.624332:0:3281:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788201457.624336:0:3281:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788201457.624338:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96248c8c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788201457.624369:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875064570124672:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788201457.625308:0:19676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 42 count 42 00000020:01000000:1.0:1788201457.625666:0:19667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788201457.625697:0:19667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201457.625718:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624ba4df200/0xa81c4c9a2f3cb6e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb6ea expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201457.625743:0:19667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624ba4df200/0xa81c4c9a2f3cb6e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb6ea expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201457.625786:0:19667:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201457.625787:0:19667:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201457.625789:0:19667:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201457.625790:0:19667:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201457.625791:0:19667:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201457.625792:0:19667:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201457.625794:0:19667:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201457.625795:0:19667:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201457.625797:0:19667:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201457.625801:0:19667:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788201457.625803:0:19667:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201457.625804:0:19667:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201457.625805:0:19667:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201457.625806:0:19667:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201457.625807:0:19667:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201457.625808:0:19667:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201457.625809:0:19667:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201457.625810:0:19667:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201457.625811:0:19667:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201457.625832:0:19667:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788201457.625848:0:19667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570124800:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201457.626131:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201457.626169:0:19667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9624916a1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201457.626256:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570124800 00000100:00100000:2.0:1788201457.626263:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570124800 00000100:00100000:2.0:1788201457.626306:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:2.0:1788201457.626313:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:19667:x1875064570124800:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201457.626334:0:5820:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788201457.626371:0:5820:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788201457.634123:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201457.634131:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201457.634134:0:36:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201457.634142:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 588 00000100:00080000:0.0:1788201457.634147:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201457.634154:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1788201457.634178:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9624bfd2c380 x1875064570125056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201457.634248:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570125184:0@lo:400:kworker.0 00000100:00100000:0.0:1788201457.634316:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201457.635208:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201457.635221:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570124928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201457.635263:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201457.635698:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570125184 00000100:00100000:0.0:1788201457.635707:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570125184 00000100:00100000:0.0:1788201457.635750:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570124928 00000100:00100000:0.0:1788201457.635753:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570124928 00000100:00100000:0.0:1788201457.635770:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788201457.635778:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570125184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201457.635831:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570125184:12345-0@lo:400:kworker.0 Request processed in 54us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201457.635846:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788201457.635872:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788201457.635877:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570124928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201457.635904:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570124928:12345-0@lo:400:kworker.0 Request processed in 28us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201457.635909:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788201457.635950:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570125184:0@lo:400:kworker.0 00000100:00100000:2.0:1788201457.636675:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570124928:0@lo:400:kworker.0 00000100:00100000:0.0:1788201457.637431:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570125056:0@lo:8:kworker.0 00000100:00100000:0.0:1788201457.637474:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201457.637645:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570125056 00000100:00100000:2.0:1788201457.637651:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570125056 00000100:00100000:2.0:1788201457.637694:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788201457.637700:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875064570125056:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788201457.637750:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875064570125056:12345-0@lo:8:kworker.0 Request processed in 50us (276us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201457.637755:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1788201457.637781:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201457.637785:0:3281:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201457.637788:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570125056:0@lo:8:kworker.0 20000000:01000000:2.0:1788201457.670795:0:5820:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201457.670837:0:5820:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788201457.675874:0:5841:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201457.675883:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201457.676364:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201457.676389:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624904a6800/0xa81c4c9a2f3cb593 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b12 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201457.676407:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624904a6c00/0xa81c4c9a2f3cb5a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb59a expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201457.676415:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201457.676459:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624904a6c00/0xa81c4c9a2f3cb5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa81c4c9a2f3cb59a expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201457.676473:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624904a6c00/0xa81c4c9a2f3cb5a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb59a expref: 19 pid: 5818 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201457.676489:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570125312:0@lo:104: 00000100:00100000:0.0:1788201457.676574:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201457.677224:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624904a6800/0xa81c4c9a2f3cb593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b12 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201457.677237:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9624904a6800/0xa81c4c9a2f3cb593 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b12 expref: 9 pid: 5818 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201457.677248:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570125440:192.168.201.56@tcp:104: 00000100:00100000:0.0:1788201457.677306:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff96238394f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201457.679612:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:19667:x1875064570124800:12345-0@lo:253:mount.lustre.0 Request processed in 53290us (53471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201457.679627:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1788201457.679874:0:19667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:19667:1875064570124800:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201457.679892:0:19667:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788201457.679895:0:19667:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201457.679897:0:19667:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201457.679899:0:19667:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201457.679900:0:19667:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201457.679901:0:19667:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201457.679916:0:19667:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201457.679918:0:19667:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201457.679920:0:19667:0:(tgt_mount.c:1204:server_mti_print()) LDD_F_IR_CAPABLE 00000020:01000004:1.0:1788201457.679921:0:19667:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201457.679923:0:19667:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788201457.679940:0:19667:0:(tgt_mount.c:2687:server_calc_timeout()) lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 00000100:00100000:3.0:1788201457.681893:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570125312 00000100:00100000:3.0:1788201457.681907:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570125312 00000100:00100000:2.0:1788201457.682125:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201457.682136:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570125312:12345-0@lo:104: 00010000:00010000:2.0:1788201457.682154:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cb5a1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201457.682244:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201457.682249:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+3:5841:x1875064570125312:12345-0@lo:104: Request processed in 116us (5677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201457.682272:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1788201457.682954:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201457.682964:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa81c4c9a2f3cb5a1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201457.682974:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4de800 already unused, calling callback (ffffffffc1b5cc20) 10000000:00010000:2.0:1788201457.682978:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa81c4c9a2f3cb5a1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201457.682988:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa81c4c9a2f3cb5a1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201457.682995:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa81c4c9a2f3cb5a1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201457.683001:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201457.683041:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cb5a1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201457.683048:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201457.683079:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cb5a1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201457.683086:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff9624ba4de800/0xa81c4c9a2f3cb59a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa81c4c9a2f3cb5a1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201457.683103:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201457.683105:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201457.683106:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201457.683145:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570125312:0@lo:104: 00080000:10000000:1.0:1788201457.685299:0:19667:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201457.686049:0:19667:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201457.686221:0:19667:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00000100:00100000:0.0:1788201457.686597:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570125568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201457.686650:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201457.686844:0:11284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570125568 00000100:00100000:3.0:1788201457.686862:0:11284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570125568 00010000:00010000:3.0:1788201457.686897:0:11284:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624904a6c00/0xa81c4c9a2f3cb5a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb59a expref: 19 pid: 5818 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201457.686936:0:11284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201457.686946:0:11284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570125568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201457.686960:0:11284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201457.686966:0:11284:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624904a6c00/0xa81c4c9a2f3cb5a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb59a expref: 19 pid: 5818 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.686978:0:11284:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624904a6c00/0xa81c4c9a2f3cb5a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb59a expref: 19 pid: 5818 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.686996:0:11284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624904a6c00/0xa81c4c9a2f3cb5a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa81c4c9a2f3cb59a expref: 19 pid: 5818 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.687012:0:11284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201457.687051:0:11284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:3283:x1875064570125568:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201457.687057:0:11284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201457.687120:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570125568:0@lo:103:ldlm_bl.0 00080000:10000000:1.0:1788201457.687232:0:19667:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201457.687746:0:19667:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00000100:00100000:2.0:1788201457.688012:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5841:1875064570125440:192.168.201.56@tcp:104: 00010000:00010000:2.0:1788201457.688034:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788201457.688230:0:19667:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00080000:1.0:1788201457.690514:0:19667:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-OST0000, 2 recoverable clients, last_transno 25769803811 00000100:00100000:1.0:1788201457.692877:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201457.693068:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559594880 00000100:00100000:3.0:1788201457.693093:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559594880 00010000:00010000:3.0:1788201457.693135:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624904a6800/0xa81c4c9a2f3cb593 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b12 expref: 10 pid: 5818 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201457.693177:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:3.0:1788201457.693188:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559594880:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201457.693202:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201457.693208:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624904a6800/0xa81c4c9a2f3cb593 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b12 expref: 10 pid: 5818 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.693220:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624904a6800/0xa81c4c9a2f3cb593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b12 expref: 10 pid: 5818 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.693237:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624904a6800/0xa81c4c9a2f3cb593 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0x390884812bd99b12 expref: 10 pid: 5818 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.693253:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.693260:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201457.693275:0:5811:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017393749s 00010000:00010000:3.0:1788201457.693280:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.693286:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.693309:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.693315:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.693322:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4de200 already unused, calling callback (ffffffffc1575fe0) 00010000:00010000:3.0:1788201457.693326:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.693334:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.693372:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.693383:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201457.693440:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:2343:x1875064559594880:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 254us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201457.693447:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 59 00010000:00010000:3.0:1788201457.693549:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.693557:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201457.693562:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624ba4de200/0xa81c4c9a2f3cb706 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788201457.694283:0:19682:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-OST0000: started recovery thread pid 19682 00010000:00080000:0.0:1788201457.694542:0:19682:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788201457.694546:0:19682:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1788201457.695648:0:19667:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788201457.695779:0:19667:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788201457.695794:0:19667:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788201457.695822:0:19667:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788201458.486535:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201459.121809:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201459.122169:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559595008 00000100:00100000:3.0:1788201459.122179:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559595008 00000100:00100000:3.0:1788201459.122243:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 496 00000100:00100000:3.0:1788201459.122254:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+9:10055:x1875064559595008:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201459.122272:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201459.122295:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624904a6400/0xa81c4c9a2f3cb70d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x390884812bd99b5f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201459.122325:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624904a6400/0xa81c4c9a2f3cb70d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b5f expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201459.122337:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624904a6400/0xa81c4c9a2f3cb70d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b5f expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201459.122387:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624904a6400, rc 0) 00000100:00100000:3.0:1788201459.122555:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559595008:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 302us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201459.122561:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 496 00000100:00100000:2.0:1788201459.153614:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201459.159531:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559595136 00000100:00100000:0.0:1788201459.159546:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559595136 00000100:00100000:0.0:1788201459.159686:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 497 00000100:00100000:0.0:1788201459.159697:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559595136:12345-192.168.201.56@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201459.159727:0:5820:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788201459.159751:0:5820:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201459.159754:0:5820:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788201459.165693:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:10055:x1875064559595136:12345-192.168.201.56@tcp:256:ll_cfg_requeue.0 Request processed in 5985us (12078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201459.165710:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 497 00000100:00100000:1.0:1788201459.169495:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201459.170035:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559595264 00000100:00100000:3.0:1788201459.170057:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559595264 00000100:00100000:3.0:1788201459.170116:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 155 00000100:00100000:3.0:1788201459.170126:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875064559595264:12345-192.168.201.56@tcp:8:ll_cfg_requeue.0 00010000:00080000:3.0:1788201459.170159:0:6668:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '986744c8-ee81-4a47-8d91-97f81ede1f3e' at ffff962382b0c000, cookie 0xa81c4c9a2f3cb6ce 00010000:00080000:3.0:1788201459.170165:0:6668:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp recovering/t25769803810 exp ffff962382b0c000 cur 591 last 1788201457 00010000:02000400:3.0:1788201459.170174:0:6668:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1788201459.180164:0:6668:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:3.0:1788201459.180193:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff962382b0c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201459.180241:0:6668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00000100:00080000:3.0:1788201459.180699:0:6668:0:(import.c:65:import_set_state_nolock()) ffff962490146000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201459.180796:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559595264:12345-192.168.201.56@tcp:8:ll_cfg_requeue.0 Request processed in 10668us (11309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201459.180806:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 155 00000100:00100000:0.0:1788201459.206542:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201459.206663:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559595392 00000100:00100000:2.0:1788201459.206676:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559595392 00000100:00100000:2.0:1788201459.206794:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 156 00000100:00100000:2.0:1788201459.206806:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559595392:12345-192.168.201.56@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201459.206827:0:6671:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9624bfe68000 x1875064559595392/t0(0) o101->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:580/0 lens 328/0 e 0 to 0 dl 1788201470 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201459.206863:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559595392:12345-192.168.201.56@tcp:101:ldlm_lock_repla.0 Request processed in 60us (334us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201459.206871:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 156 00010000:00080000:1.0:1788201459.206923:0:19682:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1788201459.512813:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788201459.639456:0:5822:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201459.639465:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9624902af800 from 11 10000000:01000000:3.0:1788201459.639470:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201459.639513:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624904a6800/0xa81c4c9a2f3cb714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201459.639524:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff9624904a6800/0xa81c4c9a2f3cb714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201459.639536:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff9624904a6800/0xa81c4c9a2f3cb714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201459.639561:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570125696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201459.639631:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201459.639687:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962382c0a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201459.640045:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570125696 00000100:00100000:0.0:1788201459.640124:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570125696 00000100:00100000:0.0:1788201459.640169:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1788201459.640178:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+18:5822:x1875064570125696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201459.640253:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201459.640266:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb71b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa81c4c9a2f3cb714 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201459.640292:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb714 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201459.640303:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624ba4de600/0xa81c4c9a2f3cb71b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa81c4c9a2f3cb714 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201459.640312:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624ba4de600, rc 0) 00000100:00100000:0.0:1788201459.642286:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570125696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2097us (2643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201459.642299:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1788201459.648732:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570125696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201459.648772:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff9624904a6800/0xa81c4c9a2f3cb714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb71b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201459.648788:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff9624904a6800/0xa81c4c9a2f3cb714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa81c4c9a2f3cb71b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201459.648881:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570125824:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788201459.650510:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201459.650575:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff962382c0a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201459.650785:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570125824 00000100:00100000:2.0:1788201459.650796:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570125824 00000100:00100000:2.0:1788201459.650864:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1788201459.650874:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570125824:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201459.650902:0:5820:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201459.650923:0:5820:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201459.650997:0:5820:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788201459.651216:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:5822:x1875064570125824:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 343us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.651224:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1788201459.651327:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:5822:1875064570125824:0@lo:256:ll_cfg_requeue.0 00000100:00080000:1.0:1788201459.651402:0:5822:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff96249852b000 already not connected (conn 35, was 0): DISCONN 00010000:00080000:1.0:1788201459.651413:0:5822:0:(ldlm_lib.c:85:import_set_conn()) imp ffff96249852b000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.201.156@tcp, moved to head 00000100:00080000:1.0:1788201459.651418:0:5822:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201459.651423:0:5822:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96249852b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1788201459.651451:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962490588380 x1875064570125952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:1.0:1788201459.651495:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201459.651506:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff9624904a6800/0xa81c4c9a2f3cb714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb71b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201459.651522:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff9624904a6800/0xa81c4c9a2f3cb714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa81c4c9a2f3cb71b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201459.651870:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570125952:0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1788201459.651911:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201459.652575:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570125952 00000100:00100000:1.0:1788201459.652584:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570125952 00000100:00100000:1.0:1788201459.652614:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788201459.652620:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875064570125952:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:1.0:1788201459.652646:0:6670:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff962382b0d800, cookie 0xa81c4c9a2f3cb6c7 00010000:00080000:1.0:1788201459.652652:0:6670:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t17179869194 exp ffff962382b0d800 cur 591 last 1788201457 00002000:00100000:1.0:1788201459.652671:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff962382b0d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788201459.652676:0:6670:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788201459.652678:0:6670:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1788201459.652821:0:6670:0:(import.c:65:import_set_state_nolock()) ffff962382b08000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201459.652888:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570125952:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 266us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.652896:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00010000:00080000:1.0:1788201459.652919:0:19682:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1788201459.653527:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962490588380 x1875064570125952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201459.653545:0:3281:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 7 00000100:00080000:2.0:1788201459.653558:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1788201459.653563:0:3281:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788201459.653566:0:3281:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803779 gen 2 00000100:00080000:2.0:1788201459.653571:0:3281:0:(recover.c:53:ptlrpc_replay_next()) import ffff96249852b000 from lustre-OST0000_UUID committed 25769803779 last 0 00000100:00080000:2.0:1788201459.653574:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00010000:00080000:1.0:1788201459.653767:0:19682:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 25769803812 00010000:00080000:1.0:1788201459.653773:0:19682:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 25769803812 00010000:00080000:1.0:1788201459.653777:0:19682:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 25769803812 00000100:00100000:0.0:1788201459.665327:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570125952:0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1788201459.665529:0:19772:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1788201459.665534:0:19772:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:3.0:1788201459.665540:0:19772:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:3.0:1788201459.665581:0:19772:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1788201459.665669:0:3281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570126080:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788201459.665739:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201459.665826:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570126080 00000100:00100000:1.0:1788201459.665835:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570126080 00000100:00100000:1.0:1788201459.665893:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788201459.665904:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570126080:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788201459.665921:0:8088:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff962492c21f80 x1875064570126080/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:580/0 lens 224/0 e 0 to 0 dl 1788201470 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201459.665958:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875064570126080:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 56us (219us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201459.665966:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:1.0:1788201459.665985:0:19682:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 25769803812 00010000:00080000:1.0:1788201459.665988:0:19682:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00010000:00080000:1.0:1788201459.665995:0:19682:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788201459.665999:0:19682:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1788201459.666007:0:19682:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.201.56@tcp: req@ffff9624bfe68000 x1875064559595392/t0(0) o101->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:580/0 lens 328/0 e 0 to 0 dl 1788201470 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788201459.666043:0:19682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201459.666080:0:19682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000543cc47c/0xa81c4c9a2f3cb722 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b58 expref: -99 pid: 19682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201459.666108:0:19682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000543cc47c/0xa81c4c9a2f3cb722 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b58 expref: 6 pid: 19682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201459.666129:0:19682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000543cc47c/0xa81c4c9a2f3cb722 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b58 expref: 6 pid: 19682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201459.666139:0:19682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96248e27f800, rc 0) 00010000:00080000:1.0:1788201459.666199:0:19682:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00080000:1.0:1788201459.666210:0:19682:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788201459.670816:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201459.671214:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559595520 00000100:00100000:2.0:1788201459.671226:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559595520 00000100:00100000:2.0:1788201459.671287:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 198 00000100:00100000:2.0:1788201459.671299:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559595520:12345-192.168.201.56@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1788201459.671319:0:6670:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff962492cba680 x1875064559595520/t0(0) o400->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:580/0 lens 224/0 e 0 to 0 dl 1788201470 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201459.671338:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559595520:12345-192.168.201.56@tcp:400:ptlrpcd_rcv.0 Request processed in 42us (531us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201459.671368:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 198 00010000:00080000:2.0:1788201459.671393:0:19682:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1788201459.671577:0:19682:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771072 00000001:00100000:3.0:1788201459.765593:0:19762:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000001:00100000:3.0:1788201459.765610:0:19762:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1788201459.765783:0:19682:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:0.0:1788201459.765801:0:19682:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff962492c21f80 x1875064570126080/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:580/0 lens 224/0 e 0 to 0 dl 1788201470 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788201459.765942:0:19682:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.201.56@tcp: req@ffff962492cba680 x1875064559595520/t0(0) o400->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:580/0 lens 224/0 e 0 to 0 dl 1788201470 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201459.765998:0:19682:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788201459.769414:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788201459.769431:0:3281:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff962492cbad80 x1875064570126080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201475 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201459.769443:0:3281:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff962492cbad80 x1875064570126080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201475 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201459.769450:0:3281:0:(import.c:65:import_set_state_nolock()) ffff96249852b000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1788201459.769466:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1788201459.769469:0:3281:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201459.769572:0:6846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b15500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064570126336:0@lo:7:osp-pre-0-0.0 00000100:00100000:2.0:1788201459.769632:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201459.769669:0:6846:0:(client.c:2702:ptlrpc_set_wait()) set ffff962381b7a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201459.769682:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570126208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201459.769708:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201459.770120:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570126336 00000100:00100000:2.0:1788201459.770128:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570126336 00000100:00100000:2.0:1788201459.770178:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788201459.770186:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:6846:x1875064570126336:12345-0@lo:7:osp-pre-0-0.0 00002000:00080000:0.0:1788201459.770881:0:19682:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788201459.770893:0:19682:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00100000:1.0:1788201459.786760:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570126208 00000100:00100000:1.0:1788201459.786774:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570126208 00000100:00100000:1.0:1788201459.786847:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788201459.786858:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570126208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201459.786906:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45154304 pending 0 free 3826253824 avail 3824156672 00000100:00100000:1.0:1788201459.787003:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875064570126208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (17294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.787011:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788201459.787555:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570126208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201459.788683:0:3281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875064570126080:0@lo:400:ldlm_lock_repla.0 00002000:00080000:3.0:1788201459.799889:0:8088:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788201459.799900:0:8088:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x240000400:0x21:0x0] 00000100:00100000:3.0:1788201459.800001:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:6846:x1875064570126336:12345-0@lo:7:osp-pre-0-0.0 Request processed in 29811us (30364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201459.800012:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788201459.800113:0:6846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b15500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6846:1875064570126336:0@lo:7:osp-pre-0-0.0 00000004:00080000:2.0:1788201459.800126:0:6846:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x240000400:0x21:0x0] 00000100:00100000:2.0:1788201459.807837:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201459.809734:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559592704 00000100:00100000:3.0:1788201459.809751:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559592704 00002000:00100000:3.0:1788201459.809808:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (32509952->33558527) req@ffff962382b15500 x1875064559592704/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:580/0 lens 488/0 e 0 to 0 dl 1788201470 ref 1 fl New:/602/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201459.809832:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15500 with x1875064559592704 ext(32509952->33558527) 00002000:00010000:3.0:1788201459.809843:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15500 00000100:00100000:3.0:1788201459.809889:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 72 00000100:00100000:3.0:1788201459.809901:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559592704:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201459.879567:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559592704:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 69652us (71723us total) trans 30064771073 rc 0/0 00000100:00100000:2.0:1788201459.879581:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 72 00002000:00100000:2.0:1788201459.879594:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (32509952->33558527) req@ffff962382b15500 x1875064559592704/t30064771073(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:580/0 lens 488/448 e 0 to 0 dl 1788201470 ref 1 fl Complete:/602/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201459.879605:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15500 with x1875064559592704 ext(32509952->33558527) 00002000:00010000:2.0:1788201459.879618:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15500 00000100:00100000:3.0:1788201459.900743:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201459.900786:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559595776 00000100:00100000:3.0:1788201459.900797:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559595776 00002000:00100000:3.0:1788201459.900844:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (33558528->33562623) req@ffff962492cbad80 x1875064559595776/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:580/0 lens 4584/0 e 0 to 0 dl 1788201470 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201459.900855:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbad80 with x1875064559595776 ext(33558528->33562623) 00002000:00010000:3.0:1788201459.900860:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbad80 00000100:00100000:3.0:1788201459.900888:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 73 00000100:00100000:3.0:1788201459.900897:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559595776:12345-192.168.201.56@tcp:4:iozone.0 00000001:00080000:1.0:1788201459.995908:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771073 is committed 00000001:00080000:1.0:1788201459.995945:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771074 is committed 00000100:00100000:3.0:1788201459.996098:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559595776:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 95197us (95360us total) trans 30064771074 rc 0/0 00000100:00100000:3.0:1788201459.996111:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 73 00002000:00100000:3.0:1788201459.996124:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (33558528->33562623) req@ffff962492cbad80 x1875064559595776/t30064771074(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:580/0 lens 4584/448 e 0 to 0 dl 1788201470 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201459.996134:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbad80 with x1875064559595776 ext(33558528->33562623) 00002000:00010000:3.0:1788201459.996139:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbad80 00000100:00100000:1.0:1788201460.241022:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201460.241106:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559595904 00000100:00100000:0.0:1788201460.241117:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559595904 00002000:00100000:0.0:1788201460.241165:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (33562624->34607103) req@ffff962490588380 x1875064559595904/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:581/0 lens 488/0 e 0 to 0 dl 1788201471 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201460.241177:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962490588380 with x1875064559595904 ext(33562624->34607103) 00002000:00010000:0.0:1788201460.241183:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962490588380 00000100:00100000:0.0:1788201460.241221:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 74 00000100:00100000:0.0:1788201460.241231:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559595904:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201460.279090:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559595904:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37847us (38075us total) trans 30064771075 rc 0/0 00000100:00100000:1.0:1788201460.279105:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 74 00002000:00100000:1.0:1788201460.279121:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (33562624->34607103) req@ffff962490588380 x1875064559595904/t30064771075(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:581/0 lens 488/448 e 0 to 0 dl 1788201471 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201460.279132:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962490588380 with x1875064559595904 ext(33562624->34607103) 00002000:00010000:1.0:1788201460.279138:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962490588380 00010000:00010000:2.0:1788201460.544100:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201460.570438:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201460.570650:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559596032 00000100:00100000:0.0:1788201460.570661:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559596032 00002000:00100000:0.0:1788201460.570717:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (34607104->35655679) req@ffff9624904a0700 x1875064559596032/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:581/0 lens 488/0 e 0 to 0 dl 1788201471 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201460.570729:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a0700 with x1875064559596032 ext(34607104->35655679) 00002000:00010000:0.0:1788201460.570735:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a0700 00000100:00100000:0.0:1788201460.570773:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00100000:0.0:1788201460.570785:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559596032:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201460.619052:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559596032:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 48256us (48612us total) trans 30064771076 rc 0/0 00000100:00100000:2.0:1788201460.619080:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 75 00002000:00100000:2.0:1788201460.619095:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (34607104->35655679) req@ffff9624904a0700 x1875064559596032/t30064771076(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:581/0 lens 488/448 e 0 to 0 dl 1788201471 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201460.619106:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a0700 with x1875064559596032 ext(34607104->35655679) 00002000:00010000:2.0:1788201460.619112:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a0700 00000100:00100000:0.0:1788201460.903633:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201460.904096:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559596160 00000100:00100000:1.0:1788201460.904110:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559596160 00002000:00100000:1.0:1788201460.904166:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (35655680->36704255) req@ffff962492c21880 x1875064559596160/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:581/0 lens 488/0 e 0 to 0 dl 1788201471 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201460.904180:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c21880 with x1875064559596160 ext(35655680->36704255) 00002000:00010000:1.0:1788201460.904186:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c21880 00000100:00100000:1.0:1788201460.904224:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 76 00000100:00100000:1.0:1788201460.904235:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559596160:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201460.921770:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559596160:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17526us (18134us total) trans 30064771077 rc 0/0 00000100:00100000:2.0:1788201460.921798:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 76 00002000:00100000:2.0:1788201460.921813:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (35655680->36704255) req@ffff962492c21880 x1875064559596160/t30064771077(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:581/0 lens 488/448 e 0 to 0 dl 1788201471 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201460.921823:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c21880 with x1875064559596160 ext(35655680->36704255) 00002000:00010000:2.0:1788201460.921830:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c21880 00000100:00100000:3.0:1788201461.241023:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201461.241092:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559596288 00000100:00100000:1.0:1788201461.241170:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559596288 00002000:00100000:1.0:1788201461.241283:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (36704256->37752831) req@ffff962492cbb800 x1875064559596288/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:582/0 lens 488/0 e 0 to 0 dl 1788201472 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201461.241295:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbb800 with x1875064559596288 ext(36704256->37752831) 00002000:00010000:1.0:1788201461.241301:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbb800 00000100:00100000:1.0:1788201461.241337:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 77 00000100:00100000:1.0:1788201461.241381:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559596288:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201461.245395:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201461.263238:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559596288:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21849us (22232us total) trans 30064771078 rc 0/0 00000100:00100000:2.0:1788201461.263255:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 77 00002000:00100000:2.0:1788201461.263269:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (36704256->37752831) req@ffff962492cbb800 x1875064559596288/t30064771078(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:582/0 lens 488/448 e 0 to 0 dl 1788201472 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201461.263281:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbb800 with x1875064559596288 ext(36704256->37752831) 00002000:00010000:2.0:1788201461.263287:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbb800 00000100:00100000:1.0:1788201461.477255:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201461.477327:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559596416 00000100:00100000:3.0:1788201461.477364:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559596416 00002000:00100000:3.0:1788201461.477426:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (37752832->38801407) req@ffff962381a19c00 x1875064559596416/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:582/0 lens 488/0 e 0 to 0 dl 1788201472 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201461.477435:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a19c00 with x1875064559596416 ext(37752832->38801407) 00002000:00010000:3.0:1788201461.477439:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a19c00 00000100:00100000:3.0:1788201461.477466:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00100000:3.0:1788201461.477473:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559596416:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201461.505119:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559596416:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27632us (27874us total) trans 30064771079 rc 0/0 00000100:00100000:1.0:1788201461.505133:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 78 00002000:00100000:1.0:1788201461.505146:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (37752832->38801407) req@ffff962381a19c00 x1875064559596416/t30064771079(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:582/0 lens 488/448 e 0 to 0 dl 1788201472 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201461.505156:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a19c00 with x1875064559596416 ext(37752832->38801407) 00002000:00010000:1.0:1788201461.505162:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a19c00 00000100:00100000:1.0:1788201461.553812:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201461.553857:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201461.553955:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559596544 00000100:00100000:0.0:1788201461.553965:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559596544 00000100:00100000:0.0:1788201461.554028:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 500 00000100:00100000:0.0:1788201461.554038:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559596544:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201461.554109:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559596544:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 72us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201461.554133:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 500 00000100:00100000:3.0:1788201461.554549:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559596672 00000100:00100000:3.0:1788201461.554555:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559596672 00000100:00100000:3.0:1788201461.554604:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 315 00000100:00100000:3.0:1788201461.554612:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559596672:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201461.554657:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559596672:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 47us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.554664:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 315 00000100:00080000:1.0:1788201461.555147:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201461.562877:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201461.898258:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201461.898475:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559596800 00000100:00100000:3.0:1788201461.898485:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559596800 00002000:00100000:3.0:1788201461.898536:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (38801408->39849983) req@ffff962381a19180 x1875064559596800/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:582/0 lens 488/0 e 0 to 0 dl 1788201472 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201461.898548:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a19180 with x1875064559596800 ext(38801408->39849983) 00002000:00010000:3.0:1788201461.898555:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a19180 00000100:00100000:3.0:1788201461.898589:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 79 00000100:00100000:3.0:1788201461.898599:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559596800:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201461.936490:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559596800:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37878us (38229us total) trans 30064771080 rc 0/0 00000100:00100000:3.0:1788201461.936514:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 79 00002000:00100000:3.0:1788201461.936528:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (38801408->39849983) req@ffff962381a19180 x1875064559596800/t30064771080(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:582/0 lens 488/448 e 0 to 0 dl 1788201472 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201461.936538:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a19180 with x1875064559596800 ext(38801408->39849983) 00002000:00010000:3.0:1788201461.936544:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a19180 00000100:00100000:0.0:1788201462.172273:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201462.172366:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559596928 00000100:00100000:3.0:1788201462.172376:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559596928 00002000:00100000:3.0:1788201462.172427:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (39849984->40898559) req@ffff962492c23800 x1875064559596928/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:583/0 lens 488/0 e 0 to 0 dl 1788201473 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201462.172447:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c23800 with x1875064559596928 ext(39849984->40898559) 00002000:00010000:3.0:1788201462.172453:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c23800 00000100:00100000:0.0:1788201462.172652:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 80 00000100:00100000:0.0:1788201462.172664:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559596928:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201462.204428:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559596928:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31753us (32151us total) trans 30064771081 rc 0/0 00000100:00100000:3.0:1788201462.204443:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 80 00002000:00100000:3.0:1788201462.204456:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (39849984->40898559) req@ffff962492c23800 x1875064559596928/t30064771081(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:583/0 lens 488/448 e 0 to 0 dl 1788201473 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201462.204467:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c23800 with x1875064559596928 ext(39849984->40898559) 00002000:00010000:3.0:1788201462.204472:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c23800 00000100:00100000:2.0:1788201462.328151:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570126464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201462.328226:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201462.328305:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570126464 00000100:00100000:2.0:1788201462.328313:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570126464 00000100:00100000:2.0:1788201462.328403:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788201462.328414:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570126464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201462.328460:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201462.328505:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570126464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201462.328513:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:2.0:1788201462.328533:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788201462.328565:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962382b17480 x1875064570126464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201462.328597:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570126464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201462.339705:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201462.339779:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559597056 00000100:00100000:1.0:1788201462.339790:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559597056 00002000:00100000:1.0:1788201462.339861:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (40898560->41947135) req@ffff962492cbbb80 x1875064559597056/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:583/0 lens 488/0 e 0 to 0 dl 1788201473 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201462.339873:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbbb80 with x1875064559597056 ext(40898560->41947135) 00002000:00010000:1.0:1788201462.339878:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbbb80 00000100:00100000:1.0:1788201462.339916:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 81 00000100:00100000:1.0:1788201462.339926:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559597056:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201462.366876:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559597056:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26939us (27169us total) trans 30064771082 rc 0/0 00000100:00100000:1.0:1788201462.366894:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 81 00002000:00100000:1.0:1788201462.366910:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (40898560->41947135) req@ffff962492cbbb80 x1875064559597056/t30064771082(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:583/0 lens 488/448 e 0 to 0 dl 1788201473 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201462.366924:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbbb80 with x1875064559597056 ext(40898560->41947135) 00002000:00010000:1.0:1788201462.366931:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbbb80 00000100:00100000:1.0:1788201462.583159:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:2.0:1788201462.583243:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201462.583292:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559597184 00000100:00100000:3.0:1788201462.583302:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559597184 00002000:00100000:3.0:1788201462.583478:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (41947136->42995711) req@ffff962381a19500 x1875064559597184/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:583/0 lens 488/0 e 0 to 0 dl 1788201473 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201462.583490:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a19500 with x1875064559597184 ext(41947136->42995711) 00002000:00010000:3.0:1788201462.583510:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a19500 00000100:00100000:3.0:1788201462.583546:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 82 00000100:00100000:3.0:1788201462.583556:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559597184:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201462.635096:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559597184:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 51528us (51936us total) trans 30064771083 rc 0/0 00000100:00100000:1.0:1788201462.635111:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 82 00002000:00100000:1.0:1788201462.635126:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (41947136->42995711) req@ffff962381a19500 x1875064559597184/t30064771083(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:583/0 lens 488/448 e 0 to 0 dl 1788201473 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201462.635137:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a19500 with x1875064559597184 ext(41947136->42995711) 00002000:00010000:1.0:1788201462.635143:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a19500 00000100:00100000:1.0:1788201462.843200:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570126848:0@lo:400:kworker.0 00000100:00100000:1.0:1788201462.843283:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201462.843369:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201462.843376:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570126976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201462.843404:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201462.843440:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570126848 00000100:00100000:1.0:1788201462.843448:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570126848 00000100:00100000:1.0:1788201462.843525:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788201462.843535:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570126848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201462.843589:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570126848:12345-0@lo:400:kworker.0 Request processed in 56us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.843597:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788201462.843618:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570126976 00000100:00100000:1.0:1788201462.843622:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570126976 00000100:00100000:1.0:1788201462.843650:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788201462.843656:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570126976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201462.843685:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570126976:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.843692:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00080000:1.0:1788201462.843707:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201462.843712:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201462.843740:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570126976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201462.843750:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570126848:0@lo:400:kworker.0 00000100:00100000:0.0:1788201462.844421:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570126592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201462.844472:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201462.844507:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570127104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201462.844536:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201462.844556:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201462.844562:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570126720:0@lo:400:kworker.0 00000100:00100000:0.0:1788201462.844583:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201462.844614:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570127104 00000100:00100000:0.0:1788201462.844620:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570127104 00000100:00100000:0.0:1788201462.844662:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570126720 00000100:00100000:0.0:1788201462.844666:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570126720 00000100:00100000:0.0:1788201462.844686:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788201462.844693:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570127104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201462.844736:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570127104:12345-0@lo:400:kworker.0 Request processed in 43us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.844742:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788201462.844755:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788201462.844761:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570126720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201462.844975:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570126720:12345-0@lo:400:kworker.0 Request processed in 214us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.845002:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:0.0:1788201462.845024:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201462.845050:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570126720:0@lo:400:kworker.0 00000100:00100000:0.0:1788201462.845059:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570127104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201462.845171:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570126592 00000100:00100000:1.0:1788201462.845175:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570126592 00000100:00100000:1.0:1788201462.845211:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1788201462.845217:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570126592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201462.845253:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570126592:12345-0@lo:400:kworker.0 Request processed in 36us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.845260:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1788201462.846020:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570126592:0@lo:400:kworker.0 00000100:00100000:2.0:1788201463.016083:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201463.016152:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559597312 00000100:00100000:3.0:1788201463.016162:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559597312 00002000:00100000:3.0:1788201463.016233:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (42995712->44044287) req@ffff962382b17480 x1875064559597312/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:584/0 lens 488/0 e 0 to 0 dl 1788201474 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201463.016245:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17480 with x1875064559597312 ext(42995712->44044287) 00002000:00010000:3.0:1788201463.016251:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17480 00000100:00100000:3.0:1788201463.016289:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 83 00000100:00100000:3.0:1788201463.016298:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559597312:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201463.016415:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201463.052273:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559597312:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35961us (36186us total) trans 30064771084 rc 0/0 00000100:00100000:3.0:1788201463.052291:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 83 00002000:00100000:3.0:1788201463.052307:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (42995712->44044287) req@ffff962382b17480 x1875064559597312/t30064771084(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:584/0 lens 488/448 e 0 to 0 dl 1788201474 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201463.052318:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17480 with x1875064559597312 ext(42995712->44044287) 00002000:00010000:3.0:1788201463.052324:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17480 00000100:00100000:2.0:1788201463.277192:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201463.277336:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559597440 00000100:00100000:1.0:1788201463.277368:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559597440 00002000:00100000:1.0:1788201463.277426:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (44044288->45092863) req@ffff962382b14000 x1875064559597440/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:584/0 lens 488/0 e 0 to 0 dl 1788201474 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201463.277459:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14000 with x1875064559597440 ext(44044288->45092863) 00002000:00010000:1.0:1788201463.277466:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14000 00000100:00100000:1.0:1788201463.277503:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 84 00000100:00100000:1.0:1788201463.277515:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559597440:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201463.299412:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559597440:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21886us (22219us total) trans 30064771085 rc 0/0 00000100:00100000:1.0:1788201463.299429:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 84 00002000:00100000:1.0:1788201463.299442:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (44044288->45092863) req@ffff962382b14000 x1875064559597440/t30064771085(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:584/0 lens 488/448 e 0 to 0 dl 1788201474 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201463.299453:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14000 with x1875064559597440 ext(44044288->45092863) 00002000:00010000:1.0:1788201463.299459:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14000 00000100:00100000:0.0:1788201463.569470:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201463.569539:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559597568 00000100:00100000:2.0:1788201463.569549:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559597568 00002000:00100000:2.0:1788201463.569607:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (45092864->46141439) req@ffff9624bfd0fb80 x1875064559597568/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:584/0 lens 488/0 e 0 to 0 dl 1788201474 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201463.569619:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd0fb80 with x1875064559597568 ext(45092864->46141439) 00002000:00010000:2.0:1788201463.569626:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd0fb80 00000100:00100000:2.0:1788201463.569660:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 85 00000100:00100000:2.0:1788201463.569670:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559597568:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:0.0:1788201463.607783:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201463.612626:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559597568:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 42944us (43162us total) trans 30064771086 rc 0/0 00000100:00100000:0.0:1788201463.612642:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 85 00002000:00100000:0.0:1788201463.612654:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (45092864->46141439) req@ffff9624bfd0fb80 x1875064559597568/t30064771086(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:584/0 lens 488/448 e 0 to 0 dl 1788201474 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201463.612665:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd0fb80 with x1875064559597568 ext(45092864->46141439) 00002000:00010000:0.0:1788201463.612672:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd0fb80 00000100:00100000:1.0:1788201463.934084:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201463.934170:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559597696 00000100:00100000:3.0:1788201463.934180:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559597696 00002000:00100000:3.0:1788201463.934226:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (46141440->47190015) req@ffff9624ba470380 x1875064559597696/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:584/0 lens 488/0 e 0 to 0 dl 1788201474 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201463.934238:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba470380 with x1875064559597696 ext(46141440->47190015) 00002000:00010000:3.0:1788201463.934244:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba470380 00000100:00100000:3.0:1788201463.934283:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 86 00000100:00100000:3.0:1788201463.934294:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559597696:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201463.966682:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559597696:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32377us (32595us total) trans 30064771087 rc 0/0 00000100:00100000:0.0:1788201463.966696:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 86 00002000:00100000:0.0:1788201463.966709:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (46141440->47190015) req@ffff9624ba470380 x1875064559597696/t30064771087(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:584/0 lens 488/448 e 0 to 0 dl 1788201474 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201463.966718:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba470380 with x1875064559597696 ext(46141440->47190015) 00002000:00010000:0.0:1788201463.966724:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba470380 00000100:00100000:0.0:1788201464.395467:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201464.395572:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559597824 00000100:00100000:3.0:1788201464.395583:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559597824 00002000:00100000:3.0:1788201464.395640:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (47190016->48238591) req@ffff962381a18000 x1875064559597824/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:585/0 lens 488/0 e 0 to 0 dl 1788201475 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201464.395650:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a18000 with x1875064559597824 ext(47190016->48238591) 00002000:00010000:3.0:1788201464.395655:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a18000 00000100:00100000:3.0:1788201464.395686:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 87 00000100:00100000:3.0:1788201464.395697:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559597824:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201464.418053:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559597824:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22347us (22587us total) trans 30064771088 rc 0/0 00000100:00100000:3.0:1788201464.418068:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 87 00002000:00100000:3.0:1788201464.418082:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (47190016->48238591) req@ffff962381a18000 x1875064559597824/t30064771088(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:585/0 lens 488/448 e 0 to 0 dl 1788201475 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201464.418094:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a18000 with x1875064559597824 ext(47190016->48238591) 00002000:00010000:3.0:1788201464.418100:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a18000 00010000:00010000:0.0:1788201464.635176:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201464.891113:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201464.891137:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570127232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201464.891212:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201464.891284:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570127232 00000100:00100000:1.0:1788201464.891292:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570127232 00000100:00100000:1.0:1788201464.891371:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788201464.891381:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570127232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201464.891405:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 92864512 pending 47710208 free 3825205248 avail 3823108096 00000100:00100000:1.0:1788201464.891460:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570127232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201464.891467:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:1.0:1788201464.891502:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201464.891538:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570127232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201465.040900:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201465.041396:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559597952 00000100:00100000:0.0:1788201465.041407:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559597952 00002000:00100000:0.0:1788201465.041530:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (48238592->49287167) req@ffff962382b14e00 x1875064559597952/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:586/0 lens 488/0 e 0 to 0 dl 1788201476 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201465.041542:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14e00 with x1875064559597952 ext(48238592->49287167) 00002000:00010000:0.0:1788201465.041548:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14e00 00000100:00100000:0.0:1788201465.041576:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 88 00000100:00100000:0.0:1788201465.041587:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559597952:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201465.049784:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201465.100903:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559597952:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 59304us (60007us total) trans 30064771089 rc 0/0 00000100:00100000:1.0:1788201465.100920:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 88 00002000:00100000:1.0:1788201465.100936:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (48238592->49287167) req@ffff962382b14e00 x1875064559597952/t30064771089(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:586/0 lens 488/448 e 0 to 0 dl 1788201476 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201465.100958:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14e00 with x1875064559597952 ext(48238592->49287167) 00002000:00010000:1.0:1788201465.100965:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14e00 00000100:00100000:1.0:1788201465.460254:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201465.460309:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559598080 00000100:00100000:1.0:1788201465.460319:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559598080 00002000:00100000:1.0:1788201465.460377:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (49287168->50335743) req@ffff9624ba470700 x1875064559598080/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:586/0 lens 488/0 e 0 to 0 dl 1788201476 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201465.460389:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba470700 with x1875064559598080 ext(49287168->50335743) 00002000:00010000:1.0:1788201465.460394:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba470700 00000100:00100000:1.0:1788201465.461137:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 89 00000100:00100000:1.0:1788201465.461150:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559598080:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201465.510833:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559598080:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 49670us (50574us total) trans 30064771090 rc 0/0 00000100:00100000:0.0:1788201465.510852:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 89 00002000:00100000:0.0:1788201465.510865:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (49287168->50335743) req@ffff9624ba470700 x1875064559598080/t30064771090(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:586/0 lens 488/448 e 0 to 0 dl 1788201476 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201465.510877:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba470700 with x1875064559598080 ext(49287168->50335743) 00002000:00010000:0.0:1788201465.510883:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba470700 00000001:00080000:0.0:1788201465.598612:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771087 is committed 00000001:00080000:0.0:1788201465.598641:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771089 is committed 00010000:00010000:1.0:1788201465.655808:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201465.739123:0:20028:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788201465.971138:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201465.971228:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559598208 00000100:00100000:3.0:1788201465.971240:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559598208 00002000:00100000:3.0:1788201465.971294:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (50335744->51384319) req@ffff9624bb8b8380 x1875064559598208/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:586/0 lens 488/0 e 0 to 0 dl 1788201476 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201465.971307:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b8380 with x1875064559598208 ext(50335744->51384319) 00002000:00010000:3.0:1788201465.971325:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b8380 00000100:00100000:3.0:1788201465.971380:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 90 00000100:00100000:3.0:1788201465.971393:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559598208:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201466.029661:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559598208:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 58258us (58523us total) trans 30064771091 rc 0/0 00000100:00100000:0.0:1788201466.029678:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 90 00002000:00100000:0.0:1788201466.029693:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (50335744->51384319) req@ffff9624bb8b8380 x1875064559598208/t30064771091(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:586/0 lens 488/448 e 0 to 0 dl 1788201476 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201466.029705:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b8380 with x1875064559598208 ext(50335744->51384319) 00002000:00010000:0.0:1788201466.029720:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b8380 00000100:00100000:0.0:1788201466.369439:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201466.369622:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559598336 00000100:00100000:3.0:1788201466.369638:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559598336 00002000:00100000:3.0:1788201466.369792:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (51384320->52432895) req@ffff962381a18e00 x1875064559598336/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:587/0 lens 488/0 e 0 to 0 dl 1788201477 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201466.369805:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a18e00 with x1875064559598336 ext(51384320->52432895) 00002000:00010000:3.0:1788201466.369812:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a18e00 00000100:00100000:0.0:1788201466.369940:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 91 00000100:00100000:0.0:1788201466.369954:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559598336:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201466.397614:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559598336:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27651us (28172us total) trans 30064771092 rc 0/0 00000100:00100000:1.0:1788201466.397629:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 91 00002000:00100000:1.0:1788201466.397642:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (51384320->52432895) req@ffff962381a18e00 x1875064559598336/t30064771092(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:587/0 lens 488/448 e 0 to 0 dl 1788201477 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201466.397671:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a18e00 with x1875064559598336 ext(51384320->52432895) 00002000:00010000:1.0:1788201466.397677:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a18e00 00010000:00010000:3.0:1788201466.691618:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201466.691732:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201466.691781:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201466.691806:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559598464 00000100:00100000:2.0:1788201466.691815:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559598464 00000100:00100000:2.0:1788201466.694040:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 502 00000100:00100000:2.0:1788201466.694064:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559598464:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201466.694149:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559598464:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 97us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201466.694157:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 502 00000100:00100000:3.0:1788201466.694399:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559598592 00000100:00100000:3.0:1788201466.694409:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559598592 00000100:00100000:3.0:1788201466.694465:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 319 00000100:00100000:3.0:1788201466.694474:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559598592:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201466.694515:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559598592:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 43us (2789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201466.694522:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 319 00000100:00080000:2.0:1788201466.694588:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201466.731644:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201466.731740:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559598720 00000100:00100000:1.0:1788201466.731753:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559598720 00002000:00100000:1.0:1788201466.731816:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (52432896->53481471) req@ffff962382b16d80 x1875064559598720/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:587/0 lens 488/0 e 0 to 0 dl 1788201477 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201466.731828:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b16d80 with x1875064559598720 ext(52432896->53481471) 00002000:00010000:1.0:1788201466.731834:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b16d80 00000100:00100000:1.0:1788201466.731876:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 92 00000100:00100000:1.0:1788201466.731888:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559598720:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201466.744009:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559598720:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12111us (12363us total) trans 30064771093 rc 0/0 00000100:00100000:0.0:1788201466.744029:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 92 00002000:00100000:0.0:1788201466.744043:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (52432896->53481471) req@ffff962382b16d80 x1875064559598720/t30064771093(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:587/0 lens 488/448 e 0 to 0 dl 1788201477 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201466.744055:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b16d80 with x1875064559598720 ext(52432896->53481471) 00002000:00010000:0.0:1788201466.744061:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b16d80 00000100:00100000:2.0:1788201466.993531:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201466.993647:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559598848 00000100:00100000:3.0:1788201466.993657:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559598848 00002000:00100000:3.0:1788201466.993700:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (53481472->54530047) req@ffff962382b15c00 x1875064559598848/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:587/0 lens 488/0 e 0 to 0 dl 1788201477 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201466.993711:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15c00 with x1875064559598848 ext(53481472->54530047) 00002000:00010000:3.0:1788201466.993717:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15c00 00000100:00100000:3.0:1788201466.993748:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 93 00000100:00100000:3.0:1788201466.993756:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559598848:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201467.028081:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559598848:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34312us (34545us total) trans 30064771094 rc 0/0 00000100:00100000:1.0:1788201467.028096:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 93 00002000:00100000:1.0:1788201467.028111:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (53481472->54530047) req@ffff962382b15c00 x1875064559598848/t30064771094(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:587/0 lens 488/448 e 0 to 0 dl 1788201477 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201467.028121:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15c00 with x1875064559598848 ext(53481472->54530047) 00002000:00010000:1.0:1788201467.028128:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15c00 00000100:00100000:0.0:1788201467.309926:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201467.312037:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559598976 00000100:00100000:2.0:1788201467.312053:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559598976 00002000:00100000:2.0:1788201467.312157:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (54530048->55578623) req@ffff9624c1cc4a80 x1875064559598976/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:588/0 lens 488/0 e 0 to 0 dl 1788201478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201467.312169:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4a80 with x1875064559598976 ext(54530048->55578623) 00002000:00010000:2.0:1788201467.312175:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4a80 00000100:00100000:2.0:1788201467.312209:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 94 00000100:00100000:2.0:1788201467.312220:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559598976:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201467.324118:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201467.358356:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559598976:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 46111us (48424us total) trans 30064771095 rc 0/0 00000100:00100000:3.0:1788201467.358376:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 94 00002000:00100000:3.0:1788201467.360494:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (54530048->55578623) req@ffff9624c1cc4a80 x1875064559598976/t30064771095(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:588/0 lens 488/448 e 0 to 0 dl 1788201478 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201467.360507:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4a80 with x1875064559598976 ext(54530048->55578623) 00002000:00010000:3.0:1788201467.360515:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4a80 00000100:00100000:0.0:1788201467.446612:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570127360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201467.446772:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201467.446863:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570127360 00000100:00100000:1.0:1788201467.446872:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570127360 00000100:00100000:1.0:1788201467.446961:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788201467.446971:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570127360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201467.447009:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788201467.447148:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201467.452279:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570127360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5296us (5493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201467.452316:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00010000:00080000:0.0:1788201467.456697:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962382b17100 x1875064570127360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201467.456727:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570127360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201467.593122:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201467.593216:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559599104 00000100:00100000:0.0:1788201467.593225:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559599104 00002000:00100000:0.0:1788201467.593290:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (55578624->56627199) req@ffff962382b17100 x1875064559599104/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:588/0 lens 488/0 e 0 to 0 dl 1788201478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201467.593302:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17100 with x1875064559599104 ext(55578624->56627199) 00002000:00010000:0.0:1788201467.593308:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17100 00000100:00100000:0.0:1788201467.593360:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 95 00000100:00100000:0.0:1788201467.593378:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559599104:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201467.637759:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559599104:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 44372us (44635us total) trans 30064771096 rc 0/0 00000100:00100000:1.0:1788201467.637774:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 95 00002000:00100000:1.0:1788201467.637788:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (55578624->56627199) req@ffff962382b17100 x1875064559599104/t30064771096(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:588/0 lens 488/448 e 0 to 0 dl 1788201478 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201467.637798:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17100 with x1875064559599104 ext(55578624->56627199) 00002000:00010000:1.0:1788201467.637804:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17100 00010000:00010000:2.0:1788201467.709386:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201467.872507:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201467.872742:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559599232 00000100:00100000:1.0:1788201467.872752:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559599232 00002000:00100000:1.0:1788201467.872804:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (56627200->57675775) req@ffff9624c1cc5500 x1875064559599232/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:588/0 lens 488/0 e 0 to 0 dl 1788201478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201467.872815:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5500 with x1875064559599232 ext(56627200->57675775) 00002000:00010000:1.0:1788201467.872820:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5500 00000100:00100000:1.0:1788201467.872858:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 96 00000100:00100000:1.0:1788201467.872868:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559599232:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201467.912790:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559599232:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39909us (40279us total) trans 30064771097 rc 0/0 00000100:00100000:1.0:1788201467.912805:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 96 00002000:00100000:1.0:1788201467.912819:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (56627200->57675775) req@ffff9624c1cc5500 x1875064559599232/t30064771097(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:588/0 lens 488/448 e 0 to 0 dl 1788201478 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201467.912830:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5500 with x1875064559599232 ext(56627200->57675775) 00002000:00010000:1.0:1788201467.912836:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5500 00000100:00100000:0.0:1788201467.958909:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570127872:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.958988:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201467.959060:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201467.959067:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570127488:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.959094:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201467.959117:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570128000:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.959144:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201467.959171:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570127616:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.959193:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201467.959209:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570128128:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.959228:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201467.959255:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201467.959261:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570127744:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.959281:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201467.959309:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570127872 00000100:00100000:0.0:1788201467.959315:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570127872 00000100:00100000:0.0:1788201467.959380:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570127616 00000100:00100000:0.0:1788201467.959501:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570127616 00000100:00100000:0.0:1788201467.959521:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570128128 00000100:00100000:0.0:1788201467.959523:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570128128 00000100:00100000:0.0:1788201467.959539:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788201467.959547:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570127872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.959600:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570127872:12345-0@lo:400:kworker.0 Request processed in 53us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201467.959623:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788201467.959639:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788201467.959644:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570127616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.959677:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570127616:12345-0@lo:400:kworker.0 Request processed in 33us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201467.959683:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788201467.959695:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788201467.959701:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570128128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.959726:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570128128:12345-0@lo:400:kworker.0 Request processed in 26us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201467.959732:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788201467.959748:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570127488 00000100:00100000:0.0:1788201467.959752:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570127488 00000100:00100000:0.0:1788201467.959775:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1788201467.959781:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570127488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.959806:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570127488:12345-0@lo:400:kworker.0 Request processed in 26us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201467.959812:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1788201467.959836:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570128000 00000100:00100000:0.0:1788201467.959839:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570128000 00000100:00100000:0.0:1788201467.959860:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570127744 00000100:00100000:0.0:1788201467.959862:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570127744 00000100:00100000:0.0:1788201467.959876:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788201467.959881:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570128000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.959923:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570128000:12345-0@lo:400:kworker.0 Request processed in 41us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201467.959938:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788201467.959949:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788201467.959955:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570127744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.959984:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570127744:12345-0@lo:400:kworker.0 Request processed in 30us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201467.959989:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788201467.960035:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570127744:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.960044:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570127616:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.960052:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570128128:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.960078:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570127488:0@lo:400:kworker.0 00010000:00080000:0.0:1788201467.960089:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1cc5880 x1875064570128000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201467.960100:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570128000:0@lo:400:kworker.0 00000100:00100000:0.0:1788201467.960109:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570127872:0@lo:400:kworker.0 00000100:00080000:3.0:1788201467.962368:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201467.962375:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201468.243959:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201468.244074:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559599360 00000100:00100000:1.0:1788201468.244085:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559599360 00002000:00100000:1.0:1788201468.244142:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (57675776->58724351) req@ffff962492cb8380 x1875064559599360/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:589/0 lens 488/0 e 0 to 0 dl 1788201479 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201468.244155:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb8380 with x1875064559599360 ext(57675776->58724351) 00002000:00010000:1.0:1788201468.244161:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb8380 00000100:00100000:1.0:1788201468.244200:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 97 00000100:00100000:1.0:1788201468.244211:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559599360:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201468.274356:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559599360:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30121us (30382us total) trans 30064771098 rc 0/0 00000100:00100000:2.0:1788201468.280937:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 97 00002000:00100000:2.0:1788201468.280963:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (57675776->58724351) req@ffff962492cb8380 x1875064559599360/t30064771098(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:589/0 lens 488/448 e 0 to 0 dl 1788201479 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201468.280974:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb8380 with x1875064559599360 ext(57675776->58724351) 00002000:00010000:2.0:1788201468.280981:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb8380 00000100:00100000:0.0:1788201468.518119:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201468.518275:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559599488 00000100:00100000:3.0:1788201468.518285:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559599488 00002000:00100000:3.0:1788201468.518329:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (58724352->59772927) req@ffff9624c1cc4700 x1875064559599488/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:589/0 lens 488/0 e 0 to 0 dl 1788201479 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201468.518338:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4700 with x1875064559599488 ext(58724352->59772927) 00002000:00010000:3.0:1788201468.518482:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4700 00000100:00100000:3.0:1788201468.518512:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 98 00000100:00100000:3.0:1788201468.518523:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559599488:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201468.559299:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559599488:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 40765us (41180us total) trans 30064771099 rc 0/0 00000100:00100000:0.0:1788201468.559315:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 98 00002000:00100000:0.0:1788201468.559331:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (58724352->59772927) req@ffff9624c1cc4700 x1875064559599488/t30064771099(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:589/0 lens 488/448 e 0 to 0 dl 1788201479 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201468.559385:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4700 with x1875064559599488 ext(58724352->59772927) 00002000:00010000:0.0:1788201468.559402:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4700 00010000:00010000:1.0:1788201468.726631:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201468.808660:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201468.808765:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559599616 00000100:00100000:1.0:1788201468.808776:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559599616 00002000:00100000:1.0:1788201468.808830:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (59772928->60821503) req@ffff9624c1cc5880 x1875064559599616/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:589/0 lens 488/0 e 0 to 0 dl 1788201479 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201468.808841:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5880 with x1875064559599616 ext(59772928->60821503) 00002000:00010000:1.0:1788201468.808847:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5880 00000100:00100000:1.0:1788201468.808893:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 99 00000100:00100000:1.0:1788201468.808903:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559599616:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201468.823471:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559599616:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14556us (14809us total) trans 30064771100 rc 0/0 00000100:00100000:1.0:1788201468.823487:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 99 00002000:00100000:1.0:1788201468.823503:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (59772928->60821503) req@ffff9624c1cc5880 x1875064559599616/t30064771100(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:589/0 lens 488/448 e 0 to 0 dl 1788201479 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201468.823515:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5880 with x1875064559599616 ext(59772928->60821503) 00002000:00010000:1.0:1788201468.823522:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5880 00000100:00100000:2.0:1788201468.930410:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201468.930651:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559599744 00000100:00100000:1.0:1788201468.930661:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559599744 00002000:00100000:1.0:1788201468.930723:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (60821504->61870079) req@ffff962382b16300 x1875064559599744/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:589/0 lens 488/0 e 0 to 0 dl 1788201479 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201468.930735:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b16300 with x1875064559599744 ext(60821504->61870079) 00002000:00010000:1.0:1788201468.930741:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b16300 00000100:00100000:1.0:1788201468.930831:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 100 00000100:00100000:1.0:1788201468.930843:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559599744:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201468.943592:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559599744:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12739us (13182us total) trans 30064771101 rc 0/0 00000100:00100000:1.0:1788201468.943609:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 100 00002000:00100000:1.0:1788201468.943626:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (60821504->61870079) req@ffff962382b16300 x1875064559599744/t30064771101(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:589/0 lens 488/448 e 0 to 0 dl 1788201479 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201468.943638:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b16300 with x1875064559599744 ext(60821504->61870079) 00002000:00010000:1.0:1788201468.943645:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b16300 00000100:00100000:3.0:1788201469.071842:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201469.073040:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559599872 00000100:00100000:2.0:1788201469.073055:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559599872 00002000:00100000:2.0:1788201469.073131:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (61870080->62918655) req@ffff962492cbb100 x1875064559599872/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:590/0 lens 488/0 e 0 to 0 dl 1788201480 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201469.073144:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbb100 with x1875064559599872 ext(61870080->62918655) 00002000:00010000:2.0:1788201469.073167:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbb100 00000100:00100000:2.0:1788201469.073218:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 101 00000100:00100000:2.0:1788201469.073232:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559599872:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201469.076502:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201469.089669:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559599872:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16427us (17824us total) trans 30064771102 rc 0/0 00000100:00100000:1.0:1788201469.089685:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 101 00002000:00100000:1.0:1788201469.089703:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (61870080->62918655) req@ffff962492cbb100 x1875064559599872/t30064771102(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:590/0 lens 488/448 e 0 to 0 dl 1788201480 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201469.089714:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbb100 with x1875064559599872 ext(61870080->62918655) 00002000:00010000:1.0:1788201469.089721:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbb100 00000100:00100000:2.0:1788201469.272843:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201469.272964:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559600000 00000100:00100000:0.0:1788201469.272973:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559600000 00002000:00100000:0.0:1788201469.273026:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (62918656->63967231) req@ffff962382b15180 x1875064559600000/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:590/0 lens 488/0 e 0 to 0 dl 1788201480 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201469.273036:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15180 with x1875064559600000 ext(62918656->63967231) 00002000:00010000:0.0:1788201469.273040:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15180 00000100:00100000:0.0:1788201469.273073:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 102 00000100:00100000:0.0:1788201469.273082:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559600000:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201469.285299:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559600000:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12205us (12454us total) trans 30064771103 rc 0/0 00000100:00100000:1.0:1788201469.285326:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 102 00002000:00100000:1.0:1788201469.285363:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (62918656->63967231) req@ffff962382b15180 x1875064559600000/t30064771103(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:590/0 lens 488/448 e 0 to 0 dl 1788201480 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201469.285375:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15180 with x1875064559600000 ext(62918656->63967231) 00002000:00010000:1.0:1788201469.285381:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15180 00000100:00100000:2.0:1788201469.619776:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201469.619968:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559600128 00000100:00100000:1.0:1788201469.619979:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559600128 00002000:00100000:1.0:1788201469.620030:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (63967232->65015807) req@ffff962382b15880 x1875064559600128/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:590/0 lens 488/0 e 0 to 0 dl 1788201480 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201469.620042:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15880 with x1875064559600128 ext(63967232->65015807) 00002000:00010000:1.0:1788201469.620048:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15880 00000100:00100000:1.0:1788201469.620083:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 103 00000100:00100000:1.0:1788201469.620093:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559600128:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201469.648772:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559600128:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28662us (28990us total) trans 30064771104 rc 0/0 00000100:00100000:1.0:1788201469.648789:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 103 00002000:00100000:1.0:1788201469.648805:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (63967232->65015807) req@ffff962382b15880 x1875064559600128/t30064771104(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:590/0 lens 488/448 e 0 to 0 dl 1788201480 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201469.648817:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15880 with x1875064559600128 ext(63967232->65015807) 00002000:00010000:1.0:1788201469.648825:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15880 00010000:00010000:3.0:1788201469.751389:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201470.006690:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201470.006717:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570128256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201470.006790:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201470.006924:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570128256 00000100:00100000:1.0:1788201470.006932:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570128256 00000100:00100000:1.0:1788201470.006999:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788201470.007023:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570128256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201470.007050:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 96272384 pending 51118080 free 3809476608 avail 3807379456 00000100:00100000:1.0:1788201470.007098:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570128256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201470.007104:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:2.0:1788201470.007490:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201470.007533:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570128256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201470.174733:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201470.174908:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559600256 00000100:00100000:1.0:1788201470.174917:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559600256 00002000:00100000:1.0:1788201470.174967:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (65015808->66064383) req@ffff9624c1cc4380 x1875064559600256/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:591/0 lens 488/0 e 0 to 0 dl 1788201481 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201470.174979:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4380 with x1875064559600256 ext(65015808->66064383) 00002000:00010000:1.0:1788201470.174984:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4380 00000100:00100000:1.0:1788201470.175026:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 104 00000100:00100000:1.0:1788201470.175035:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559600256:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201470.214308:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559600256:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39259us (39571us total) trans 30064771105 rc 0/0 00000100:00100000:1.0:1788201470.214327:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 104 00002000:00100000:1.0:1788201470.214372:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (65015808->66064383) req@ffff9624c1cc4380 x1875064559600256/t30064771105(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:591/0 lens 488/448 e 0 to 0 dl 1788201481 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201470.214384:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4380 with x1875064559600256 ext(65015808->66064383) 00002000:00010000:1.0:1788201470.214392:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4380 00000100:00100000:0.0:1788201470.500446:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201470.500541:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559600384 00000100:00100000:2.0:1788201470.500551:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559600384 00002000:00100000:2.0:1788201470.500606:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (66064384->67112959) req@ffff9624c1cc6300 x1875064559600384/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:591/0 lens 488/0 e 0 to 0 dl 1788201481 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201470.500617:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6300 with x1875064559600384 ext(66064384->67112959) 00002000:00010000:2.0:1788201470.500621:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6300 00000100:00100000:2.0:1788201470.500657:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 105 00000100:00100000:2.0:1788201470.500666:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559600384:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201470.547861:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2342:x1875064559600384:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 47174us (47402us total) trans 30064771106 rc 0/0 00000100:00100000:3.0:1788201470.547892:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 105 00002000:00100000:3.0:1788201470.547910:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (66064384->67112959) req@ffff9624c1cc6300 x1875064559600384/t30064771106(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:591/0 lens 488/448 e 0 to 0 dl 1788201481 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201470.547919:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6300 with x1875064559600384 ext(66064384->67112959) 00002000:00010000:3.0:1788201470.547926:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6300 00000001:00080000:2.0:1788201470.586289:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771099 is committed 00000001:00080000:2.0:1788201470.586325:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771105 is committed 00010000:00010000:2.0:1788201470.775044:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201470.802784:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201470.805073:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559600512 00000100:00100000:0.0:1788201470.805087:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559600512 00002000:00100000:0.0:1788201470.805146:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (67112960->68161535) req@ffff9624bfd2ca80 x1875064559600512/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:591/0 lens 488/0 e 0 to 0 dl 1788201481 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201470.805157:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2ca80 with x1875064559600512 ext(67112960->68161535) 00002000:00010000:0.0:1788201470.805162:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2ca80 00000100:00100000:0.0:1788201470.805267:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 106 00000100:00100000:0.0:1788201470.805277:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559600512:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201470.835628:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201470.836088:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559600640 00000100:00100000:0.0:1788201470.836098:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559600640 00000100:00100000:0.0:1788201470.836184:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 103 00000100:00100000:0.0:1788201470.836206:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:17762:x1875064559600640:12345-192.168.201.56@tcp:41:lfs.0 00000004:00000024:0.0:1788201470.836251:0:5826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788201470.836917:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:17762:x1875064559600640:12345-192.168.201.56@tcp:41:lfs.0 Request processed in 721us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201470.836926:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 103 00000100:00080000:2.0:1788201470.837102:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201470.846667:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559600512:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 41381us (43883us total) trans 30064771107 rc 0/0 00000100:00100000:0.0:1788201470.846681:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 106 00002000:00100000:0.0:1788201470.846694:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (67112960->68161535) req@ffff9624bfd2ca80 x1875064559600512/t30064771107(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:591/0 lens 488/448 e 0 to 0 dl 1788201481 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201470.846868:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2ca80 with x1875064559600512 ext(67112960->68161535) 00002000:00010000:0.0:1788201470.846876:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2ca80 00000100:00100000:0.0:1788201470.855611:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201470.855870:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559600768 00000100:00100000:1.0:1788201470.855879:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559600768 00000100:00100000:1.0:1788201470.855937:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 183 00000100:00100000:1.0:1788201470.855945:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:17762:x1875064559600768:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:1.0:1788201470.855987:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51970048 pending 6815744 free 3809476608 avail 3757047808 00000100:00100000:1.0:1788201470.856067:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:17762:x1875064559600768:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 122us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201470.856073:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 183 00000100:00100000:2.0:1788201470.867756:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201470.868069:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559600896 00000100:00100000:0.0:1788201470.868081:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559600896 00000100:00100000:0.0:1788201470.868137:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 159 00000100:00100000:0.0:1788201470.868146:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875064559600896:12345-192.168.201.56@tcp:8:lfs.0 00010000:00080000:0.0:1788201470.868186:0:6671:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp t0 exp 0000000000000000 cur 602 last 0 00000020:00000080:0.0:1788201470.868236:0:6671:0:(genops.c:1406:class_connect()) connect: client 986744c8-ee81-4a47-8d91-97f81ede1f3e, cookie 0xa81c4c9a2f3cb729 00002000:00100000:0.0:1788201470.868247:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 986744c8-ee81-4a47-8d91-97f81ede1f3e/ffff962485918000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201470.868271:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:0.0:1788201470.868545:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788201470.868576:0:6671:0:(import.c:65:import_set_state_nolock()) ffff96248591e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201470.868657:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2340:x1875064559600896:12345-192.168.201.56@tcp:8:lfs.0 Request processed in 511us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201470.868664:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 159 00000100:00100000:3.0:1788201470.871128:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201470.871221:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559601024 00000100:00100000:1.0:1788201470.871230:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559601024 00000100:00100000:1.0:1788201470.871301:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 184 00000100:00100000:1.0:1788201470.871311:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:17762:x1875064559601024:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:1.0:1788201470.871377:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201470.871449:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:17762:x1875064559601024:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 140us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201470.871457:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 184 00000100:00080000:2.0:1788201470.871523:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201471.189325:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201471.189452:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559601152 00000100:00100000:1.0:1788201471.189462:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559601152 00002000:00100000:1.0:1788201471.189535:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (68161536->69210111) req@ffff9624ba116300 x1875064559601152/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:592/0 lens 488/0 e 0 to 0 dl 1788201482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201471.189547:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba116300 with x1875064559601152 ext(68161536->69210111) 00002000:00010000:1.0:1788201471.189552:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba116300 00000100:00100000:1.0:1788201471.189579:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 107 00000100:00100000:1.0:1788201471.189588:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559601152:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201471.190378:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201471.215565:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2341:x1875064559601152:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25966us (26237us total) trans 30064771108 rc 0/0 00000100:00100000:1.0:1788201471.215580:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 107 00002000:00100000:1.0:1788201471.215605:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (68161536->69210111) req@ffff9624ba116300 x1875064559601152/t30064771108(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:592/0 lens 488/448 e 0 to 0 dl 1788201482 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201471.215625:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba116300 with x1875064559601152 ext(68161536->69210111) 00002000:00010000:1.0:1788201471.215631:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba116300 00000100:00100000:3.0:1788201471.441289:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201471.444131:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559601280 00000100:00100000:1.0:1788201471.444146:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559601280 00002000:00100000:1.0:1788201471.444204:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (69210112->70258687) req@ffff9624ba114700 x1875064559601280/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:592/0 lens 488/0 e 0 to 0 dl 1788201482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201471.444217:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba114700 with x1875064559601280 ext(69210112->70258687) 00002000:00010000:1.0:1788201471.444223:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba114700 00000100:00100000:1.0:1788201471.444262:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 108 00000100:00100000:1.0:1788201471.444273:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559601280:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201471.492318:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559601280:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 48030us (51024us total) trans 30064771109 rc 0/0 00000100:00100000:1.0:1788201471.492337:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 108 00002000:00100000:1.0:1788201471.492384:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (69210112->70258687) req@ffff9624ba114700 x1875064559601280/t30064771109(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:592/0 lens 488/448 e 0 to 0 dl 1788201482 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201471.492396:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba114700 with x1875064559601280 ext(69210112->70258687) 00002000:00010000:1.0:1788201471.492403:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba114700 00010000:00010000:1.0:1788201471.799505:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201471.802277:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201471.802490:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559601536 00000100:00100000:1.0:1788201471.802500:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559601536 00000100:00100000:1.0:1788201471.802563:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 323 00000100:00100000:1.0:1788201471.802571:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559601536:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201471.806254:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559601536:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 3667us (3972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201471.806282:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 323 00000100:00100000:3.0:1788201471.807641:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201471.807715:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201471.807809:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559601408 00000100:00100000:2.0:1788201471.807818:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559601408 00000100:00100000:2.0:1788201471.807889:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 504 00000100:00100000:2.0:1788201471.807898:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559601408:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201471.807962:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559601408:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201471.807968:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 504 00000100:00100000:0.0:1788201471.812592:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559601664 00000100:00100000:0.0:1788201471.812625:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559601664 00000100:00100000:0.0:1788201471.812694:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 202 00000100:00100000:0.0:1788201471.812703:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559601664:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201471.812783:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559601664:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 80us (5068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.812790:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 202 00000100:00100000:2.0:1788201471.933394:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201471.933561:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559601792 00000100:00100000:3.0:1788201471.933571:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559601792 00002000:00100000:3.0:1788201471.933623:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (70258688->71307263) req@ffff9624b9d63480 x1875064559601792/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:592/0 lens 488/0 e 0 to 0 dl 1788201482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201471.933634:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d63480 with x1875064559601792 ext(70258688->71307263) 00002000:00010000:3.0:1788201471.933641:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d63480 00000100:00100000:3.0:1788201471.933677:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 109 00000100:00100000:3.0:1788201471.933687:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2341:x1875064559601792:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201471.994431:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559601792:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 60732us (61035us total) trans 30064771110 rc 0/0 00000100:00100000:3.0:1788201471.994447:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 109 00002000:00100000:3.0:1788201471.994463:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (70258688->71307263) req@ffff9624b9d63480 x1875064559601792/t30064771110(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:592/0 lens 488/448 e 0 to 0 dl 1788201482 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201471.994492:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d63480 with x1875064559601792 ext(70258688->71307263) 00002000:00010000:3.0:1788201471.994499:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d63480 00000100:00100000:0.0:1788201472.384506:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201472.387790:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559601920 00000100:00100000:1.0:1788201472.387806:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559601920 00002000:00100000:1.0:1788201472.387878:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (71307264->72355839) req@ffff9624c1cc7b80 x1875064559601920/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:593/0 lens 488/0 e 0 to 0 dl 1788201483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201472.387888:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc7b80 with x1875064559601920 ext(71307264->72355839) 00002000:00010000:1.0:1788201472.387895:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc7b80 00000100:00100000:1.0:1788201472.387932:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 110 00000100:00100000:1.0:1788201472.387942:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559601920:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201472.416003:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559601920:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28049us (31493us total) trans 30064771111 rc 0/0 00000100:00100000:2.0:1788201472.416018:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 110 00002000:00100000:2.0:1788201472.416031:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (71307264->72355839) req@ffff9624c1cc7b80 x1875064559601920/t30064771111(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:593/0 lens 488/448 e 0 to 0 dl 1788201483 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201472.416041:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc7b80 with x1875064559601920 ext(71307264->72355839) 00002000:00010000:2.0:1788201472.416055:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc7b80 00000100:00100000:3.0:1788201472.567859:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570128384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201472.567947:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201472.568039:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570128384 00000100:00100000:2.0:1788201472.568047:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570128384 00000100:00080000:3.0:1788201472.568113:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201472.568122:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788201472.568134:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570128384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201472.568168:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201472.568219:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570128384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201472.568226:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00010000:00080000:3.0:1788201472.568376:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba0db100 x1875064570128384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201472.568394:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570128384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201472.577997:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201472.578336:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559602048 00000100:00100000:3.0:1788201472.578387:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559602048 00002000:00100000:3.0:1788201472.578438:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (72355840->73404415) req@ffff9624ba0d8700 x1875064559602048/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:593/0 lens 488/0 e 0 to 0 dl 1788201483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201472.578449:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d8700 with x1875064559602048 ext(72355840->73404415) 00002000:00010000:3.0:1788201472.578454:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d8700 00000100:00100000:3.0:1788201472.578488:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 111 00000100:00100000:3.0:1788201472.578497:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559602048:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201472.601159:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559602048:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22650us (23158us total) trans 30064771112 rc 0/0 00000100:00100000:0.0:1788201472.601175:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 111 00002000:00100000:0.0:1788201472.601189:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (72355840->73404415) req@ffff9624ba0d8700 x1875064559602048/t30064771112(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:593/0 lens 488/448 e 0 to 0 dl 1788201483 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201472.601199:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d8700 with x1875064559602048 ext(72355840->73404415) 00002000:00010000:0.0:1788201472.601205:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d8700 00000100:00100000:0.0:1788201472.716769:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201472.716873:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559602176 00000100:00100000:1.0:1788201472.716883:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559602176 00002000:00100000:1.0:1788201472.716931:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (73404416->74452991) req@ffff9624c1cc5c00 x1875064559602176/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:593/0 lens 488/0 e 0 to 0 dl 1788201483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201472.716941:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5c00 with x1875064559602176 ext(73404416->74452991) 00002000:00010000:1.0:1788201472.716946:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5c00 00000100:00100000:1.0:1788201472.716980:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 112 00000100:00100000:1.0:1788201472.716988:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559602176:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201472.745489:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559602176:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28491us (28719us total) trans 30064771113 rc 0/0 00000100:00100000:0.0:1788201472.745503:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 112 00002000:00100000:0.0:1788201472.745516:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (73404416->74452991) req@ffff9624c1cc5c00 x1875064559602176/t30064771113(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:593/0 lens 488/448 e 0 to 0 dl 1788201483 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201472.745527:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5c00 with x1875064559602176 ext(73404416->74452991) 00002000:00010000:0.0:1788201472.745533:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5c00 00010000:00010000:0.0:1788201472.828546:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201473.058876:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201473.058969:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559602304 00000100:00100000:2.0:1788201473.058982:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559602304 00002000:00100000:2.0:1788201473.059056:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (74452992->75501567) req@ffff9624c1cc4e00 x1875064559602304/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:594/0 lens 488/0 e 0 to 0 dl 1788201484 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201473.059069:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4e00 with x1875064559602304 ext(74452992->75501567) 00002000:00010000:2.0:1788201473.059075:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4e00 00000100:00100000:2.0:1788201473.059107:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 113 00000100:00100000:2.0:1788201473.059119:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559602304:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201473.060266:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201473.080952:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570128896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.081023:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201473.081081:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201473.081087:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570128512:0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.081127:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201473.081155:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570129024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.081191:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201473.081218:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570128640:0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.081238:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201473.081252:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570129152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.081267:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201473.081511:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201473.081519:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248c9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570128768:0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.081545:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201473.081588:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570128896 00000100:00100000:1.0:1788201473.081597:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570128896 00000100:00100000:1.0:1788201473.081648:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570128640 00000100:00100000:1.0:1788201473.081651:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570128640 00000100:00100000:1.0:1788201473.081663:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570129152 00000100:00100000:1.0:1788201473.081665:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570129152 00000100:00100000:1.0:1788201473.081680:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788201473.081688:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570128896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.081738:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570128896:12345-0@lo:400:kworker.0 Request processed in 51us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.081745:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788201473.081759:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788201473.081764:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570128640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.081790:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570128640:12345-0@lo:400:kworker.0 Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.081795:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788201473.081895:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788201473.081903:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570129152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.081937:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570129152:12345-0@lo:400:kworker.0 Request processed in 36us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.081942:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788201473.081961:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570128512 00000100:00100000:1.0:1788201473.081964:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570128512 00000100:00100000:1.0:1788201473.081985:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1788201473.081990:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570128512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.082015:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570128512:12345-0@lo:400:kworker.0 Request processed in 25us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.082020:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1788201473.082044:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570129024 00000100:00100000:1.0:1788201473.082047:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570129024 00000100:00100000:1.0:1788201473.082068:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570128768 00000100:00100000:1.0:1788201473.082070:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570128768 00000100:00100000:1.0:1788201473.082090:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788201473.082096:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570129024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.082195:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570129024:12345-0@lo:400:kworker.0 Request processed in 98us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.082202:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788201473.082213:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788201473.082220:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570128768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.082248:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570128768:12345-0@lo:400:kworker.0 Request processed in 29us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201473.082253:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:1.0:1788201473.082740:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201473.082744:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201473.082796:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570128768:0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.083006:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570128640:0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.083016:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570129152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.083057:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570128512:0@lo:400:kworker.0 00010000:00080000:1.0:1788201473.083071:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248c9cd180 x1875064570129024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201473.083081:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570129024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.083091:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248c9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570128896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201473.090244:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559602304:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31113us (31369us total) trans 30064771114 rc 0/0 00000100:00100000:1.0:1788201473.090260:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 113 00002000:00100000:1.0:1788201473.090274:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (74452992->75501567) req@ffff9624c1cc4e00 x1875064559602304/t30064771114(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:594/0 lens 488/448 e 0 to 0 dl 1788201484 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201473.090284:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4e00 with x1875064559602304 ext(74452992->75501567) 00002000:00010000:1.0:1788201473.090291:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4e00 00000100:00100000:1.0:1788201473.552526:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201473.553252:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559602432 00000100:00100000:3.0:1788201473.553273:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559602432 00002000:00100000:3.0:1788201473.553328:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (75501568->76550143) req@ffff96248c9cea00 x1875064559602432/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:594/0 lens 488/0 e 0 to 0 dl 1788201484 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201473.553363:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cea00 with x1875064559602432 ext(75501568->76550143) 00002000:00010000:3.0:1788201473.553370:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cea00 00000100:00100000:3.0:1788201473.553409:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:3.0:1788201473.553598:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559602432:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201473.607932:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559602432:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 54326us (55403us total) trans 30064771115 rc 0/0 00000100:00100000:1.0:1788201473.607948:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 114 00002000:00100000:1.0:1788201473.607962:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (75501568->76550143) req@ffff96248c9cea00 x1875064559602432/t30064771115(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:594/0 lens 488/448 e 0 to 0 dl 1788201484 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201473.607974:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cea00 with x1875064559602432 ext(75501568->76550143) 00002000:00010000:1.0:1788201473.607991:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cea00 00010000:00010000:2.0:1788201473.852885:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201473.993806:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201473.993894:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559602560 00000100:00100000:3.0:1788201473.993905:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559602560 00002000:00100000:3.0:1788201473.993957:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (76550144->77598719) req@ffff9624c1cc6d80 x1875064559602560/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:594/0 lens 488/0 e 0 to 0 dl 1788201484 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201473.993969:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6d80 with x1875064559602560 ext(76550144->77598719) 00002000:00010000:3.0:1788201473.993975:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6d80 00000100:00100000:3.0:1788201473.994038:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 115 00000100:00100000:3.0:1788201473.994048:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559602560:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201474.037915:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559602560:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 43856us (44117us total) trans 30064771116 rc 0/0 00000100:00100000:3.0:1788201474.037928:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 115 00002000:00100000:3.0:1788201474.037941:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (76550144->77598719) req@ffff9624c1cc6d80 x1875064559602560/t30064771116(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:594/0 lens 488/448 e 0 to 0 dl 1788201484 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201474.037951:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6d80 with x1875064559602560 ext(76550144->77598719) 00002000:00010000:3.0:1788201474.037956:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6d80 00000100:00100000:3.0:1788201474.543434:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201474.543542:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559602688 00000100:00100000:0.0:1788201474.543553:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559602688 00002000:00100000:0.0:1788201474.543625:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (77598720->78647295) req@ffff9624b9f69c00 x1875064559602688/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:595/0 lens 488/0 e 0 to 0 dl 1788201485 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201474.543637:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69c00 with x1875064559602688 ext(77598720->78647295) 00002000:00010000:0.0:1788201474.543642:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69c00 00000100:00100000:0.0:1788201474.543680:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 116 00000100:00100000:0.0:1788201474.543691:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559602688:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201474.592817:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559602688:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 49116us (49382us total) trans 30064771117 rc 0/0 00000100:00100000:3.0:1788201474.592833:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 116 00002000:00100000:3.0:1788201474.592846:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (77598720->78647295) req@ffff9624b9f69c00 x1875064559602688/t30064771117(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:595/0 lens 488/448 e 0 to 0 dl 1788201485 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201474.592875:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69c00 with x1875064559602688 ext(77598720->78647295) 00002000:00010000:3.0:1788201474.592881:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69c00 00010000:00010000:1.0:1788201474.871807:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201475.047989:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201475.048087:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559602816 00000100:00100000:2.0:1788201475.048098:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559602816 00002000:00100000:2.0:1788201475.048172:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (78647296->79695871) req@ffff962381957100 x1875064559602816/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:596/0 lens 488/0 e 0 to 0 dl 1788201486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201475.048185:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381957100 with x1875064559602816 ext(78647296->79695871) 00002000:00010000:2.0:1788201475.048191:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381957100 00000100:00080000:3.0:1788201475.048260:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201475.048299:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 117 00000100:00100000:2.0:1788201475.048312:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559602816:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201475.119965:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559602816:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 71643us (71974us total) trans 30064771118 rc 0/0 00000100:00100000:2.0:1788201475.119981:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 117 00002000:00100000:2.0:1788201475.119995:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (78647296->79695871) req@ffff962381957100 x1875064559602816/t30064771118(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:596/0 lens 488/448 e 0 to 0 dl 1788201486 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201475.120007:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381957100 with x1875064559602816 ext(78647296->79695871) 00002000:00010000:2.0:1788201475.120013:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381957100 00000100:00100000:0.0:1788201475.128324:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201475.128372:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570129280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201475.128445:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201475.128514:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570129280 00000100:00100000:0.0:1788201475.128523:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570129280 00000100:00100000:0.0:1788201475.128580:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788201475.128589:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570129280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201475.128612:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 89456640 pending 44302336 free 3792699392 avail 3790602240 00000100:00100000:0.0:1788201475.128655:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570129280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201475.128662:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1788201475.128680:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201475.128718:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570129280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201475.408547:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201475.409678:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559602944 00000100:00100000:3.0:1788201475.409692:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559602944 00002000:00100000:3.0:1788201475.409749:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (79695872->80744447) req@ffff9624ba0db800 x1875064559602944/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:596/0 lens 488/0 e 0 to 0 dl 1788201486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201475.409773:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0db800 with x1875064559602944 ext(79695872->80744447) 00002000:00010000:3.0:1788201475.409780:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0db800 00000100:00100000:3.0:1788201475.409817:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 118 00000100:00100000:3.0:1788201475.409826:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559602944:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201475.431792:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559602944:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21956us (23439us total) trans 30064771119 rc 0/0 00000100:00100000:3.0:1788201475.431808:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 118 00002000:00100000:3.0:1788201475.431822:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (79695872->80744447) req@ffff9624ba0db800 x1875064559602944/t30064771119(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:596/0 lens 488/448 e 0 to 0 dl 1788201486 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201475.431833:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0db800 with x1875064559602944 ext(79695872->80744447) 00002000:00010000:3.0:1788201475.431839:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0db800 00000100:00100000:2.0:1788201475.674508:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201475.675434:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559603072 00000100:00100000:2.0:1788201475.675446:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559603072 00002000:00100000:2.0:1788201475.675499:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (80744448->81793023) req@ffff9624ba0d9180 x1875064559603072/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:596/0 lens 488/0 e 0 to 0 dl 1788201486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201475.675511:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d9180 with x1875064559603072 ext(80744448->81793023) 00002000:00010000:2.0:1788201475.675517:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d9180 00000100:00100000:2.0:1788201475.675548:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 119 00000100:00100000:2.0:1788201475.675558:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559603072:12345-192.168.201.56@tcp:4:iozone.0 00000001:00100000:1.0:1788201475.723548:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000100:00100000:2.0:1788201475.738494:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559603072:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 59974us (61035us total) trans 30064771120 rc 0/0 00000100:00100000:2.0:1788201475.738514:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 119 00002000:00100000:2.0:1788201475.738530:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (80744448->81793023) req@ffff9624ba0d9180 x1875064559603072/t30064771120(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:596/0 lens 488/448 e 0 to 0 dl 1788201486 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201475.738540:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d9180 with x1875064559603072 ext(80744448->81793023) 00002000:00010000:2.0:1788201475.738546:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d9180 00000001:00080000:1.0:1788201475.825007:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771113 is committed 00000001:00080000:1.0:1788201475.825050:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771115 is committed 00000001:00080000:1.0:1788201475.825069:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771118 is committed 00000001:00080000:1.0:1788201475.825082:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771119 is committed 00010000:00010000:0.0:1788201475.894602:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201475.985949:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201475.986032:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559603200 00000100:00100000:1.0:1788201475.986044:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559603200 00002000:00100000:1.0:1788201475.986095:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (81793024->82841599) req@ffff962381954a80 x1875064559603200/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:596/0 lens 488/0 e 0 to 0 dl 1788201486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201475.986106:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954a80 with x1875064559603200 ext(81793024->82841599) 00002000:00010000:1.0:1788201475.986112:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954a80 00000100:00100000:1.0:1788201475.986144:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:1.0:1788201475.986154:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559603200:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201476.013806:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559603200:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27640us (27854us total) trans 30064771121 rc 0/0 00000100:00100000:1.0:1788201476.013822:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 120 00002000:00100000:1.0:1788201476.013834:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (81793024->82841599) req@ffff962381954a80 x1875064559603200/t30064771121(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:596/0 lens 488/448 e 0 to 0 dl 1788201486 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201476.016837:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954a80 with x1875064559603200 ext(81793024->82841599) 00002000:00010000:1.0:1788201476.016943:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954a80 00000100:00100000:3.0:1788201476.185940:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201476.186071:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559603328 00000100:00100000:2.0:1788201476.186081:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559603328 00002000:00100000:2.0:1788201476.186205:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (82841600->83890175) req@ffff9624b9f69880 x1875064559603328/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:597/0 lens 488/0 e 0 to 0 dl 1788201487 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201476.186218:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69880 with x1875064559603328 ext(82841600->83890175) 00002000:00010000:2.0:1788201476.186224:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69880 00000100:00100000:2.0:1788201476.186715:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 121 00000100:00100000:2.0:1788201476.186728:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559603328:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201476.211325:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559603328:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24585us (25383us total) trans 30064771122 rc 0/0 00000100:00100000:2.0:1788201476.211355:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 121 00002000:00100000:2.0:1788201476.211371:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (82841600->83890175) req@ffff9624b9f69880 x1875064559603328/t30064771122(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:597/0 lens 488/448 e 0 to 0 dl 1788201487 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201476.211381:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69880 with x1875064559603328 ext(82841600->83890175) 00002000:00010000:2.0:1788201476.211388:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69880 00000100:00100000:3.0:1788201476.370869:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201476.370985:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559603456 00000100:00100000:1.0:1788201476.370995:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559603456 00002000:00100000:1.0:1788201476.371045:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (83890176->84938751) req@ffff9624c1e5b800 x1875064559603456/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:597/0 lens 488/0 e 0 to 0 dl 1788201487 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201476.371073:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5b800 with x1875064559603456 ext(83890176->84938751) 00002000:00010000:1.0:1788201476.371080:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5b800 00000100:00100000:1.0:1788201476.371120:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 122 00000100:00100000:1.0:1788201476.371129:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559603456:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201476.398899:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559603456:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27758us (28029us total) trans 30064771123 rc 0/0 00000100:00100000:2.0:1788201476.398916:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 122 00002000:00100000:2.0:1788201476.398931:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (83890176->84938751) req@ffff9624c1e5b800 x1875064559603456/t30064771123(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:597/0 lens 488/448 e 0 to 0 dl 1788201487 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201476.398942:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5b800 with x1875064559603456 ext(83890176->84938751) 00002000:00010000:2.0:1788201476.398948:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5b800 00000100:00100000:3.0:1788201476.654611:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201476.654761:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559603584 00000100:00100000:0.0:1788201476.654773:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559603584 00002000:00100000:0.0:1788201476.654847:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (84938752->85987327) req@ffff9624c1e59500 x1875064559603584/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:597/0 lens 488/0 e 0 to 0 dl 1788201487 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201476.654858:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e59500 with x1875064559603584 ext(84938752->85987327) 00002000:00010000:0.0:1788201476.654864:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e59500 00000100:00100000:0.0:1788201476.654904:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 123 00000100:00100000:0.0:1788201476.654915:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559603584:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201476.698390:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559603584:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 43457us (43773us total) trans 30064771124 rc 0/0 00000100:00100000:2.0:1788201476.698409:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 123 00002000:00100000:2.0:1788201476.698432:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (84938752->85987327) req@ffff9624c1e59500 x1875064559603584/t30064771124(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:597/0 lens 488/448 e 0 to 0 dl 1788201487 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201476.698445:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e59500 with x1875064559603584 ext(84938752->85987327) 00002000:00010000:2.0:1788201476.698452:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e59500 00000100:00100000:0.0:1788201476.876280:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201476.876620:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559603712 00000100:00100000:3.0:1788201476.876631:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559603712 00002000:00100000:3.0:1788201476.876688:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (85987328->87035903) req@ffff962381955880 x1875064559603712/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:597/0 lens 488/0 e 0 to 0 dl 1788201487 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201476.876717:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955880 with x1875064559603712 ext(85987328->87035903) 00002000:00010000:3.0:1788201476.876724:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955880 00000100:00100000:3.0:1788201476.876775:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 124 00000100:00100000:3.0:1788201476.876787:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559603712:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201476.912794:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559603712:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35987us (36505us total) trans 30064771125 rc 0/0 00000100:00100000:3.0:1788201476.912813:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 124 00002000:00100000:3.0:1788201476.912829:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (85987328->87035903) req@ffff962381955880 x1875064559603712/t30064771125(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:597/0 lens 488/448 e 0 to 0 dl 1788201487 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201476.912842:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955880 with x1875064559603712 ext(85987328->87035903) 00002000:00010000:3.0:1788201476.912851:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955880 00000100:00100000:0.0:1788201476.917706:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201476.917876:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559603840 00000100:00100000:1.0:1788201476.917887:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559603840 00000100:00100000:1.0:1788201476.917951:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 506 00000100:00100000:1.0:1788201476.917963:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559603840:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201476.918046:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559603840:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201476.918054:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 506 00010000:00010000:2.0:1788201476.918599:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201476.923566:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201476.923623:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201476.923665:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559604096 00000100:00100000:0.0:1788201476.923676:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559604096 00000100:00100000:0.0:1788201476.923762:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 205 00000100:00100000:0.0:1788201476.923774:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559604096:12345-192.168.201.56@tcp:400:kworker.0 00000100:00080000:3.0:1788201476.923817:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201476.923859:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559604096:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 86us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201476.923867:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 205 00000100:00100000:2.0:1788201476.924004:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559603968 00000100:00100000:2.0:1788201476.924022:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559603968 00000100:00080000:3.0:1788201476.924048:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201476.924073:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 327 00000100:00100000:2.0:1788201476.924083:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559603968:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201476.924134:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559603968:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 53us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201476.924140:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 327 00000100:00100000:1.0:1788201477.248252:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201477.248407:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559604224 00000100:00100000:2.0:1788201477.248418:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559604224 00002000:00100000:2.0:1788201477.248483:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (87035904->88084479) req@ffff96248c9cd880 x1875064559604224/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:598/0 lens 488/0 e 0 to 0 dl 1788201488 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201477.248496:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cd880 with x1875064559604224 ext(87035904->88084479) 00002000:00010000:2.0:1788201477.248503:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cd880 00000100:00080000:3.0:1788201477.248538:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201477.248591:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 125 00000100:00100000:2.0:1788201477.248604:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559604224:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201477.273170:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559604224:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24558us (24917us total) trans 30064771126 rc 0/0 00000100:00100000:2.0:1788201477.273183:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 125 00002000:00100000:2.0:1788201477.273196:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (87035904->88084479) req@ffff96248c9cd880 x1875064559604224/t30064771126(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:598/0 lens 488/448 e 0 to 0 dl 1788201488 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201477.273208:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cd880 with x1875064559604224 ext(87035904->88084479) 00002000:00010000:2.0:1788201477.273214:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cd880 00000100:00100000:3.0:1788201477.555847:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201477.555937:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559604352 00000100:00100000:0.0:1788201477.555949:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559604352 00002000:00100000:0.0:1788201477.556005:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (88084480->89133055) req@ffff9624c1e5a300 x1875064559604352/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:598/0 lens 488/0 e 0 to 0 dl 1788201488 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201477.556016:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5a300 with x1875064559604352 ext(88084480->89133055) 00002000:00010000:0.0:1788201477.556022:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5a300 00000100:00100000:0.0:1788201477.556062:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 126 00000100:00100000:0.0:1788201477.556072:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559604352:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201477.582495:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559604352:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26413us (26648us total) trans 30064771127 rc 0/0 00000100:00100000:1.0:1788201477.582511:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 126 00002000:00100000:1.0:1788201477.582523:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (88084480->89133055) req@ffff9624c1e5a300 x1875064559604352/t30064771127(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:598/0 lens 488/448 e 0 to 0 dl 1788201488 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201477.582534:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5a300 with x1875064559604352 ext(88084480->89133055) 00002000:00010000:1.0:1788201477.582541:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5a300 00000100:00100000:1.0:1788201477.690693:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba0db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570129408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201477.690778:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201477.691122:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570129408 00000100:00100000:0.0:1788201477.691137:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570129408 00000100:00100000:0.0:1788201477.691210:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00080000:3.0:1788201477.691288:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201477.691410:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570129408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201477.691459:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201477.691510:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570129408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 291us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201477.691517:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00010000:00080000:1.0:1788201477.691637:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba0db100 x1875064570129408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201477.691657:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba0db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570129408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201477.779093:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201477.779177:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559604480 00000100:00100000:0.0:1788201477.779188:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559604480 00002000:00100000:0.0:1788201477.779237:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (89133056->90181631) req@ffff9624ba0db100 x1875064559604480/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:598/0 lens 488/0 e 0 to 0 dl 1788201488 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201477.779248:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0db100 with x1875064559604480 ext(89133056->90181631) 00002000:00010000:0.0:1788201477.779254:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0db100 00000100:00100000:0.0:1788201477.779287:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 127 00000100:00100000:0.0:1788201477.779297:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559604480:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201477.811498:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559604480:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32180us (32396us total) trans 30064771128 rc 0/0 00000100:00100000:3.0:1788201477.813214:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 127 00002000:00100000:3.0:1788201477.813716:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (89133056->90181631) req@ffff9624ba0db100 x1875064559604480/t30064771128(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:598/0 lens 488/448 e 0 to 0 dl 1788201488 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201477.813738:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0db100 with x1875064559604480 ext(89133056->90181631) 00002000:00010000:3.0:1788201477.813745:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0db100 00010000:00010000:1.0:1788201477.943981:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201478.104322:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201478.104546:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559604608 00000100:00100000:0.0:1788201478.104557:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559604608 00002000:00100000:0.0:1788201478.104611:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (90181632->91230207) req@ffff9624c1e58700 x1875064559604608/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:599/0 lens 488/0 e 0 to 0 dl 1788201489 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201478.104622:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e58700 with x1875064559604608 ext(90181632->91230207) 00002000:00010000:0.0:1788201478.104628:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e58700 00000100:00100000:0.0:1788201478.104653:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 128 00000100:00100000:0.0:1788201478.104663:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559604608:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201478.124198:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559604608:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19522us (19871us total) trans 30064771129 rc 0/0 00000100:00100000:2.0:1788201478.124226:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 128 00002000:00100000:2.0:1788201478.124243:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (90181632->91230207) req@ffff9624c1e58700 x1875064559604608/t30064771129(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:599/0 lens 488/448 e 0 to 0 dl 1788201489 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201478.124255:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e58700 with x1875064559604608 ext(90181632->91230207) 00002000:00010000:2.0:1788201478.124262:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e58700 00000100:00100000:2.0:1788201478.198645:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570129792:0@lo:400:kworker.0 00000100:00100000:2.0:1788201478.198735:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201478.198805:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788201478.198811:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570129664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201478.198844:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201478.198964:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570129536:0@lo:400:kworker.0 00000100:00100000:3.0:1788201478.199015:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201478.199041:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570130048:0@lo:400:kworker.0 00000100:00100000:3.0:1788201478.199078:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201478.199097:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201478.199103:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570129920:0@lo:400:kworker.0 00000100:00100000:3.0:1788201478.199150:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570129792 00000100:00100000:3.0:1788201478.199158:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570129792 00000100:00100000:3.0:1788201478.199208:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570130048 00000100:00100000:3.0:1788201478.199211:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570130048 00000100:00100000:3.0:1788201478.199229:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788201478.199238:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570129792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201478.199304:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570129792:12345-0@lo:400:kworker.0 Request processed in 66us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201478.199311:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788201478.199330:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788201478.199336:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570130048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201478.199390:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570130048:12345-0@lo:400:kworker.0 Request processed in 55us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201478.199396:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:3.0:1788201478.199411:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201478.199663:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570130176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201478.199694:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201478.203587:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570129536 00000100:00100000:3.0:1788201478.203601:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570129536 00000100:00100000:3.0:1788201478.203661:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1788201478.203671:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570129536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201478.203769:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570129536:12345-0@lo:400:kworker.0 Request processed in 100us (4753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201478.203787:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1788201478.205032:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570129792:0@lo:400:kworker.0 00000100:00100000:3.0:1788201478.205237:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201478.206161:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570129664 00000100:00100000:1.0:1788201478.206170:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570129664 00000100:00100000:1.0:1788201478.206218:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570130176 00000100:00100000:1.0:1788201478.206221:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570130176 00000100:00100000:1.0:1788201478.206259:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788201478.206269:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570129664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201478.206367:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570129664:12345-0@lo:400:kworker.0 Request processed in 99us (7521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201478.206375:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788201478.206392:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788201478.206398:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570130176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201478.206431:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570130176:12345-0@lo:400:kworker.0 Request processed in 33us (6736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201478.206437:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00080000:1.0:1788201478.206467:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201478.207293:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570129664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201478.207305:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570130176:0@lo:400:kworker.0 00000100:00100000:3.0:1788201478.207516:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570129536:0@lo:400:kworker.0 00010000:00080000:3.0:1788201478.207533:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248cd05880 x1875064570130048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201478.207543:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570130048:0@lo:400:kworker.0 00000100:00100000:1.0:1788201478.207679:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570129920 00000100:00100000:1.0:1788201478.207685:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570129920 00000100:00100000:1.0:1788201478.207751:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788201478.207760:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570129920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201478.207827:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570129920:12345-0@lo:400:kworker.0 Request processed in 68us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201478.207834:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788201478.207954:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570129920:0@lo:400:kworker.0 00000100:00080000:3.0:1788201478.208140:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788201478.359158:0:20327:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00000100:00100000:3.0:1788201478.428128:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201478.428237:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559604736 00000100:00100000:0.0:1788201478.428248:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559604736 00002000:00100000:0.0:1788201478.428308:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (91230208->92278783) req@ffff962381a0c380 x1875064559604736/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:599/0 lens 488/0 e 0 to 0 dl 1788201489 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201478.428319:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0c380 with x1875064559604736 ext(91230208->92278783) 00002000:00010000:0.0:1788201478.428325:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0c380 00000100:00100000:0.0:1788201478.428387:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 129 00000100:00100000:0.0:1788201478.428398:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559604736:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201478.457730:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559604736:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29313us (29593us total) trans 30064771130 rc 0/0 00000100:00100000:2.0:1788201478.457744:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 129 00002000:00100000:2.0:1788201478.457760:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (91230208->92278783) req@ffff962381a0c380 x1875064559604736/t30064771130(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:599/0 lens 488/448 e 0 to 0 dl 1788201489 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201478.457784:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0c380 with x1875064559604736 ext(91230208->92278783) 00002000:00010000:2.0:1788201478.457792:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0c380 00000100:00100000:3.0:1788201478.716223:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201478.716618:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559604864 00000100:00100000:2.0:1788201478.716629:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559604864 00002000:00100000:2.0:1788201478.716680:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (92278784->93327359) req@ffff962381a0df80 x1875064559604864/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:599/0 lens 488/0 e 0 to 0 dl 1788201489 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201478.716692:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0df80 with x1875064559604864 ext(92278784->93327359) 00002000:00010000:2.0:1788201478.716698:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0df80 00000100:00100000:2.0:1788201478.716743:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00100000:2.0:1788201478.716753:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559604864:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201478.747316:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559604864:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29940us (30480us total) trans 30064771131 rc 0/0 00000100:00100000:2.0:1788201478.747337:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 130 00002000:00100000:2.0:1788201478.747374:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (92278784->93327359) req@ffff962381a0df80 x1875064559604864/t30064771131(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:599/0 lens 488/448 e 0 to 0 dl 1788201489 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201478.747386:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0df80 with x1875064559604864 ext(92278784->93327359) 00002000:00010000:2.0:1788201478.747393:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0df80 00010000:00010000:0.0:1788201478.969238:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201479.066379:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201479.067746:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559604992 00000100:00100000:3.0:1788201479.067759:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559604992 00002000:00100000:3.0:1788201479.067846:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (93327360->94375935) req@ffff962381956a00 x1875064559604992/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:600/0 lens 488/0 e 0 to 0 dl 1788201490 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201479.067858:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381956a00 with x1875064559604992 ext(93327360->94375935) 00002000:00010000:3.0:1788201479.067865:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381956a00 00000100:00100000:3.0:1788201479.067901:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 131 00000100:00100000:3.0:1788201479.067912:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559604992:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201479.068954:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201479.085242:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559604992:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17320us (18898us total) trans 30064771132 rc 0/0 00000100:00100000:1.0:1788201479.085257:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 131 00002000:00100000:1.0:1788201479.085271:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (93327360->94375935) req@ffff962381956a00 x1875064559604992/t30064771132(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:600/0 lens 488/448 e 0 to 0 dl 1788201490 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201479.085283:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381956a00 with x1875064559604992 ext(93327360->94375935) 00002000:00010000:1.0:1788201479.085290:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381956a00 00000100:00100000:0.0:1788201479.374841:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201479.374945:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559605120 00000100:00100000:2.0:1788201479.374955:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559605120 00002000:00100000:2.0:1788201479.375010:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (94375936->95424511) req@ffff962381955180 x1875064559605120/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:600/0 lens 488/0 e 0 to 0 dl 1788201490 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201479.375032:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955180 with x1875064559605120 ext(94375936->95424511) 00002000:00010000:2.0:1788201479.375037:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955180 00000100:00100000:2.0:1788201479.375082:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 132 00000100:00100000:2.0:1788201479.375091:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559605120:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201479.423636:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559605120:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 48530us (48791us total) trans 30064771133 rc 0/0 00000100:00100000:2.0:1788201479.423653:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 132 00002000:00100000:2.0:1788201479.423669:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (94375936->95424511) req@ffff962381955180 x1875064559605120/t30064771133(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:600/0 lens 488/448 e 0 to 0 dl 1788201490 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201479.423682:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955180 with x1875064559605120 ext(94375936->95424511) 00002000:00010000:2.0:1788201479.423689:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955180 00000100:00100000:0.0:1788201479.707418:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201479.707505:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559605248 00000100:00100000:3.0:1788201479.707515:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559605248 00002000:00100000:3.0:1788201479.707564:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (95424512->96473087) req@ffff962381954700 x1875064559605248/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:600/0 lens 488/0 e 0 to 0 dl 1788201490 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201479.707575:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954700 with x1875064559605248 ext(95424512->96473087) 00002000:00010000:3.0:1788201479.707592:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954700 00000100:00100000:3.0:1788201479.707626:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 133 00000100:00100000:3.0:1788201479.707636:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559605248:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201479.734660:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559605248:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27014us (27238us total) trans 30064771134 rc 0/0 00000100:00100000:0.0:1788201479.734676:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 133 00002000:00100000:0.0:1788201479.734700:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (95424512->96473087) req@ffff962381954700 x1875064559605248/t30064771134(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:600/0 lens 488/448 e 0 to 0 dl 1788201490 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201479.734711:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954700 with x1875064559605248 ext(95424512->96473087) 00002000:00010000:0.0:1788201479.734718:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954700 00000100:00100000:1.0:1788201479.891658:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201479.900100:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559605376 00000100:00100000:2.0:1788201479.900116:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559605376 00002000:00100000:2.0:1788201479.901054:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (96473088->97521663) req@ffff96248c9cc000 x1875064559605376/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:600/0 lens 488/0 e 0 to 0 dl 1788201490 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201479.901068:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cc000 with x1875064559605376 ext(96473088->97521663) 00002000:00010000:2.0:1788201479.901075:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cc000 00000100:00100000:2.0:1788201479.901103:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 134 00000100:00100000:2.0:1788201479.901114:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559605376:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201479.919143:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559605376:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18021us (27485us total) trans 30064771135 rc 0/0 00000100:00100000:2.0:1788201479.919157:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 134 00002000:00100000:2.0:1788201479.919170:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (96473088->97521663) req@ffff96248c9cc000 x1875064559605376/t30064771135(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:600/0 lens 488/448 e 0 to 0 dl 1788201490 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201479.919190:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cc000 with x1875064559605376 ext(96473088->97521663) 00002000:00010000:2.0:1788201479.919202:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cc000 00010000:00010000:2.0:1788201479.998109:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201480.125665:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201480.125754:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559605504 00000100:00100000:0.0:1788201480.125765:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559605504 00002000:00100000:0.0:1788201480.125817:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (97521664->98570239) req@ffff96248cd07b80 x1875064559605504/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:601/0 lens 488/0 e 0 to 0 dl 1788201491 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201480.125830:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07b80 with x1875064559605504 ext(97521664->98570239) 00002000:00010000:0.0:1788201480.125835:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07b80 00000100:00100000:0.0:1788201480.125882:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 135 00000100:00100000:0.0:1788201480.125893:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559605504:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201480.161400:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559605504:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35493us (35731us total) trans 30064771136 rc 0/0 00000100:00100000:3.0:1788201480.161427:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 135 00002000:00100000:3.0:1788201480.161449:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (97521664->98570239) req@ffff96248cd07b80 x1875064559605504/t30064771136(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:601/0 lens 488/448 e 0 to 0 dl 1788201491 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201480.161460:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07b80 with x1875064559605504 ext(97521664->98570239) 00002000:00010000:3.0:1788201480.161586:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07b80 00000100:00100000:0.0:1788201480.247628:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201480.247651:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570130304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201480.247736:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201480.248054:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570130304 00000100:00100000:1.0:1788201480.248063:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570130304 00000100:00100000:1.0:1788201480.248131:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788201480.248142:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570130304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201480.248166:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 103088128 pending 57933824 free 3778019328 avail 3775922176 00000100:00100000:1.0:1788201480.248224:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570130304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201480.248232:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:3.0:1788201480.248288:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201480.248616:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570130304:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788201480.472244:0:20375:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1788201480.492739:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201480.494532:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559605632 00000100:00100000:0.0:1788201480.494546:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559605632 00002000:00100000:0.0:1788201480.494611:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (98570240->99618815) req@ffff962381954380 x1875064559605632/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:601/0 lens 488/0 e 0 to 0 dl 1788201491 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201480.494623:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954380 with x1875064559605632 ext(98570240->99618815) 00002000:00010000:0.0:1788201480.494628:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954380 00000100:00100000:0.0:1788201480.495305:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 136 00000100:00100000:0.0:1788201480.495321:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559605632:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201480.555268:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559605632:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 59939us (62530us total) trans 30064771137 rc 0/0 00000100:00100000:0.0:1788201480.555283:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 136 00002000:00100000:0.0:1788201480.555299:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (98570240->99618815) req@ffff962381954380 x1875064559605632/t30064771137(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:601/0 lens 488/448 e 0 to 0 dl 1788201491 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201480.555311:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954380 with x1875064559605632 ext(98570240->99618815) 00002000:00010000:0.0:1788201480.555317:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954380 00000100:00100000:3.0:1788201480.843629:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201480.843727:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559605760 00000100:00100000:1.0:1788201480.843738:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559605760 00002000:00100000:1.0:1788201480.843789:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (99618816->100667391) req@ffff962381a0f480 x1875064559605760/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:601/0 lens 488/0 e 0 to 0 dl 1788201491 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201480.843800:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0f480 with x1875064559605760 ext(99618816->100667391) 00002000:00010000:1.0:1788201480.843805:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0f480 00000100:00100000:1.0:1788201480.843840:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 137 00000100:00100000:1.0:1788201480.843848:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559605760:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201480.880466:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559605760:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36607us (36837us total) trans 30064771138 rc 0/0 00000100:00100000:3.0:1788201480.880482:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 137 00002000:00100000:3.0:1788201480.880495:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (99618816->100667391) req@ffff962381a0f480 x1875064559605760/t30064771138(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:601/0 lens 488/448 e 0 to 0 dl 1788201491 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201480.880508:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0f480 with x1875064559605760 ext(99618816->100667391) 00002000:00010000:3.0:1788201480.880514:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0f480 00000001:00080000:1.0:1788201480.918059:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771134 is committed 00000001:00080000:1.0:1788201480.918096:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771137 is committed 00010000:00010000:1.0:1788201481.015143:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201481.144974:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201481.145099:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559605888 00000100:00100000:0.0:1788201481.145118:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559605888 00002000:00100000:0.0:1788201481.145211:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (100667392->101715967) req@ffff962381a0f800 x1875064559605888/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:602/0 lens 488/0 e 0 to 0 dl 1788201492 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201481.145224:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0f800 with x1875064559605888 ext(100667392->101715967) 00002000:00010000:0.0:1788201481.145246:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0f800 00000100:00100000:0.0:1788201481.145293:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 138 00000100:00100000:0.0:1788201481.145305:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559605888:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201481.145425:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201481.168878:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559605888:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23554us (23900us total) trans 30064771139 rc 0/0 00000100:00100000:0.0:1788201481.168899:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 138 00002000:00100000:0.0:1788201481.168918:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (100667392->101715967) req@ffff962381a0f800 x1875064559605888/t30064771139(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:602/0 lens 488/448 e 0 to 0 dl 1788201492 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201481.168931:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0f800 with x1875064559605888 ext(100667392->101715967) 00002000:00010000:0.0:1788201481.168939:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0f800 00000100:00100000:3.0:1788201481.446690:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201481.446895:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559606016 00000100:00100000:0.0:1788201481.446912:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559606016 00002000:00100000:0.0:1788201481.446975:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (101715968->102764543) req@ffff962381a0c000 x1875064559606016/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:602/0 lens 488/0 e 0 to 0 dl 1788201492 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201481.446987:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0c000 with x1875064559606016 ext(101715968->102764543) 00002000:00010000:0.0:1788201481.446994:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0c000 00000100:00100000:0.0:1788201481.447039:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 139 00000100:00100000:0.0:1788201481.447049:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559606016:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201481.480823:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559606016:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33764us (34138us total) trans 30064771140 rc 0/0 00000100:00100000:0.0:1788201481.480838:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 139 00002000:00100000:0.0:1788201481.480853:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (101715968->102764543) req@ffff962381a0c000 x1875064559606016/t30064771140(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:602/0 lens 488/448 e 0 to 0 dl 1788201492 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201481.480879:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0c000 with x1875064559606016 ext(101715968->102764543) 00002000:00010000:0.0:1788201481.480885:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0c000 00000100:00100000:2.0:1788201481.737381:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201481.744805:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559606144 00000100:00100000:1.0:1788201481.744822:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559606144 00002000:00100000:1.0:1788201481.744891:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (102764544->103813119) req@ffff96248cd06a00 x1875064559606144/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:602/0 lens 488/0 e 0 to 0 dl 1788201492 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201481.744903:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd06a00 with x1875064559606144 ext(102764544->103813119) 00002000:00010000:1.0:1788201481.744909:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd06a00 00000100:00100000:1.0:1788201481.744953:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 140 00000100:00100000:1.0:1788201481.744962:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559606144:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201481.764896:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559606144:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19923us (27555us total) trans 30064771141 rc 0/0 00000100:00100000:0.0:1788201481.764912:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 140 00002000:00100000:0.0:1788201481.764927:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (102764544->103813119) req@ffff96248cd06a00 x1875064559606144/t30064771141(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:602/0 lens 488/448 e 0 to 0 dl 1788201492 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201481.764938:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd06a00 with x1875064559606144 ext(102764544->103813119) 00002000:00010000:0.0:1788201481.764944:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd06a00 00000100:00100000:2.0:1788201481.906091:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201481.906190:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559606272 00000100:00100000:3.0:1788201481.906200:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559606272 00002000:00100000:3.0:1788201481.906253:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (103813120->104861695) req@ffff96248cd04a80 x1875064559606272/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:602/0 lens 488/0 e 0 to 0 dl 1788201492 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201481.906275:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd04a80 with x1875064559606272 ext(103813120->104861695) 00002000:00010000:3.0:1788201481.906280:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd04a80 00000100:00100000:3.0:1788201481.906317:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 141 00000100:00100000:3.0:1788201481.906328:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2341:x1875064559606272:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201481.923462:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559606272:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17126us (17371us total) trans 30064771142 rc 0/0 00000100:00100000:1.0:1788201481.923476:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 141 00002000:00100000:1.0:1788201481.923488:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (103813120->104861695) req@ffff96248cd04a80 x1875064559606272/t30064771142(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:602/0 lens 488/448 e 0 to 0 dl 1788201492 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201481.923498:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd04a80 with x1875064559606272 ext(103813120->104861695) 00002000:00010000:1.0:1788201481.923504:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd04a80 00000100:00100000:2.0:1788201482.035084:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201482.035136:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201482.035173:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201482.035270:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559606528 00000100:00100000:1.0:1788201482.035281:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559606528 00000100:00100000:1.0:1788201482.035383:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 331 00000100:00100000:1.0:1788201482.035394:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559606528:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201482.035484:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559606528:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 91us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201482.035492:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 331 00000100:00100000:3.0:1788201482.035611:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559606656 00000100:00100000:3.0:1788201482.035616:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559606656 00000100:00100000:3.0:1788201482.035667:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 208 00000100:00100000:3.0:1788201482.035683:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559606656:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201482.035715:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2344:x1875064559606656:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 34us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201482.035721:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 208 00000100:00080000:2.0:1788201482.036304:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201482.036311:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201482.037495:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559606400 00000100:00100000:0.0:1788201482.037506:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559606400 00000100:00100000:0.0:1788201482.037575:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 508 00000100:00100000:0.0:1788201482.037585:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559606400:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201482.037692:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559606400:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 108us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201482.037700:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 508 00010000:00010000:0.0:1788201482.038627:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201482.141305:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201482.141454:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559606784 00000100:00100000:0.0:1788201482.141464:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559606784 00002000:00100000:0.0:1788201482.141514:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (104861696->105910271) req@ffff96248cd05f80 x1875064559606784/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:603/0 lens 488/0 e 0 to 0 dl 1788201493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201482.141526:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05f80 with x1875064559606784 ext(104861696->105910271) 00002000:00010000:0.0:1788201482.141532:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05f80 00000100:00100000:0.0:1788201482.141586:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 142 00000100:00100000:0.0:1788201482.141596:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559606784:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201482.167193:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559606784:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25580us (25881us total) trans 30064771143 rc 0/0 00000100:00100000:0.0:1788201482.167225:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 142 00002000:00100000:0.0:1788201482.167246:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (104861696->105910271) req@ffff96248cd05f80 x1875064559606784/t30064771143(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:603/0 lens 488/448 e 0 to 0 dl 1788201493 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201482.167260:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05f80 with x1875064559606784 ext(104861696->105910271) 00002000:00010000:0.0:1788201482.167269:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05f80 00000100:00100000:3.0:1788201482.314152:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201482.314403:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559606912 00000100:00100000:1.0:1788201482.315027:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559606912 00000100:00100000:1.0:1788201482.315182:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 104 00000100:00100000:1.0:1788201482.315196:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:18227:x1875064559606912:12345-192.168.201.56@tcp:41:lfs.0 00000004:00000024:1.0:1788201482.315269:0:5825:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201482.315399:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:18227:x1875064559606912:12345-192.168.201.56@tcp:41:lfs.0 Request processed in 205us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201482.315408:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 104 00000100:00100000:2.0:1788201482.319789:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201482.319908:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559607168 00000100:00100000:3.0:1788201482.319922:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559607168 00000100:00100000:3.0:1788201482.320028:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 189 00000100:00100000:3.0:1788201482.320040:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:18227:x1875064559607168:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:3.0:1788201482.320078:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 65601536 pending 20447232 free 3759144960 avail 3757047808 00000100:00100000:3.0:1788201482.320177:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:18227:x1875064559607168:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 138us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201482.320186:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 189 00000100:00100000:2.0:1788201482.321778:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201482.321890:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559607040 00000100:00100000:0.0:1788201482.321901:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559607040 00002000:00100000:0.0:1788201482.321962:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (105910272->106958847) req@ffff96248cd07800 x1875064559607040/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:603/0 lens 488/0 e 0 to 0 dl 1788201493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201482.321975:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07800 with x1875064559607040 ext(105910272->106958847) 00002000:00010000:0.0:1788201482.321981:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07800 00000100:00100000:0.0:1788201482.322054:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 143 00000100:00100000:0.0:1788201482.322066:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559607040:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201482.330457:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201482.332013:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559607296 00000100:00100000:3.0:1788201482.332033:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559607296 00000100:00100000:3.0:1788201482.332121:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 190 00000100:00100000:3.0:1788201482.332134:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:18227:x1875064559607296:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:3.0:1788201482.332198:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201482.332302:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:18227:x1875064559607296:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 170us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201482.332310:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 190 00000100:00100000:3.0:1788201482.341266:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559607040:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19181us (19479us total) trans 30064771144 rc 0/0 00000100:00100000:3.0:1788201482.341287:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 143 00002000:00100000:3.0:1788201482.341306:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (105910272->106958847) req@ffff96248cd07800 x1875064559607040/t30064771144(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:603/0 lens 488/448 e 0 to 0 dl 1788201493 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201482.341318:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07800 with x1875064559607040 ext(105910272->106958847) 00002000:00010000:3.0:1788201482.341326:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07800 00000100:00100000:0.0:1788201482.517907:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201482.518048:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559607424 00000100:00100000:2.0:1788201482.518064:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559607424 00002000:00100000:2.0:1788201482.518138:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (106958848->108007423) req@ffff962381955f80 x1875064559607424/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:603/0 lens 488/0 e 0 to 0 dl 1788201493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201482.518150:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955f80 with x1875064559607424 ext(106958848->108007423) 00002000:00010000:2.0:1788201482.518158:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955f80 00000100:00100000:2.0:1788201482.518202:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 144 00000100:00100000:2.0:1788201482.518290:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559607424:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201482.538163:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559607424:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19853us (20251us total) trans 30064771145 rc 0/0 00000100:00100000:2.0:1788201482.538214:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 144 00002000:00100000:2.0:1788201482.538238:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (106958848->108007423) req@ffff962381955f80 x1875064559607424/t30064771145(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:603/0 lens 488/448 e 0 to 0 dl 1788201493 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201482.538252:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955f80 with x1875064559607424 ext(106958848->108007423) 00002000:00010000:2.0:1788201482.538260:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955f80 00000100:00100000:0.0:1788201482.684049:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201482.684149:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559607552 00000100:00100000:3.0:1788201482.684163:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559607552 00002000:00100000:3.0:1788201482.684245:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (108007424->109055999) req@ffff962381957480 x1875064559607552/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:603/0 lens 488/0 e 0 to 0 dl 1788201493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201482.684259:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381957480 with x1875064559607552 ext(108007424->109055999) 00002000:00010000:3.0:1788201482.684267:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381957480 00000100:00100000:3.0:1788201482.684308:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 145 00000100:00100000:3.0:1788201482.684320:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559607552:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201482.719129:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559607552:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34790us (35073us total) trans 30064771146 rc 0/0 00000100:00100000:1.0:1788201482.719153:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 145 00002000:00100000:1.0:1788201482.719175:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (108007424->109055999) req@ffff962381957480 x1875064559607552/t30064771146(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:603/0 lens 488/448 e 0 to 0 dl 1788201493 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201482.719189:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381957480 with x1875064559607552 ext(108007424->109055999) 00002000:00010000:1.0:1788201482.719196:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381957480 00000100:00100000:1.0:1788201482.807096:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570130432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201482.807219:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201482.807397:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570130432 00000100:00100000:3.0:1788201482.807409:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570130432 00000100:00100000:3.0:1788201482.807495:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788201482.807506:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570130432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201482.807539:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788201482.808759:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201482.811174:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570130432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3649us (3934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201482.811264:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00010000:00080000:1.0:1788201482.811573:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248cd04e00 x1875064570130432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201482.811606:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570130432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201482.910271:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201482.910511:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559607680 00000100:00100000:0.0:1788201482.910526:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559607680 00002000:00100000:0.0:1788201482.910662:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (109056000->110104575) req@ffff96248cd06680 x1875064559607680/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:603/0 lens 488/0 e 0 to 0 dl 1788201493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201482.910702:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd06680 with x1875064559607680 ext(109056000->110104575) 00002000:00010000:0.0:1788201482.910709:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd06680 00000100:00100000:0.0:1788201482.910801:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 146 00000100:00100000:0.0:1788201482.910814:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559607680:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201482.937487:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559607680:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26659us (27216us total) trans 30064771147 rc 0/0 00000100:00100000:3.0:1788201482.937508:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 146 00002000:00100000:3.0:1788201482.937526:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (109056000->110104575) req@ffff96248cd06680 x1875064559607680/t30064771147(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:603/0 lens 488/448 e 0 to 0 dl 1788201493 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201482.937539:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd06680 with x1875064559607680 ext(109056000->110104575) 00002000:00010000:3.0:1788201482.937547:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd06680 00010000:00010000:2.0:1788201483.065147:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201483.183987:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201483.184221:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559607808 00000100:00100000:2.0:1788201483.184234:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559607808 00002000:00100000:2.0:1788201483.184338:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (110104576->111153151) req@ffff962381957800 x1875064559607808/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:604/0 lens 488/0 e 0 to 0 dl 1788201494 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201483.184388:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381957800 with x1875064559607808 ext(110104576->111153151) 00002000:00010000:2.0:1788201483.184395:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381957800 00000100:00100000:2.0:1788201483.184564:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 147 00000100:00100000:2.0:1788201483.184577:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559607808:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201483.185665:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201483.206291:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559607808:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21698us (22298us total) trans 30064771148 rc 0/0 00000100:00100000:3.0:1788201483.206311:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 147 00002000:00100000:3.0:1788201483.206329:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (110104576->111153151) req@ffff962381957800 x1875064559607808/t30064771148(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:604/0 lens 488/448 e 0 to 0 dl 1788201494 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201483.206373:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381957800 with x1875064559607808 ext(110104576->111153151) 00002000:00010000:3.0:1788201483.206382:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381957800 00000100:00100000:2.0:1788201483.322251:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570130560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201483.322704:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201483.322887:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570130688:0@lo:400:kworker.0 00000100:00100000:1.0:1788201483.322931:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570130944:0@lo:400:kworker.0 00000100:00100000:0.0:1788201483.322957:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201483.323007:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201483.323037:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570131200:0@lo:400:kworker.0 00000100:00100000:1.0:1788201483.323072:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201483.323079:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201483.323089:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570131072:0@lo:400:kworker.0 00000100:00100000:0.0:1788201483.323113:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201483.323125:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570130816:0@lo:400:kworker.0 00000100:00100000:1.0:1788201483.323149:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201483.325932:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570130688 00000100:00100000:0.0:1788201483.325949:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570130688 00000100:00100000:0.0:1788201483.326020:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570130944 00000100:00100000:0.0:1788201483.326024:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570130944 00000100:00100000:0.0:1788201483.326050:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570131200 00000100:00100000:0.0:1788201483.326053:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570131200 00000100:00100000:0.0:1788201483.326075:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788201483.326085:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570130688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201483.327118:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570130560 00000100:00100000:3.0:1788201483.327126:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570130560 00000100:00100000:3.0:1788201483.327169:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1788201483.327176:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570130560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201483.327687:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788201483.327698:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570130944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201483.327761:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570130944:12345-0@lo:400:kworker.0 Request processed in 66us (4755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201483.327769:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788201483.327787:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788201483.327809:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570131200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201483.327847:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570131200:12345-0@lo:400:kworker.0 Request processed in 39us (4772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201483.327853:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788201483.327874:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570131072 00000100:00100000:2.0:1788201483.327878:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570131072 00000100:00100000:2.0:1788201483.327910:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788201483.327917:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570131072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201483.327950:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570131072:12345-0@lo:400:kworker.0 Request processed in 34us (4804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201483.327956:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:2.0:1788201483.328007:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201483.328022:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201483.328063:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570131200:0@lo:400:kworker.0 00000100:00100000:2.0:1788201483.328091:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570130816 00000100:00100000:2.0:1788201483.328095:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570130816 00000100:00100000:2.0:1788201483.328124:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788201483.328131:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570130816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201483.328166:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570130816:12345-0@lo:400:kworker.0 Request processed in 36us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201483.328171:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:2.0:1788201483.328185:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201483.328213:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570130816:0@lo:400:kworker.0 00000100:00100000:0.0:1788201483.331069:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570130688:12345-0@lo:400:kworker.0 Request processed in 4979us (8110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201483.331083:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788201483.331851:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570130688:0@lo:400:kworker.0 00010000:00080000:1.0:1788201483.334205:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962381955c00 x1875064570131072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201483.334231:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570131072:0@lo:400:kworker.0 00000100:00100000:1.0:1788201483.334249:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570130944:0@lo:400:kworker.0 00000100:00100000:3.0:1788201483.338930:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570130560:12345-0@lo:400:kworker.0 Request processed in 11742us (16216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201483.338948:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1788201483.339728:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570130560:0@lo:400:kworker.0 00000100:00100000:0.0:1788201483.428889:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201483.429047:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559607936 00000100:00100000:2.0:1788201483.429061:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559607936 00002000:00100000:2.0:1788201483.429242:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (111153152->112201727) req@ffff962487e7b480 x1875064559607936/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:604/0 lens 488/0 e 0 to 0 dl 1788201494 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201483.429255:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b480 with x1875064559607936 ext(111153152->112201727) 00002000:00010000:2.0:1788201483.429264:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b480 00000100:00100000:2.0:1788201483.429306:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 148 00000100:00100000:2.0:1788201483.429320:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559607936:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201483.449712:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559607936:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20382us (20827us total) trans 30064771149 rc 0/0 00000100:00100000:2.0:1788201483.449727:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 148 00002000:00100000:2.0:1788201483.449740:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (111153152->112201727) req@ffff962487e7b480 x1875064559607936/t30064771149(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:604/0 lens 488/448 e 0 to 0 dl 1788201494 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201483.449750:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b480 with x1875064559607936 ext(111153152->112201727) 00002000:00010000:2.0:1788201483.449757:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b480 00000100:00100000:0.0:1788201483.619915:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201483.624730:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559608064 00000100:00100000:1.0:1788201483.624752:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559608064 00002000:00100000:1.0:1788201483.624833:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (112201728->113250303) req@ffff962487e7b800 x1875064559608064/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:604/0 lens 488/0 e 0 to 0 dl 1788201494 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201483.624847:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b800 with x1875064559608064 ext(112201728->113250303) 00002000:00010000:1.0:1788201483.624854:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b800 00000100:00100000:1.0:1788201483.624978:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 149 00000100:00100000:1.0:1788201483.624991:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559608064:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201483.656021:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559608064:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31016us (36107us total) trans 30064771150 rc 0/0 00000100:00100000:2.0:1788201483.656040:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 149 00002000:00100000:2.0:1788201483.656062:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (112201728->113250303) req@ffff962487e7b800 x1875064559608064/t30064771150(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:604/0 lens 488/448 e 0 to 0 dl 1788201494 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201483.656073:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b800 with x1875064559608064 ext(112201728->113250303) 00002000:00010000:2.0:1788201483.656080:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b800 00000100:00100000:0.0:1788201483.829271:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201483.831770:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559608192 00000100:00100000:3.0:1788201483.831818:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559608192 00002000:00100000:3.0:1788201483.831894:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (113250304->114298879) req@ffff962487e78000 x1875064559608192/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:604/0 lens 488/0 e 0 to 0 dl 1788201494 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201483.831908:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78000 with x1875064559608192 ext(113250304->114298879) 00002000:00010000:3.0:1788201483.831915:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78000 00000100:00100000:3.0:1788201483.831965:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 150 00000100:00100000:3.0:1788201483.831977:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559608192:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201483.852751:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559608192:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20758us (23478us total) trans 30064771151 rc 0/0 00000100:00100000:1.0:1788201483.852771:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 150 00002000:00100000:1.0:1788201483.852789:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (113250304->114298879) req@ffff962487e78000 x1875064559608192/t30064771151(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:604/0 lens 488/448 e 0 to 0 dl 1788201494 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201483.852802:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78000 with x1875064559608192 ext(113250304->114298879) 00002000:00010000:1.0:1788201483.852809:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78000 00000100:00100000:3.0:1788201484.066232:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201484.066387:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559608320 00000100:00100000:2.0:1788201484.066436:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559608320 00002000:00100000:2.0:1788201484.066521:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (114298880->115347455) req@ffff962381a0e680 x1875064559608320/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:605/0 lens 488/0 e 0 to 0 dl 1788201495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201484.066539:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0e680 with x1875064559608320 ext(114298880->115347455) 00002000:00010000:2.0:1788201484.066548:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0e680 00000100:00100000:2.0:1788201484.066597:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 151 00000100:00100000:2.0:1788201484.066608:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559608320:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201484.086949:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559608320:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20329us (20725us total) trans 30064771152 rc 0/0 00000100:00100000:2.0:1788201484.086961:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 151 00002000:00100000:2.0:1788201484.086974:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (114298880->115347455) req@ffff962381a0e680 x1875064559608320/t30064771152(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:605/0 lens 488/448 e 0 to 0 dl 1788201495 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201484.086983:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0e680 with x1875064559608320 ext(114298880->115347455) 00002000:00010000:2.0:1788201484.086989:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0e680 00010000:00010000:1.0:1788201484.088431:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201484.254207:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201484.254594:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559608448 00000100:00100000:2.0:1788201484.254615:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559608448 00002000:00100000:2.0:1788201484.254688:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (115347456->116396031) req@ffff962381a0ed80 x1875064559608448/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:605/0 lens 488/0 e 0 to 0 dl 1788201495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201484.254702:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0ed80 with x1875064559608448 ext(115347456->116396031) 00002000:00010000:2.0:1788201484.254708:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0ed80 00000100:00100000:2.0:1788201484.254762:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 152 00000100:00100000:2.0:1788201484.254775:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559608448:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201484.291925:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559608448:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37134us (37715us total) trans 30064771153 rc 0/0 00000100:00100000:2.0:1788201484.292021:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 152 00002000:00100000:2.0:1788201484.292039:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (115347456->116396031) req@ffff962381a0ed80 x1875064559608448/t30064771153(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:605/0 lens 488/448 e 0 to 0 dl 1788201495 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201484.292052:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0ed80 with x1875064559608448 ext(115347456->116396031) 00002000:00010000:2.0:1788201484.292059:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0ed80 00000100:00100000:1.0:1788201484.443990:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201484.444232:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559608576 00000100:00100000:2.0:1788201484.444246:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559608576 00002000:00100000:2.0:1788201484.444319:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (116396032->117444607) req@ffff96248c9cdc00 x1875064559608576/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:605/0 lens 488/0 e 0 to 0 dl 1788201495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201484.444334:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cdc00 with x1875064559608576 ext(116396032->117444607) 00002000:00010000:2.0:1788201484.444406:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cdc00 00000100:00100000:2.0:1788201484.444449:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 153 00000100:00100000:2.0:1788201484.444461:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559608576:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201484.469929:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559608576:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25452us (25937us total) trans 30064771154 rc 0/0 00000100:00100000:2.0:1788201484.469959:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 153 00002000:00100000:2.0:1788201484.469977:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (116396032->117444607) req@ffff96248c9cdc00 x1875064559608576/t30064771154(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:605/0 lens 488/448 e 0 to 0 dl 1788201495 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201484.469989:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cdc00 with x1875064559608576 ext(116396032->117444607) 00002000:00010000:2.0:1788201484.469996:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cdc00 00000100:00100000:3.0:1788201484.615013:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201484.615367:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559608704 00000100:00100000:1.0:1788201484.615382:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559608704 00002000:00100000:1.0:1788201484.615462:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (117444608->118493183) req@ffff962381a0dc00 x1875064559608704/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:605/0 lens 488/0 e 0 to 0 dl 1788201495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201484.615489:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0dc00 with x1875064559608704 ext(117444608->118493183) 00002000:00010000:1.0:1788201484.615498:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0dc00 00000100:00100000:1.0:1788201484.615625:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 154 00000100:00100000:1.0:1788201484.615640:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559608704:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201484.640590:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559608704:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24931us (25570us total) trans 30064771155 rc 0/0 00000100:00100000:1.0:1788201484.640619:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 154 00002000:00100000:1.0:1788201484.640643:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (117444608->118493183) req@ffff962381a0dc00 x1875064559608704/t30064771155(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:605/0 lens 488/448 e 0 to 0 dl 1788201495 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201484.640655:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0dc00 with x1875064559608704 ext(117444608->118493183) 00002000:00010000:1.0:1788201484.640663:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0dc00 00000100:00100000:0.0:1788201484.808009:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201484.808160:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559608832 00000100:00100000:3.0:1788201484.808173:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559608832 00002000:00100000:3.0:1788201484.808245:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (118493184->119541759) req@ffff962487e78e00 x1875064559608832/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:605/0 lens 488/0 e 0 to 0 dl 1788201495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201484.808259:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78e00 with x1875064559608832 ext(118493184->119541759) 00002000:00010000:3.0:1788201484.808267:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78e00 00000100:00100000:3.0:1788201484.808314:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 155 00000100:00100000:3.0:1788201484.808327:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559608832:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201484.842979:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559608832:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34643us (34973us total) trans 30064771156 rc 0/0 00000100:00100000:3.0:1788201484.842994:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 155 00002000:00100000:3.0:1788201484.843007:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (118493184->119541759) req@ffff962487e78e00 x1875064559608832/t30064771156(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:605/0 lens 488/448 e 0 to 0 dl 1788201495 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201484.843018:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78e00 with x1875064559608832 ext(118493184->119541759) 00002000:00010000:3.0:1788201484.843037:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78e00 00000100:00100000:1.0:1788201484.957794:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201484.957981:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559608960 00000100:00100000:2.0:1788201484.957992:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559608960 00002000:00100000:2.0:1788201484.958052:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (119541760->120590335) req@ffff96248c9cf100 x1875064559608960/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:605/0 lens 488/0 e 0 to 0 dl 1788201495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201484.958078:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cf100 with x1875064559608960 ext(119541760->120590335) 00002000:00010000:2.0:1788201484.958084:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cf100 00000100:00100000:2.0:1788201484.958316:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 156 00000100:00100000:2.0:1788201484.958327:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559608960:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201484.984049:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559608960:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25707us (26248us total) trans 30064771157 rc 0/0 00000100:00100000:2.0:1788201484.984068:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 156 00002000:00100000:2.0:1788201484.984093:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (119541760->120590335) req@ffff96248c9cf100 x1875064559608960/t30064771157(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:605/0 lens 488/448 e 0 to 0 dl 1788201495 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201484.984106:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cf100 with x1875064559608960 ext(119541760->120590335) 00002000:00010000:2.0:1788201484.984114:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cf100 00010000:00010000:0.0:1788201485.111144:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201485.183338:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201485.183549:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559609088 00000100:00100000:2.0:1788201485.183563:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559609088 00002000:00100000:2.0:1788201485.183678:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (120590336->121638911) req@ffff962487e7a680 x1875064559609088/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:606/0 lens 488/0 e 0 to 0 dl 1788201496 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201485.183690:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7a680 with x1875064559609088 ext(120590336->121638911) 00002000:00010000:2.0:1788201485.183696:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7a680 00000100:00100000:2.0:1788201485.183733:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 157 00000100:00100000:2.0:1788201485.183746:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2341:x1875064559609088:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201485.188489:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201485.205202:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2341:x1875064559609088:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21441us (21861us total) trans 30064771158 rc 0/0 00000100:00100000:2.0:1788201485.205221:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 157 00002000:00100000:2.0:1788201485.205259:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (120590336->121638911) req@ffff962487e7a680 x1875064559609088/t30064771158(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:606/0 lens 488/448 e 0 to 0 dl 1788201496 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201485.205272:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7a680 with x1875064559609088 ext(120590336->121638911) 00002000:00010000:2.0:1788201485.205279:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7a680 00000100:00100000:1.0:1788201485.367968:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201485.368285:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201485.368325:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962487e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570131328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201485.368442:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201485.368520:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570131328 00000100:00100000:2.0:1788201485.368539:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570131328 00000100:00100000:2.0:1788201485.368635:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788201485.368647:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570131328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201485.368671:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 116719616 pending 71565312 free 3759144960 avail 3757047808 00000100:00100000:2.0:1788201485.368765:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570131328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201485.368773:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788201485.368958:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962487e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570131328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201485.372238:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201485.372661:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559609216 00000100:00100000:3.0:1788201485.372677:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559609216 00002000:00100000:3.0:1788201485.372748:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (121638912->122687487) req@ffff96248c9cca80 x1875064559609216/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:606/0 lens 488/0 e 0 to 0 dl 1788201496 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201485.372758:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cca80 with x1875064559609216 ext(121638912->122687487) 00002000:00010000:3.0:1788201485.372763:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cca80 00000100:00100000:3.0:1788201485.372801:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 158 00000100:00100000:3.0:1788201485.372809:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2342:x1875064559609216:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201485.396522:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559609216:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23693us (28560us total) trans 30064771159 rc 0/0 00000100:00100000:0.0:1788201485.396543:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 158 00002000:00100000:0.0:1788201485.396562:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (121638912->122687487) req@ffff96248c9cca80 x1875064559609216/t30064771159(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:606/0 lens 488/448 e 0 to 0 dl 1788201496 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201485.396586:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cca80 with x1875064559609216 ext(121638912->122687487) 00002000:00010000:0.0:1788201485.396603:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cca80 00000100:00100000:1.0:1788201485.558205:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201485.558452:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559609344 00000100:00100000:3.0:1788201485.558466:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559609344 00002000:00100000:3.0:1788201485.558533:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (122687488->123736063) req@ffff9624ba438000 x1875064559609344/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:606/0 lens 488/0 e 0 to 0 dl 1788201496 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201485.558548:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba438000 with x1875064559609344 ext(122687488->123736063) 00002000:00010000:3.0:1788201485.558555:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba438000 00000100:00100000:3.0:1788201485.558624:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 159 00000100:00100000:3.0:1788201485.558637:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559609344:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201485.586780:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559609344:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28128us (28573us total) trans 30064771160 rc 0/0 00000100:00100000:2.0:1788201485.586800:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 159 00002000:00100000:2.0:1788201485.586819:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (122687488->123736063) req@ffff9624ba438000 x1875064559609344/t30064771160(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:606/0 lens 488/448 e 0 to 0 dl 1788201496 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201485.586832:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba438000 with x1875064559609344 ext(122687488->123736063) 00002000:00010000:2.0:1788201485.586839:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba438000 00000100:00100000:1.0:1788201485.769529:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201485.769613:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559609472 00000100:00100000:2.0:1788201485.769628:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559609472 00002000:00100000:2.0:1788201485.769705:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (123736064->124784639) req@ffff9624904ea680 x1875064559609472/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:606/0 lens 488/0 e 0 to 0 dl 1788201496 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201485.769718:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904ea680 with x1875064559609472 ext(123736064->124784639) 00002000:00010000:2.0:1788201485.769725:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904ea680 00000100:00100000:2.0:1788201485.769856:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 160 00000100:00100000:2.0:1788201485.769867:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559609472:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201485.787855:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559609472:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17968us (18321us total) trans 30064771161 rc 0/0 00000100:00100000:2.0:1788201485.787878:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 160 00002000:00100000:2.0:1788201485.787900:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (123736064->124784639) req@ffff9624904ea680 x1875064559609472/t30064771161(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:606/0 lens 488/448 e 0 to 0 dl 1788201496 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201485.787912:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904ea680 with x1875064559609472 ext(123736064->124784639) 00002000:00010000:2.0:1788201485.787921:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904ea680 00000100:00100000:0.0:1788201486.002139:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201486.002247:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559609600 00000100:00100000:1.0:1788201486.002261:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559609600 00002000:00100000:1.0:1788201486.002329:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (124784640->125833215) req@ffff962487e79c00 x1875064559609600/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:607/0 lens 488/0 e 0 to 0 dl 1788201497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201486.002458:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79c00 with x1875064559609600 ext(124784640->125833215) 00002000:00010000:1.0:1788201486.002465:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79c00 00000100:00100000:1.0:1788201486.002551:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 161 00000100:00100000:1.0:1788201486.002564:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2341:x1875064559609600:12345-192.168.201.56@tcp:4:iozone.0 00000001:00080000:2.0:1788201486.006535:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771143 is committed 00000001:00080000:2.0:1788201486.006594:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771155 is committed 00000001:00080000:2.0:1788201486.006618:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771161 is committed 00000100:00100000:2.0:1788201486.023816:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559609600:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21237us (21671us total) trans 30064771162 rc 0/0 00000100:00100000:2.0:1788201486.023836:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 161 00002000:00100000:2.0:1788201486.023853:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (124784640->125833215) req@ffff962487e79c00 x1875064559609600/t30064771162(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:607/0 lens 488/448 e 0 to 0 dl 1788201497 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201486.023865:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79c00 with x1875064559609600 ext(124784640->125833215) 00002000:00010000:2.0:1788201486.023873:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79c00 00010000:00010000:2.0:1788201486.134703:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201486.197546:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201486.198016:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559609728 00000100:00100000:3.0:1788201486.198030:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559609728 00002000:00100000:3.0:1788201486.198226:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (125833216->126881791) req@ffff962487e7b100 x1875064559609728/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:607/0 lens 488/0 e 0 to 0 dl 1788201497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201486.198239:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b100 with x1875064559609728 ext(125833216->126881791) 00002000:00010000:3.0:1788201486.198246:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b100 00000100:00100000:3.0:1788201486.198338:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 162 00000100:00100000:3.0:1788201486.198405:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559609728:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201486.230302:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559609728:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31882us (32754us total) trans 30064771163 rc 0/0 00000100:00100000:3.0:1788201486.230321:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 162 00002000:00100000:3.0:1788201486.230338:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (125833216->126881791) req@ffff962487e7b100 x1875064559609728/t30064771163(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:607/0 lens 488/448 e 0 to 0 dl 1788201497 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201486.230385:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b100 with x1875064559609728 ext(125833216->126881791) 00002000:00010000:3.0:1788201486.230394:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b100 00000100:00100000:1.0:1788201486.467319:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201486.467562:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559609856 00000100:00100000:3.0:1788201486.467583:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559609856 00002000:00100000:3.0:1788201486.467661:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (126881792->127930367) req@ffff9624b9d6b100 x1875064559609856/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:607/0 lens 488/0 e 0 to 0 dl 1788201497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201486.467674:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6b100 with x1875064559609856 ext(126881792->127930367) 00002000:00010000:3.0:1788201486.467682:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6b100 00000100:00100000:3.0:1788201486.467727:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 163 00000100:00100000:3.0:1788201486.467740:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559609856:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201486.504468:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559609856:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36709us (37144us total) trans 30064771164 rc 0/0 00000100:00100000:3.0:1788201486.504488:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 163 00002000:00100000:3.0:1788201486.504510:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (126881792->127930367) req@ffff9624b9d6b100 x1875064559609856/t30064771164(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:607/0 lens 488/448 e 0 to 0 dl 1788201497 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201486.504523:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6b100 with x1875064559609856 ext(126881792->127930367) 00002000:00010000:3.0:1788201486.504530:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6b100 00000100:00100000:1.0:1788201486.631586:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201486.631773:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559609984 00000100:00100000:2.0:1788201486.631791:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559609984 00002000:00100000:2.0:1788201486.631874:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (127930368->128978943) req@ffff9624b9d68a80 x1875064559609984/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:607/0 lens 488/0 e 0 to 0 dl 1788201497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201486.631988:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68a80 with x1875064559609984 ext(127930368->128978943) 00002000:00010000:2.0:1788201486.631995:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68a80 00000100:00100000:2.0:1788201486.632040:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 164 00000100:00100000:2.0:1788201486.632052:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559609984:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201486.652645:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559609984:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20576us (21066us total) trans 30064771165 rc 0/0 00000100:00100000:2.0:1788201486.652667:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 164 00002000:00100000:2.0:1788201486.652687:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (127930368->128978943) req@ffff9624b9d68a80 x1875064559609984/t30064771165(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:607/0 lens 488/448 e 0 to 0 dl 1788201497 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201486.652700:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68a80 with x1875064559609984 ext(127930368->128978943) 00002000:00010000:2.0:1788201486.652708:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68a80 00000100:00100000:1.0:1788201486.794526:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201486.794617:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559610112 00000100:00100000:2.0:1788201486.794632:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559610112 00002000:00100000:2.0:1788201486.794709:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (128978944->130027519) req@ffff9624b9d6bb80 x1875064559610112/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:607/0 lens 488/0 e 0 to 0 dl 1788201497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201486.794725:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6bb80 with x1875064559610112 ext(128978944->130027519) 00002000:00010000:2.0:1788201486.794731:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6bb80 00000100:00100000:2.0:1788201486.794775:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 165 00000100:00100000:2.0:1788201486.794788:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559610112:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201486.813915:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559610112:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19111us (19387us total) trans 30064771166 rc 0/0 00000100:00100000:2.0:1788201486.813933:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 165 00002000:00100000:2.0:1788201486.813966:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (128978944->130027519) req@ffff9624b9d6bb80 x1875064559610112/t30064771166(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:607/0 lens 488/448 e 0 to 0 dl 1788201497 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201486.813978:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6bb80 with x1875064559610112 ext(128978944->130027519) 00002000:00010000:2.0:1788201486.813987:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6bb80 00000100:00100000:0.0:1788201486.945212:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201486.945532:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559610240 00000100:00100000:3.0:1788201486.945555:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559610240 00002000:00100000:3.0:1788201486.945638:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (130027520->131076095) req@ffff962487e78a80 x1875064559610240/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:607/0 lens 488/0 e 0 to 0 dl 1788201497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201486.945652:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78a80 with x1875064559610240 ext(130027520->131076095) 00002000:00010000:3.0:1788201486.945660:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78a80 00000100:00100000:3.0:1788201486.945703:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 166 00000100:00100000:3.0:1788201486.945715:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559610240:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201486.969828:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559610240:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24095us (24615us total) trans 30064771167 rc 0/0 00000100:00100000:2.0:1788201486.969848:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 166 00002000:00100000:2.0:1788201486.969867:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (130027520->131076095) req@ffff962487e78a80 x1875064559610240/t30064771167(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:607/0 lens 488/448 e 0 to 0 dl 1788201497 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201486.969879:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78a80 with x1875064559610240 ext(130027520->131076095) 00002000:00010000:2.0:1788201486.969887:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78a80 00000100:00100000:0.0:1788201487.104494:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201487.104692:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559610368 00000100:00100000:3.0:1788201487.104771:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559610368 00002000:00100000:3.0:1788201487.104894:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (131076096->132124671) req@ffff962487e7bb80 x1875064559610368/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:608/0 lens 488/0 e 0 to 0 dl 1788201498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201487.104908:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7bb80 with x1875064559610368 ext(131076096->132124671) 00002000:00010000:3.0:1788201487.104915:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7bb80 00000100:00100000:3.0:1788201487.104957:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 167 00000100:00100000:3.0:1788201487.104970:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559610368:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201487.106175:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201487.121309:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559610368:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16324us (16811us total) trans 30064771168 rc 0/0 00000100:00100000:3.0:1788201487.121330:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 167 00002000:00100000:3.0:1788201487.121389:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (131076096->132124671) req@ffff962487e7bb80 x1875064559610368/t30064771168(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:608/0 lens 488/448 e 0 to 0 dl 1788201498 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201487.121402:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7bb80 with x1875064559610368 ext(131076096->132124671) 00002000:00010000:3.0:1788201487.121411:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7bb80 00010000:00010000:1.0:1788201487.162696:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201487.163105:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201487.163153:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201487.163209:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201487.163313:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559610496 00000100:00100000:0.0:1788201487.163314:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559610752 00000100:00100000:0.0:1788201487.163328:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559610752 00000100:00100000:3.0:1788201487.163378:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559610496 00000100:00100000:3.0:1788201487.163447:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 510 00000100:00100000:3.0:1788201487.163461:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559610496:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201487.163501:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 211 00000100:00100000:0.0:1788201487.163511:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559610752:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201487.163578:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559610752:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 70us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.163587:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 211 00000100:00100000:3.0:1788201487.163605:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559610496:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 146us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201487.163614:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 510 00000100:00080000:0.0:1788201487.163615:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201487.164604:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559610624 00000100:00100000:2.0:1788201487.164616:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559610624 00000100:00080000:0.0:1788201487.164698:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201487.164699:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 335 00000100:00100000:2.0:1788201487.164709:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559610624:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201487.164776:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559610624:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 68us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201487.164783:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 335 00000100:00100000:0.0:1788201487.251763:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201487.252017:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559610880 00000100:00100000:2.0:1788201487.252091:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559610880 00002000:00100000:2.0:1788201487.252160:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (132124672->133173247) req@ffff962487e79880 x1875064559610880/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:608/0 lens 488/0 e 0 to 0 dl 1788201498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201487.252175:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79880 with x1875064559610880 ext(132124672->133173247) 00002000:00010000:2.0:1788201487.252182:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79880 00000100:00100000:2.0:1788201487.252283:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 168 00000100:00100000:2.0:1788201487.252297:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559610880:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201487.268854:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559610880:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16541us (17087us total) trans 30064771169 rc 0/0 00000100:00100000:3.0:1788201487.268874:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 168 00002000:00100000:3.0:1788201487.269087:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (132124672->133173247) req@ffff962487e79880 x1875064559610880/t30064771169(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:608/0 lens 488/448 e 0 to 0 dl 1788201498 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201487.269101:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79880 with x1875064559610880 ext(132124672->133173247) 00002000:00010000:3.0:1788201487.269111:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79880 00000100:00100000:1.0:1788201487.414166:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201487.414291:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559611008 00000100:00100000:2.0:1788201487.414304:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559611008 00002000:00100000:2.0:1788201487.414611:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (133173248->134221823) req@ffff9624b9d69180 x1875064559611008/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:608/0 lens 488/0 e 0 to 0 dl 1788201498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201487.414625:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d69180 with x1875064559611008 ext(133173248->134221823) 00002000:00010000:2.0:1788201487.414633:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d69180 00000100:00100000:2.0:1788201487.414719:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 169 00000100:00100000:2.0:1788201487.414732:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559611008:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201487.444807:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559611008:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30055us (30634us total) trans 30064771170 rc 0/0 00000100:00100000:3.0:1788201487.444827:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 169 00002000:00100000:3.0:1788201487.444844:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (133173248->134221823) req@ffff9624b9d69180 x1875064559611008/t30064771170(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:608/0 lens 488/448 e 0 to 0 dl 1788201498 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201487.444856:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d69180 with x1875064559611008 ext(133173248->134221823) 00002000:00010000:3.0:1788201487.444864:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d69180 00000100:00100000:1.0:1788201487.619525:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201487.619893:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559611136 00000100:00100000:0.0:1788201487.619908:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559611136 00002000:00100000:0.0:1788201487.619978:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (134221824->135270399) req@ffff9624b9d68700 x1875064559611136/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:608/0 lens 488/0 e 0 to 0 dl 1788201498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201487.619990:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68700 with x1875064559611136 ext(134221824->135270399) 00002000:00010000:0.0:1788201487.619997:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68700 00000100:00100000:0.0:1788201487.620047:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 170 00000100:00100000:0.0:1788201487.620059:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559611136:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201487.637279:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559611136:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17204us (17752us total) trans 30064771171 rc 0/0 00000100:00100000:0.0:1788201487.637299:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 170 00002000:00100000:0.0:1788201487.637316:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (134221824->135270399) req@ffff9624b9d68700 x1875064559611136/t30064771171(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:608/0 lens 488/448 e 0 to 0 dl 1788201498 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201487.637329:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68700 with x1875064559611136 ext(134221824->135270399) 00002000:00010000:0.0:1788201487.637337:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68700 00000100:00100000:2.0:1788201487.780513:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201487.780656:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559611264 00000100:00100000:3.0:1788201487.780672:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559611264 00002000:00100000:3.0:1788201487.780747:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (135270400->136318975) req@ffff96248cd05c00 x1875064559611264/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:608/0 lens 488/0 e 0 to 0 dl 1788201498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201487.780787:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05c00 with x1875064559611264 ext(135270400->136318975) 00002000:00010000:3.0:1788201487.780794:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05c00 00000100:00100000:3.0:1788201487.780839:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 171 00000100:00100000:3.0:1788201487.780851:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559611264:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201487.799702:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559611264:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18834us (19186us total) trans 30064771172 rc 0/0 00000100:00100000:0.0:1788201487.799722:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 171 00002000:00100000:0.0:1788201487.799739:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (135270400->136318975) req@ffff96248cd05c00 x1875064559611264/t30064771172(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:608/0 lens 488/448 e 0 to 0 dl 1788201498 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201487.799752:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05c00 with x1875064559611264 ext(135270400->136318975) 00002000:00010000:0.0:1788201487.799761:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05c00 00000100:00100000:3.0:1788201487.926846:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201487.926880:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570131456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201487.926987:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201487.929017:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570131456 00000100:00100000:0.0:1788201487.929114:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570131456 00000100:00100000:0.0:1788201487.929289:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788201487.929302:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570131456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201487.929385:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201487.929486:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570131456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 186us (2499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.929500:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00010000:00080000:3.0:1788201487.931449:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248cd07100 x1875064570131456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201487.931483:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570131456:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201487.936964:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201487.985065:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201487.985742:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559611392 00000100:00100000:3.0:1788201487.985756:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559611392 00002000:00100000:3.0:1788201487.985829:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (136318976->137367551) req@ffff96248cd07100 x1875064559611392/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:608/0 lens 488/0 e 0 to 0 dl 1788201498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201487.985841:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07100 with x1875064559611392 ext(136318976->137367551) 00002000:00010000:3.0:1788201487.985849:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07100 00000100:00100000:3.0:1788201487.985956:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 172 00000100:00100000:3.0:1788201487.985968:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559611392:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201488.002809:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2341:x1875064559611392:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16824us (17741us total) trans 30064771173 rc 0/0 00000100:00100000:3.0:1788201488.002829:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 172 00002000:00100000:3.0:1788201488.002845:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (136318976->137367551) req@ffff96248cd07100 x1875064559611392/t30064771173(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:608/0 lens 488/448 e 0 to 0 dl 1788201498 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201488.002869:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07100 with x1875064559611392 ext(136318976->137367551) 00002000:00010000:3.0:1788201488.002878:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07100 00000100:00100000:2.0:1788201488.157859:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201488.158010:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559611520 00000100:00100000:3.0:1788201488.158034:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559611520 00002000:00100000:3.0:1788201488.158105:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (137367552->138416127) req@ffff96248cd04e00 x1875064559611520/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:609/0 lens 488/0 e 0 to 0 dl 1788201499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201488.158116:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd04e00 with x1875064559611520 ext(137367552->138416127) 00002000:00010000:3.0:1788201488.158123:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd04e00 00000100:00100000:3.0:1788201488.158173:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 173 00000100:00100000:3.0:1788201488.158185:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559611520:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201488.182183:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559611520:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23981us (24319us total) trans 30064771174 rc 0/0 00000100:00100000:3.0:1788201488.182204:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 173 00002000:00100000:3.0:1788201488.182219:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (137367552->138416127) req@ffff96248cd04e00 x1875064559611520/t30064771174(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:609/0 lens 488/448 e 0 to 0 dl 1788201499 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201488.182232:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd04e00 with x1875064559611520 ext(137367552->138416127) 00002000:00010000:3.0:1788201488.182240:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd04e00 00010000:00010000:0.0:1788201488.187286:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201488.358278:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201488.359532:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559611648 00000100:00100000:0.0:1788201488.359576:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559611648 00002000:00100000:0.0:1788201488.359668:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (138416128->139464703) req@ffff9624b9d6a300 x1875064559611648/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:609/0 lens 488/0 e 0 to 0 dl 1788201499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201488.359682:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6a300 with x1875064559611648 ext(138416128->139464703) 00002000:00010000:0.0:1788201488.359688:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6a300 00000100:00100000:0.0:1788201488.359731:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 174 00000100:00100000:0.0:1788201488.359742:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559611648:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201488.389395:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559611648:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29247us (30727us total) trans 30064771175 rc 0/0 00000100:00100000:0.0:1788201488.389416:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 174 00002000:00100000:0.0:1788201488.389435:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (138416128->139464703) req@ffff9624b9d6a300 x1875064559611648/t30064771175(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:609/0 lens 488/448 e 0 to 0 dl 1788201499 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201488.389447:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6a300 with x1875064559611648 ext(138416128->139464703) 00002000:00010000:0.0:1788201488.389456:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6a300 00000100:00100000:0.0:1788201488.439247:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570131840:0@lo:400:kworker.0 00000100:00100000:3.0:1788201488.439314:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570131584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201488.439568:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201488.439638:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570132096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201488.439673:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201488.439707:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201488.439733:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570131968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201488.439764:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201488.439800:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570131584 00000100:00100000:3.0:1788201488.439808:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570131584 00000100:00100000:3.0:1788201488.439865:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1788201488.439876:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570131584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201488.439939:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570131584:12345-0@lo:400:kworker.0 Request processed in 63us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201488.439947:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1788201488.439988:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570132096 00000100:00100000:3.0:1788201488.439992:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570132096 00000100:00100000:3.0:1788201488.440262:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788201488.440271:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570132096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201488.440309:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570132096:12345-0@lo:400:kworker.0 Request processed in 40us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201488.440316:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788201488.440388:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570131584:0@lo:400:kworker.0 00010000:00080000:3.0:1788201488.440403:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962381954e00 x1875064570132096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201488.440414:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570132096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201488.441407:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570131968 00000100:00100000:3.0:1788201488.441417:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570131968 00000100:00100000:2.0:1788201488.442133:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788201488.442147:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570131968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201488.442264:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570131968:12345-0@lo:400:kworker.0 Request processed in 121us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201488.442274:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788201488.442454:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570131712:0@lo:400:kworker.0 00000100:00100000:2.0:1788201488.442502:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201488.442557:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570132224:0@lo:400:kworker.0 00000100:00100000:2.0:1788201488.442583:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201488.442618:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570131712 00000100:00100000:2.0:1788201488.442640:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570131712 00000100:00100000:0.0:1788201488.442659:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201488.442665:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570132224 00000100:00100000:2.0:1788201488.442667:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570132224 00000100:00100000:2.0:1788201488.442690:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788201488.442692:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570131840 00000100:00100000:0.0:1788201488.442695:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570131840 00000100:00100000:2.0:1788201488.442696:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570131712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201488.442725:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788201488.442732:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570131840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201488.442732:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570131712:12345-0@lo:400:kworker.0 Request processed in 37us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201488.442738:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788201488.442749:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788201488.442755:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570132224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201488.442762:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570131840:12345-0@lo:400:kworker.0 Request processed in 32us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201488.442768:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788201488.442779:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570132224:12345-0@lo:400:kworker.0 Request processed in 25us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201488.442785:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788201488.442804:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570131840:0@lo:400:kworker.0 00000100:00100000:2.0:1788201488.442805:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570131712:0@lo:400:kworker.0 00000100:00100000:2.0:1788201488.442814:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570132224:0@lo:400:kworker.0 00000100:00080000:2.0:1788201488.445960:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201488.445978:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201488.446076:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570131968:0@lo:400:kworker.0 00000100:00100000:2.0:1788201488.534637:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201488.534766:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559611776 00000100:00100000:0.0:1788201488.534779:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559611776 00002000:00100000:0.0:1788201488.534870:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (139464704->140513279) req@ffff962381955c00 x1875064559611776/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:609/0 lens 488/0 e 0 to 0 dl 1788201499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201488.534884:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955c00 with x1875064559611776 ext(139464704->140513279) 00002000:00010000:0.0:1788201488.534892:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955c00 00000100:00100000:0.0:1788201488.534932:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 175 00000100:00100000:0.0:1788201488.534946:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559611776:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201488.553748:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559611776:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18783us (19107us total) trans 30064771176 rc 0/0 00000100:00100000:0.0:1788201488.553769:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 175 00002000:00100000:0.0:1788201488.553792:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (139464704->140513279) req@ffff962381955c00 x1875064559611776/t30064771176(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:609/0 lens 488/448 e 0 to 0 dl 1788201499 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201488.553805:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955c00 with x1875064559611776 ext(139464704->140513279) 00002000:00010000:0.0:1788201488.553813:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955c00 00000100:00100000:3.0:1788201488.750310:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201488.750618:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559611904 00000100:00100000:2.0:1788201488.750632:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559611904 00002000:00100000:2.0:1788201488.750705:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (140513280->141561855) req@ffff962381a0d880 x1875064559611904/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:609/0 lens 488/0 e 0 to 0 dl 1788201499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201488.750719:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0d880 with x1875064559611904 ext(140513280->141561855) 00002000:00010000:2.0:1788201488.750726:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0d880 00000100:00100000:2.0:1788201488.750773:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 176 00000100:00100000:2.0:1788201488.750810:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559611904:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201488.781967:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559611904:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31145us (31658us total) trans 30064771177 rc 0/0 00000100:00100000:2.0:1788201488.781984:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 176 00002000:00100000:2.0:1788201488.782001:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (140513280->141561855) req@ffff962381a0d880 x1875064559611904/t30064771177(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:609/0 lens 488/448 e 0 to 0 dl 1788201499 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201488.783999:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0d880 with x1875064559611904 ext(140513280->141561855) 00002000:00010000:2.0:1788201488.784482:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0d880 00000100:00100000:1.0:1788201488.923742:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201488.923930:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559612032 00000100:00100000:3.0:1788201488.923942:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559612032 00002000:00100000:3.0:1788201488.924025:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (141561856->142610431) req@ffff9624b9d69500 x1875064559612032/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:609/0 lens 488/0 e 0 to 0 dl 1788201499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201488.924060:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d69500 with x1875064559612032 ext(141561856->142610431) 00002000:00010000:3.0:1788201488.924068:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d69500 00000100:00100000:3.0:1788201488.924170:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 177 00000100:00100000:3.0:1788201488.924182:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559612032:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201488.945824:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559612032:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21624us (22080us total) trans 30064771178 rc 0/0 00000100:00100000:3.0:1788201488.945844:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 177 00002000:00100000:3.0:1788201488.945934:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (141561856->142610431) req@ffff9624b9d69500 x1875064559612032/t30064771178(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:609/0 lens 488/448 e 0 to 0 dl 1788201499 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201488.945947:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d69500 with x1875064559612032 ext(141561856->142610431) 00002000:00010000:3.0:1788201488.945956:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d69500 00000100:00100000:1.0:1788201489.111522:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201489.111695:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559612160 00000100:00100000:0.0:1788201489.111709:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559612160 00002000:00100000:0.0:1788201489.111813:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (142610432->143659007) req@ffff9624b9d68380 x1875064559612160/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:610/0 lens 488/0 e 0 to 0 dl 1788201500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201489.111826:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68380 with x1875064559612160 ext(142610432->143659007) 00002000:00010000:0.0:1788201489.111834:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68380 00000100:00100000:0.0:1788201489.111889:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 178 00000100:00100000:0.0:1788201489.111903:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559612160:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201489.113706:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201489.141864:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559612160:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29937us (30330us total) trans 30064771179 rc 0/0 00000100:00100000:0.0:1788201489.141883:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 178 00002000:00100000:0.0:1788201489.141901:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (142610432->143659007) req@ffff9624b9d68380 x1875064559612160/t30064771179(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:610/0 lens 488/448 e 0 to 0 dl 1788201500 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201489.141912:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68380 with x1875064559612160 ext(142610432->143659007) 00002000:00010000:0.0:1788201489.141921:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68380 00010000:00010000:2.0:1788201489.206642:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201489.280756:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201489.280896:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559612288 00000100:00100000:0.0:1788201489.280910:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559612288 00002000:00100000:0.0:1788201489.280983:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (143659008->144707583) req@ffff962381956680 x1875064559612288/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:610/0 lens 488/0 e 0 to 0 dl 1788201500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201489.280998:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381956680 with x1875064559612288 ext(143659008->144707583) 00002000:00010000:0.0:1788201489.281071:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381956680 00000100:00100000:0.0:1788201489.281113:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 179 00000100:00100000:0.0:1788201489.281124:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559612288:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201489.302461:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559612288:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21320us (21703us total) trans 30064771180 rc 0/0 00000100:00100000:0.0:1788201489.302497:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 179 00002000:00100000:0.0:1788201489.302517:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (143659008->144707583) req@ffff962381956680 x1875064559612288/t30064771180(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:610/0 lens 488/448 e 0 to 0 dl 1788201500 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201489.302540:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381956680 with x1875064559612288 ext(143659008->144707583) 00002000:00010000:0.0:1788201489.302548:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381956680 00000100:00100000:2.0:1788201489.443556:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201489.443723:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559612416 00000100:00100000:3.0:1788201489.443738:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559612416 00002000:00100000:3.0:1788201489.443813:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (144707584->145756159) req@ffff962381954000 x1875064559612416/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:610/0 lens 488/0 e 0 to 0 dl 1788201500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201489.443827:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954000 with x1875064559612416 ext(144707584->145756159) 00002000:00010000:3.0:1788201489.443833:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954000 00000100:00100000:3.0:1788201489.444021:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 180 00000100:00100000:3.0:1788201489.444035:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559612416:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201489.467076:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559612416:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22810us (23302us total) trans 30064771181 rc 0/0 00000100:00100000:3.0:1788201489.467095:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 180 00002000:00100000:3.0:1788201489.467128:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (144707584->145756159) req@ffff962381954000 x1875064559612416/t30064771181(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:610/0 lens 488/448 e 0 to 0 dl 1788201500 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201489.474233:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954000 with x1875064559612416 ext(144707584->145756159) 00002000:00010000:3.0:1788201489.474246:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954000 00000100:00100000:1.0:1788201489.626764:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201489.626865:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559612544 00000100:00100000:3.0:1788201489.626879:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559612544 00002000:00100000:3.0:1788201489.626954:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (145756160->146804735) req@ffff9624b9d69f80 x1875064559612544/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:610/0 lens 488/0 e 0 to 0 dl 1788201500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201489.626968:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d69f80 with x1875064559612544 ext(145756160->146804735) 00002000:00010000:3.0:1788201489.626975:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d69f80 00000100:00100000:3.0:1788201489.627073:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 181 00000100:00100000:3.0:1788201489.627085:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559612544:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201489.644289:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559612544:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17189us (17524us total) trans 30064771182 rc 0/0 00000100:00100000:3.0:1788201489.646271:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 181 00002000:00100000:3.0:1788201489.646295:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (145756160->146804735) req@ffff9624b9d69f80 x1875064559612544/t30064771182(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:610/0 lens 488/448 e 0 to 0 dl 1788201500 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201489.646308:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d69f80 with x1875064559612544 ext(145756160->146804735) 00002000:00010000:3.0:1788201489.646316:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d69f80 00000100:00100000:2.0:1788201489.806656:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201489.806881:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559612672 00000100:00100000:0.0:1788201489.806895:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559612672 00002000:00100000:0.0:1788201489.806966:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (146804736->147853311) req@ffff962381956d80 x1875064559612672/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:610/0 lens 488/0 e 0 to 0 dl 1788201500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201489.806979:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381956d80 with x1875064559612672 ext(146804736->147853311) 00002000:00010000:0.0:1788201489.806985:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381956d80 00000100:00100000:0.0:1788201489.807035:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 182 00000100:00100000:0.0:1788201489.807047:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2342:x1875064559612672:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201489.838681:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559612672:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31618us (32022us total) trans 30064771183 rc 0/0 00000100:00100000:0.0:1788201489.838700:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 182 00002000:00100000:0.0:1788201489.838718:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (146804736->147853311) req@ffff962381956d80 x1875064559612672/t30064771183(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:610/0 lens 488/448 e 0 to 0 dl 1788201500 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201489.838731:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381956d80 with x1875064559612672 ext(146804736->147853311) 00002000:00010000:0.0:1788201489.838739:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381956d80 00000100:00100000:2.0:1788201490.057899:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201490.058099:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559612800 00000100:00100000:0.0:1788201490.058113:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559612800 00002000:00100000:0.0:1788201490.058187:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (147853312->148901887) req@ffff9624b9de8700 x1875064559612800/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:611/0 lens 488/0 e 0 to 0 dl 1788201501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201490.058215:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de8700 with x1875064559612800 ext(147853312->148901887) 00002000:00010000:0.0:1788201490.058223:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de8700 00000100:00100000:0.0:1788201490.058885:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 183 00000100:00100000:0.0:1788201490.058899:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559612800:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201490.094965:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559612800:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36053us (37066us total) trans 30064771184 rc 0/0 00000100:00100000:0.0:1788201490.094986:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 183 00002000:00100000:0.0:1788201490.095005:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (147853312->148901887) req@ffff9624b9de8700 x1875064559612800/t30064771184(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:611/0 lens 488/448 e 0 to 0 dl 1788201501 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201490.100035:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de8700 with x1875064559612800 ext(147853312->148901887) 00002000:00010000:0.0:1788201490.100050:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de8700 00010000:00010000:1.0:1788201490.233703:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201490.259864:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201490.259957:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559612928 00000100:00100000:3.0:1788201490.260036:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559612928 00002000:00100000:3.0:1788201490.260106:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (148901888->149950463) req@ffff9624b9de8e00 x1875064559612928/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:611/0 lens 488/0 e 0 to 0 dl 1788201501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201490.260118:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de8e00 with x1875064559612928 ext(148901888->149950463) 00002000:00010000:3.0:1788201490.260145:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de8e00 00000100:00100000:3.0:1788201490.260248:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 184 00000100:00100000:3.0:1788201490.260261:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559612928:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201490.286015:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559612928:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25738us (26150us total) trans 30064771185 rc 0/0 00000100:00100000:3.0:1788201490.286035:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 184 00002000:00100000:3.0:1788201490.286054:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (148901888->149950463) req@ffff9624b9de8e00 x1875064559612928/t30064771185(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:611/0 lens 488/448 e 0 to 0 dl 1788201501 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201490.286067:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de8e00 with x1875064559612928 ext(148901888->149950463) 00002000:00010000:3.0:1788201490.286076:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de8e00 00000100:00100000:1.0:1788201490.425603:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201490.425730:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559613056 00000100:00100000:3.0:1788201490.425743:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559613056 00002000:00100000:3.0:1788201490.425812:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (149950464->150999039) req@ffff9624b9d6b480 x1875064559613056/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:611/0 lens 488/0 e 0 to 0 dl 1788201501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201490.425824:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6b480 with x1875064559613056 ext(149950464->150999039) 00002000:00010000:3.0:1788201490.425832:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6b480 00000100:00100000:3.0:1788201490.425870:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 185 00000100:00100000:3.0:1788201490.425881:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2342:x1875064559613056:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201490.472686:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559613056:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 46788us (47095us total) trans 30064771186 rc 0/0 00000100:00100000:2.0:1788201490.472706:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 185 00002000:00100000:2.0:1788201490.472725:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (149950464->150999039) req@ffff9624b9d6b480 x1875064559613056/t30064771186(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:611/0 lens 488/448 e 0 to 0 dl 1788201501 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201490.472738:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6b480 with x1875064559613056 ext(149950464->150999039) 00002000:00010000:2.0:1788201490.472746:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6b480 00000100:00100000:3.0:1788201490.486766:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201490.486798:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962487e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570132352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201490.486907:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201490.487120:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570132352 00000100:00100000:0.0:1788201490.487131:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570132352 00000100:00100000:0.0:1788201490.487217:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788201490.487229:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570132352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201490.487260:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 130351104 pending 85196800 free 3733979136 avail 3731881984 00000100:00100000:0.0:1788201490.487310:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570132352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201490.487318:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:1.0:1788201490.487489:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201490.487821:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962487e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570132352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201490.631211:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201490.631380:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559613184 00000100:00100000:0.0:1788201490.631393:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559613184 00002000:00100000:0.0:1788201490.631462:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (150999040->152047615) req@ffff9624b9d6b800 x1875064559613184/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:611/0 lens 488/0 e 0 to 0 dl 1788201501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201490.631512:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6b800 with x1875064559613184 ext(150999040->152047615) 00002000:00010000:0.0:1788201490.631521:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6b800 00000100:00100000:0.0:1788201490.631562:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 186 00000100:00100000:0.0:1788201490.631574:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559613184:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201490.650716:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2344:x1875064559613184:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19124us (19501us total) trans 30064771187 rc 0/0 00000100:00100000:3.0:1788201490.650736:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 186 00002000:00100000:3.0:1788201490.650773:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (150999040->152047615) req@ffff9624b9d6b800 x1875064559613184/t30064771187(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:611/0 lens 488/448 e 0 to 0 dl 1788201501 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201490.650785:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6b800 with x1875064559613184 ext(150999040->152047615) 00002000:00010000:3.0:1788201490.650792:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6b800 00000100:00100000:2.0:1788201490.739689:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201490.740916:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559613312 00000100:00100000:0.0:1788201490.740933:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559613312 00002000:00100000:0.0:1788201490.741197:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (152047616->152588287) req@ffff9624c1c25f80 x1875064559613312/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:611/0 lens 488/0 e 0 to 0 dl 1788201501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201490.741210:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25f80 with x1875064559613312 ext(152047616->152588287) 00002000:00010000:0.0:1788201490.741218:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25f80 00000100:00100000:0.0:1788201490.741271:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 187 00000100:00100000:0.0:1788201490.741451:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2342:x1875064559613312:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201490.752769:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2342:x1875064559613312:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11469us (13079us total) trans 30064771188 rc 0/0 00000100:00100000:0.0:1788201490.752787:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 187 00002000:00100000:0.0:1788201490.752802:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (152047616->152588287) req@ffff9624c1c25f80 x1875064559613312/t30064771188(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:611/0 lens 488/448 e 0 to 0 dl 1788201501 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201490.752814:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25f80 with x1875064559613312 ext(152047616->152588287) 00002000:00010000:0.0:1788201490.753164:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25f80 00010000:00010000:0.0:1788201491.273791:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201491.309461:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201491.309883:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201491.309920:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559613440 00000100:00100000:3.0:1788201491.309933:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559613440 00002000:00100000:3.0:1788201491.310023:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (153092096->154140671) req@ffff962381a0d180 x1875064559613440/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:612/0 lens 488/0 e 0 to 0 dl 1788201502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201491.310037:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0d180 with x1875064559613440 ext(153092096->154140671) 00002000:00010000:3.0:1788201491.310044:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0d180 00000100:00100000:3.0:1788201491.310070:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559613568 00000100:00100000:3.0:1788201491.310074:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559613568 00002000:00100000:3.0:1788201491.310089:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (152588288->154144767) req@ffff962381a0c700 x1875064559613568/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:612/0 lens 504/0 e 0 to 0 dl 1788201502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201491.310098:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0c700 with x1875064559613568 ext(152588288->154144767) 00002000:00010000:3.0:1788201491.310101:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0c700 00000100:00100000:3.0:1788201491.310122:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 188 00000100:00100000:3.0:1788201491.310135:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+61:2343:x1875064559613440:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201491.310398:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 189 00000100:00100000:3.0:1788201491.310408:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2343:x1875064559613568:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201491.311472:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201491.334511:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2343:x1875064559613440:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24347us (25034us total) trans 30064771189 rc 0/0 00000100:00100000:1.0:1788201491.334530:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 188 00002000:00100000:1.0:1788201491.334565:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (153092096->154140671) req@ffff962381a0d180 x1875064559613440/t30064771189(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:612/0 lens 488/448 e 0 to 0 dl 1788201502 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201491.334577:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0d180 with x1875064559613440 ext(153092096->154140671) 00002000:00010000:1.0:1788201491.334585:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0d180 00000100:00100000:2.0:1788201491.352690:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2343:x1875064559613568:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 42267us (42792us total) trans 30064771190 rc 0/0 00000100:00100000:2.0:1788201491.352724:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 189 00002000:00100000:2.0:1788201491.352742:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (152588288->154144767) req@ffff962381a0c700 x1875064559613568/t30064771190(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:612/0 lens 504/448 e 0 to 0 dl 1788201502 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201491.352754:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0c700 with x1875064559613568 ext(152588288->154144767) 00002000:00010000:2.0:1788201491.352777:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0c700 00000001:00080000:2.0:1788201491.358862:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771188 is committed 00000100:00100000:0.0:1788201491.730232:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201491.730394:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559613696 00000100:00100000:3.0:1788201491.730424:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559613696 00002000:00100000:3.0:1788201491.730566:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (155189248->156237823) req@ffff962487e78700 x1875064559613696/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:612/0 lens 488/0 e 0 to 0 dl 1788201502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201491.730580:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78700 with x1875064559613696 ext(155189248->156237823) 00002000:00010000:3.0:1788201491.730587:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78700 00000100:00100000:3.0:1788201491.730671:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 190 00000100:00100000:3.0:1788201491.730683:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559613696:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201491.759394:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559613696:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28693us (29159us total) trans 30064771191 rc 0/0 00000100:00100000:3.0:1788201491.759414:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 190 00002000:00100000:3.0:1788201491.759435:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (155189248->156237823) req@ffff962487e78700 x1875064559613696/t30064771191(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:612/0 lens 488/448 e 0 to 0 dl 1788201502 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201491.759459:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78700 with x1875064559613696 ext(155189248->156237823) 00002000:00010000:3.0:1788201491.759468:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78700 00000100:00100000:1.0:1788201491.934855:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201491.934919:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559613824 00000100:00100000:3.0:1788201491.934932:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559613824 00002000:00100000:3.0:1788201491.935003:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (156237824->157286399) req@ffff9624b9d68000 x1875064559613824/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:612/0 lens 488/0 e 0 to 0 dl 1788201502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201491.935016:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68000 with x1875064559613824 ext(156237824->157286399) 00002000:00010000:3.0:1788201491.935023:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68000 00000100:00100000:3.0:1788201491.935065:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 191 00000100:00100000:3.0:1788201491.935077:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559613824:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201491.947282:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559613824:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12192us (12426us total) trans 30064771192 rc 0/0 00000100:00100000:3.0:1788201491.947323:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 191 00002000:00100000:3.0:1788201491.947370:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (156237824->157286399) req@ffff9624b9d68000 x1875064559613824/t30064771192(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:612/0 lens 488/448 e 0 to 0 dl 1788201502 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201491.947383:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68000 with x1875064559613824 ext(156237824->157286399) 00002000:00010000:3.0:1788201491.947392:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68000 00000100:00100000:2.0:1788201492.094245:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201492.094587:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559613952 00000100:00100000:0.0:1788201492.094620:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559613952 00002000:00100000:0.0:1788201492.094692:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (157286400->158334975) req@ffff9624c1c27480 x1875064559613952/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:613/0 lens 488/0 e 0 to 0 dl 1788201503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201492.094706:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c27480 with x1875064559613952 ext(157286400->158334975) 00002000:00010000:0.0:1788201492.094714:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c27480 00000100:00100000:0.0:1788201492.094804:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 192 00000100:00100000:0.0:1788201492.094816:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559613952:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201492.128071:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559613952:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33241us (33825us total) trans 30064771193 rc 0/0 00000100:00100000:3.0:1788201492.128091:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 192 00002000:00100000:3.0:1788201492.128108:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (157286400->158334975) req@ffff9624c1c27480 x1875064559613952/t30064771193(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:613/0 lens 488/448 e 0 to 0 dl 1788201503 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201492.128118:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c27480 with x1875064559613952 ext(157286400->158334975) 00002000:00010000:3.0:1788201492.128125:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c27480 00000100:00100000:2.0:1788201492.278508:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201492.278638:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201492.278817:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559614208 00000100:00100000:3.0:1788201492.278830:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559614208 00000100:00100000:3.0:1788201492.278928:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 339 00000100:00100000:3.0:1788201492.278942:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559614208:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201492.279049:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559614208:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 110us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201492.279058:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 339 00000100:00080000:2.0:1788201492.280610:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201492.280632:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201492.280723:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559614080 00000100:00100000:1.0:1788201492.280736:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559614080 00000100:00100000:1.0:1788201492.280853:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 512 00000100:00100000:1.0:1788201492.280866:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559614080:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201492.280978:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559614080:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 116us (2486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201492.280986:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 512 00000100:00100000:2.0:1788201492.282400:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201492.282536:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559614336 00000100:00100000:3.0:1788201492.282547:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559614336 00000100:00100000:3.0:1788201492.282620:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 214 00000100:00100000:3.0:1788201492.282631:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559614336:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201492.282721:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2343:x1875064559614336:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 92us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201492.282729:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 214 00000100:00080000:2.0:1788201492.282839:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201492.295214:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201492.297531:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559614464 00000100:00100000:2.0:1788201492.297552:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559614464 00002000:00100000:2.0:1788201492.297641:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (158334976->159383551) req@ffff9624b9d68e00 x1875064559614464/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:613/0 lens 488/0 e 0 to 0 dl 1788201503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201492.297666:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68e00 with x1875064559614464 ext(158334976->159383551) 00002000:00010000:2.0:1788201492.297674:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68e00 00000100:00100000:2.0:1788201492.297725:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 193 00000100:00100000:2.0:1788201492.297738:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559614464:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201492.317006:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559614464:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19252us (21790us total) trans 30064771194 rc 0/0 00000100:00100000:2.0:1788201492.317024:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 193 00002000:00100000:2.0:1788201492.317060:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (158334976->159383551) req@ffff9624b9d68e00 x1875064559614464/t30064771194(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:613/0 lens 488/448 e 0 to 0 dl 1788201503 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201492.317072:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68e00 with x1875064559614464 ext(158334976->159383551) 00002000:00010000:2.0:1788201492.317079:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68e00 00000100:00100000:3.0:1788201492.433651:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201492.433806:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559614592 00000100:00100000:1.0:1788201492.433819:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559614592 00002000:00100000:1.0:1788201492.433890:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (159383552->160432127) req@ffff962381a0e300 x1875064559614592/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:613/0 lens 488/0 e 0 to 0 dl 1788201503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201492.433905:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0e300 with x1875064559614592 ext(159383552->160432127) 00002000:00010000:1.0:1788201492.433911:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0e300 00000100:00100000:1.0:1788201492.433954:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 194 00000100:00100000:1.0:1788201492.433967:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559614592:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201492.450007:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559614592:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16025us (16357us total) trans 30064771195 rc 0/0 00000100:00100000:1.0:1788201492.450026:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 194 00002000:00100000:1.0:1788201492.450062:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (159383552->160432127) req@ffff962381a0e300 x1875064559614592/t30064771195(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:613/0 lens 488/448 e 0 to 0 dl 1788201503 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201492.450075:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0e300 with x1875064559614592 ext(159383552->160432127) 00002000:00010000:1.0:1788201492.450083:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0e300 00000100:00100000:2.0:1788201492.767966:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201492.769635:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559614720 00000100:00100000:3.0:1788201492.769655:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559614720 00002000:00100000:3.0:1788201492.769751:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (160432128->161480703) req@ffff9624c1c24e00 x1875064559614720/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:613/0 lens 488/0 e 0 to 0 dl 1788201503 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201492.769765:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c24e00 with x1875064559614720 ext(160432128->161480703) 00002000:00010000:3.0:1788201492.769773:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c24e00 00000100:00100000:3.0:1788201492.769820:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 195 00000100:00100000:3.0:1788201492.769832:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559614720:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201492.796600:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559614720:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26752us (28638us total) trans 30064771196 rc 0/0 00000100:00100000:1.0:1788201492.796619:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 195 00002000:00100000:1.0:1788201492.796636:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (160432128->161480703) req@ffff9624c1c24e00 x1875064559614720/t30064771196(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:613/0 lens 488/448 e 0 to 0 dl 1788201503 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201492.796649:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c24e00 with x1875064559614720 ext(160432128->161480703) 00002000:00010000:1.0:1788201492.796656:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c24e00 00000100:00100000:3.0:1788201493.046863:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201493.046900:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570132480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201493.047019:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201493.047280:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570132480 00000100:00100000:0.0:1788201493.047290:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570132480 00000100:00100000:0.0:1788201493.047417:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788201493.047429:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570132480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201493.047489:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201493.047553:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570132480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201493.047561:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:2.0:1788201493.047687:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788201493.047824:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1c26680 x1875064570132480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201493.047847:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570132480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201493.103051:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201493.103180:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559614848 00000100:00100000:3.0:1788201493.103195:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559614848 00002000:00100000:3.0:1788201493.103297:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (161480704->162529279) req@ffff962487e7a300 x1875064559614848/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:614/0 lens 488/0 e 0 to 0 dl 1788201504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201493.103313:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7a300 with x1875064559614848 ext(161480704->162529279) 00002000:00010000:3.0:1788201493.103320:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7a300 00000100:00100000:3.0:1788201493.103428:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 196 00000100:00100000:3.0:1788201493.103442:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559614848:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201493.104478:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201493.123244:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559614848:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19786us (20192us total) trans 30064771197 rc 0/0 00000100:00100000:1.0:1788201493.123262:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 196 00002000:00100000:1.0:1788201493.123278:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (161480704->162529279) req@ffff962487e7a300 x1875064559614848/t30064771197(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:614/0 lens 488/448 e 0 to 0 dl 1788201504 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201493.123290:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7a300 with x1875064559614848 ext(161480704->162529279) 00002000:00010000:1.0:1788201493.123300:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7a300 00010000:00010000:1.0:1788201493.302752:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201493.375127:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201493.375196:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559614976 00000100:00100000:2.0:1788201493.375210:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559614976 00002000:00100000:2.0:1788201493.375282:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (162529280->163577855) req@ffff9624b9d23100 x1875064559614976/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:614/0 lens 488/0 e 0 to 0 dl 1788201504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201493.375299:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d23100 with x1875064559614976 ext(162529280->163577855) 00002000:00010000:2.0:1788201493.375306:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d23100 00000100:00100000:2.0:1788201493.375572:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 197 00000100:00100000:2.0:1788201493.375586:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559614976:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201493.407248:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559614976:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31648us (32116us total) trans 30064771198 rc 0/0 00000100:00100000:3.0:1788201493.407266:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 197 00002000:00100000:3.0:1788201493.407282:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (162529280->163577855) req@ffff9624b9d23100 x1875064559614976/t30064771198(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:614/0 lens 488/448 e 0 to 0 dl 1788201504 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201493.407295:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d23100 with x1875064559614976 ext(162529280->163577855) 00002000:00010000:3.0:1788201493.407303:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d23100 00000100:00100000:2.0:1788201493.560244:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570132736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201493.560384:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201493.560483:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201493.560490:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570132864:0@lo:400:kworker.0 00000100:00100000:2.0:1788201493.560523:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201493.560576:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570132736 00000100:00100000:2.0:1788201493.560586:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570132736 00000100:00100000:2.0:1788201493.560652:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788201493.560664:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570132736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201493.560727:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570132736:12345-0@lo:400:kworker.0 Request processed in 65us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201493.560755:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788201493.560786:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570132864 00000100:00100000:2.0:1788201493.560789:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570132864 00000100:00100000:2.0:1788201493.560829:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788201493.560835:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570132864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201493.560873:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570132864:12345-0@lo:400:kworker.0 Request processed in 37us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201493.560879:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788201493.561102:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570132608:0@lo:400:kworker.0 00000100:00100000:3.0:1788201493.561155:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201493.561195:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570133120:0@lo:400:kworker.0 00000100:00100000:3.0:1788201493.561234:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201493.561265:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201493.561272:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570132992:0@lo:400:kworker.0 00000100:00100000:3.0:1788201493.561300:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201493.561331:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570132608 00000100:00100000:3.0:1788201493.561336:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570132608 00000100:00100000:3.0:1788201493.561406:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1788201493.561413:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570132608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201493.561474:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570132608:12345-0@lo:400:kworker.0 Request processed in 61us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201493.561486:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1788201493.561559:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570133120 00000100:00100000:3.0:1788201493.561563:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570133120 00000100:00100000:3.0:1788201493.561592:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570132992 00000100:00100000:3.0:1788201493.561595:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570132992 00000100:00100000:3.0:1788201493.561618:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788201493.561625:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570133120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201493.561660:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570133120:12345-0@lo:400:kworker.0 Request processed in 35us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201493.561666:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788201493.561679:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788201493.561685:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570132992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201493.561726:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570132992:12345-0@lo:400:kworker.0 Request processed in 41us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201493.561732:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788201493.561766:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570132992:0@lo:400:kworker.0 00000100:00100000:3.0:1788201493.561778:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570132608:0@lo:400:kworker.0 00000100:00100000:3.0:1788201493.561788:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570133120:0@lo:400:kworker.0 00000100:00080000:3.0:1788201493.561844:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201493.561850:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201493.562297:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570132864:0@lo:400:kworker.0 00000100:00100000:2.0:1788201493.562324:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570132736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201493.581827:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201493.581965:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559615104 00000100:00100000:1.0:1788201493.581980:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559615104 00002000:00100000:1.0:1788201493.582049:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (163577856->164626431) req@ffff9624c1c25c00 x1875064559615104/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:614/0 lens 488/0 e 0 to 0 dl 1788201504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201493.582062:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25c00 with x1875064559615104 ext(163577856->164626431) 00002000:00010000:1.0:1788201493.582085:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25c00 00000100:00100000:1.0:1788201493.582130:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 198 00000100:00100000:1.0:1788201493.582142:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559615104:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201493.611906:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559615104:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29749us (30081us total) trans 30064771199 rc 0/0 00000100:00100000:1.0:1788201493.611924:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 198 00002000:00100000:1.0:1788201493.611941:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (163577856->164626431) req@ffff9624c1c25c00 x1875064559615104/t30064771199(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:614/0 lens 488/448 e 0 to 0 dl 1788201504 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201493.611954:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25c00 with x1875064559615104 ext(163577856->164626431) 00002000:00010000:1.0:1788201493.611961:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25c00 00000100:00100000:0.0:1788201493.769202:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201493.769415:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559615232 00000100:00100000:1.0:1788201493.769429:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559615232 00002000:00100000:1.0:1788201493.769531:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (164626432->165675007) req@ffff962487e79500 x1875064559615232/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:614/0 lens 488/0 e 0 to 0 dl 1788201504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201493.769544:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79500 with x1875064559615232 ext(164626432->165675007) 00002000:00010000:1.0:1788201493.769550:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79500 00000100:00100000:1.0:1788201493.769591:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 199 00000100:00100000:1.0:1788201493.769602:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559615232:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201493.798011:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559615232:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28395us (28810us total) trans 30064771200 rc 0/0 00000100:00100000:1.0:1788201493.798031:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 199 00002000:00100000:1.0:1788201493.798048:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (164626432->165675007) req@ffff962487e79500 x1875064559615232/t30064771200(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:614/0 lens 488/448 e 0 to 0 dl 1788201504 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201493.798086:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79500 with x1875064559615232 ext(164626432->165675007) 00002000:00010000:1.0:1788201493.798094:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79500 00000100:00100000:3.0:1788201493.884967:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201493.886836:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559615360 00000100:00100000:1.0:1788201493.886855:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559615360 00002000:00100000:1.0:1788201493.886946:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (165675008->166723583) req@ffff9624b9d21880 x1875064559615360/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:614/0 lens 488/0 e 0 to 0 dl 1788201504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201493.886961:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d21880 with x1875064559615360 ext(165675008->166723583) 00002000:00010000:1.0:1788201493.886968:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d21880 00000100:00100000:1.0:1788201493.887086:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 200 00000100:00100000:1.0:1788201493.887099:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559615360:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201493.917793:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559615360:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30675us (32823us total) trans 30064771201 rc 0/0 00000100:00100000:1.0:1788201493.917812:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 200 00002000:00100000:1.0:1788201493.917830:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (165675008->166723583) req@ffff9624b9d21880 x1875064559615360/t30064771201(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:614/0 lens 488/448 e 0 to 0 dl 1788201504 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201493.917843:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d21880 with x1875064559615360 ext(165675008->166723583) 00002000:00010000:1.0:1788201493.917852:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d21880 00000100:00100000:0.0:1788201494.032192:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201494.036077:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559615488 00000100:00100000:3.0:1788201494.036102:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559615488 00002000:00100000:3.0:1788201494.036195:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (166723584->167772159) req@ffff962487e79180 x1875064559615488/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:615/0 lens 488/0 e 0 to 0 dl 1788201505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201494.036329:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79180 with x1875064559615488 ext(166723584->167772159) 00002000:00010000:3.0:1788201494.036339:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79180 00000100:00100000:3.0:1788201494.036552:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 201 00000100:00100000:3.0:1788201494.036566:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559615488:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201494.055155:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559615488:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18574us (22960us total) trans 30064771202 rc 0/0 00000100:00100000:3.0:1788201494.055175:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 201 00002000:00100000:3.0:1788201494.055193:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (166723584->167772159) req@ffff962487e79180 x1875064559615488/t30064771202(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:615/0 lens 488/448 e 0 to 0 dl 1788201505 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201494.055206:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79180 with x1875064559615488 ext(166723584->167772159) 00002000:00010000:3.0:1788201494.055334:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79180 00000100:00100000:2.0:1788201494.211052:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201494.211164:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559615616 00000100:00100000:3.0:1788201494.211178:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559615616 00002000:00100000:3.0:1788201494.211527:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (167772160->168820735) req@ffff9624c1c27100 x1875064559615616/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:615/0 lens 488/0 e 0 to 0 dl 1788201505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201494.211543:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c27100 with x1875064559615616 ext(167772160->168820735) 00002000:00010000:3.0:1788201494.211552:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c27100 00000100:00100000:3.0:1788201494.211664:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 202 00000100:00100000:3.0:1788201494.211679:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559615616:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201494.231484:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559615616:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19789us (20550us total) trans 30064771203 rc 0/0 00000100:00100000:3.0:1788201494.231503:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 202 00002000:00100000:3.0:1788201494.231523:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (167772160->168820735) req@ffff9624c1c27100 x1875064559615616/t30064771203(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:615/0 lens 488/448 e 0 to 0 dl 1788201505 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201494.231536:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c27100 with x1875064559615616 ext(167772160->168820735) 00002000:00010000:3.0:1788201494.231564:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c27100 00010000:00010000:0.0:1788201494.327030:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201494.378036:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201494.378201:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559615744 00000100:00100000:1.0:1788201494.378215:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559615744 00002000:00100000:1.0:1788201494.378298:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (168820736->169869311) req@ffff9624c1c25180 x1875064559615744/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:615/0 lens 488/0 e 0 to 0 dl 1788201505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201494.378313:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25180 with x1875064559615744 ext(168820736->169869311) 00002000:00010000:1.0:1788201494.378320:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25180 00000100:00100000:1.0:1788201494.378426:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 203 00000100:00100000:1.0:1788201494.378446:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559615744:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201494.396821:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559615744:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18361us (18786us total) trans 30064771204 rc 0/0 00000100:00100000:2.0:1788201494.396839:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 203 00002000:00100000:2.0:1788201494.396855:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (168820736->169869311) req@ffff9624c1c25180 x1875064559615744/t30064771204(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:615/0 lens 488/448 e 0 to 0 dl 1788201505 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201494.396866:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25180 with x1875064559615744 ext(168820736->169869311) 00002000:00010000:2.0:1788201494.396875:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25180 00000100:00100000:0.0:1788201494.577542:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201494.578145:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559615872 00000100:00100000:1.0:1788201494.578160:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559615872 00002000:00100000:1.0:1788201494.578255:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (169869312->170917887) req@ffff962487e7ad80 x1875064559615872/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:615/0 lens 488/0 e 0 to 0 dl 1788201505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201494.578269:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7ad80 with x1875064559615872 ext(169869312->170917887) 00002000:00010000:1.0:1788201494.578277:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7ad80 00000100:00100000:1.0:1788201494.578322:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 204 00000100:00100000:1.0:1788201494.578334:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559615872:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201494.600217:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559615872:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21869us (22674us total) trans 30064771205 rc 0/0 00000100:00100000:1.0:1788201494.600234:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 204 00002000:00100000:1.0:1788201494.600250:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (169869312->170917887) req@ffff962487e7ad80 x1875064559615872/t30064771205(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:615/0 lens 488/448 e 0 to 0 dl 1788201505 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201494.600264:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7ad80 with x1875064559615872 ext(169869312->170917887) 00002000:00010000:1.0:1788201494.600271:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7ad80 00000100:00100000:0.0:1788201494.745271:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201494.745476:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559616000 00000100:00100000:3.0:1788201494.745490:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559616000 00002000:00100000:3.0:1788201494.745562:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (170917888->171966463) req@ffff9624b9d27b80 x1875064559616000/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:615/0 lens 488/0 e 0 to 0 dl 1788201505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201494.745576:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27b80 with x1875064559616000 ext(170917888->171966463) 00002000:00010000:3.0:1788201494.745584:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27b80 00000100:00100000:3.0:1788201494.745631:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 205 00000100:00100000:3.0:1788201494.745642:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559616000:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201494.762804:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559616000:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15490us (15879us total) trans 30064771206 rc 0/0 00000100:00100000:3.0:1788201494.762830:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 205 00002000:00100000:3.0:1788201494.762851:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (170917888->171966463) req@ffff9624b9d27b80 x1875064559616000/t30064771206(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:615/0 lens 488/448 e 0 to 0 dl 1788201505 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201494.762864:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27b80 with x1875064559616000 ext(170917888->171966463) 00002000:00010000:3.0:1788201494.762871:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27b80 00000100:00100000:0.0:1788201494.929012:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201494.929125:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559616128 00000100:00100000:3.0:1788201494.929137:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559616128 00002000:00100000:3.0:1788201494.929205:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (171966464->173015039) req@ffff9624b9d25880 x1875064559616128/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:615/0 lens 488/0 e 0 to 0 dl 1788201505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201494.929231:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25880 with x1875064559616128 ext(171966464->173015039) 00002000:00010000:3.0:1788201494.929237:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25880 00000100:00100000:3.0:1788201494.929273:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 206 00000100:00100000:3.0:1788201494.929283:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2342:x1875064559616128:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201494.951316:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2342:x1875064559616128:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22005us (22291us total) trans 30064771207 rc 0/0 00000100:00100000:1.0:1788201494.951336:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 206 00002000:00100000:1.0:1788201494.951376:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (171966464->173015039) req@ffff9624b9d25880 x1875064559616128/t30064771207(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:615/0 lens 488/448 e 0 to 0 dl 1788201505 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201494.951389:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25880 with x1875064559616128 ext(171966464->173015039) 00002000:00010000:1.0:1788201494.951417:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25880 00000100:00100000:3.0:1788201495.163247:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201495.163408:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559616256 00000100:00100000:2.0:1788201495.163435:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559616256 00002000:00100000:2.0:1788201495.163548:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (173015040->174063615) req@ffff9624b9d22a00 x1875064559616256/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:616/0 lens 488/0 e 0 to 0 dl 1788201506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201495.163588:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d22a00 with x1875064559616256 ext(173015040->174063615) 00002000:00010000:2.0:1788201495.163606:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d22a00 00000100:00100000:2.0:1788201495.163648:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 207 00000100:00100000:2.0:1788201495.163665:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559616256:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201495.166172:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201495.178165:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559616256:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14486us (14914us total) trans 30064771208 rc 0/0 00000100:00100000:2.0:1788201495.178185:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 207 00002000:00100000:2.0:1788201495.178211:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (173015040->174063615) req@ffff9624b9d22a00 x1875064559616256/t30064771208(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:616/0 lens 488/448 e 0 to 0 dl 1788201506 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201495.178224:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d22a00 with x1875064559616256 ext(173015040->174063615) 00002000:00010000:2.0:1788201495.178232:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d22a00 00000100:00100000:3.0:1788201495.350182:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201495.350315:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559616384 00000100:00100000:1.0:1788201495.350328:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559616384 00002000:00100000:1.0:1788201495.350476:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (174063616->175112191) req@ffff9624b9d21180 x1875064559616384/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:616/0 lens 488/0 e 0 to 0 dl 1788201506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201495.350489:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d21180 with x1875064559616384 ext(174063616->175112191) 00002000:00010000:1.0:1788201495.350496:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d21180 00000100:00100000:1.0:1788201495.350537:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 208 00000100:00100000:1.0:1788201495.350549:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2341:x1875064559616384:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:2.0:1788201495.351273:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201495.366154:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2341:x1875064559616384:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15591us (15971us total) trans 30064771209 rc 0/0 00000100:00100000:1.0:1788201495.366172:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 208 00002000:00100000:1.0:1788201495.366186:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (174063616->175112191) req@ffff9624b9d21180 x1875064559616384/t30064771209(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:616/0 lens 488/448 e 0 to 0 dl 1788201506 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201495.366198:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d21180 with x1875064559616384 ext(174063616->175112191) 00002000:00010000:1.0:1788201495.366207:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d21180 00000100:00100000:3.0:1788201495.612748:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201495.612782:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570133248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201495.612898:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201495.613078:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570133248 00000100:00100000:0.0:1788201495.613089:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570133248 00000100:00100000:0.0:1788201495.613185:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788201495.613197:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570133248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201495.613238:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 118423552 pending 37486592 free 3706716160 avail 3704619008 00000100:00100000:0.0:1788201495.613299:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570133248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201495.613308:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788201495.613337:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570133248:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201495.615087:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201495.644562:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201495.647576:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559616512 00000100:00100000:0.0:1788201495.647593:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559616512 00002000:00100000:0.0:1788201495.647669:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (175112192->176160767) req@ffff9624b9d22300 x1875064559616512/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:616/0 lens 488/0 e 0 to 0 dl 1788201506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201495.647681:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d22300 with x1875064559616512 ext(175112192->176160767) 00002000:00010000:0.0:1788201495.647687:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d22300 00000100:00100000:0.0:1788201495.647722:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 209 00000100:00100000:0.0:1788201495.647733:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559616512:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201495.669297:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559616512:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21553us (24733us total) trans 30064771210 rc 0/0 00000100:00100000:0.0:1788201495.669310:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 209 00002000:00100000:0.0:1788201495.669323:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (175112192->176160767) req@ffff9624b9d22300 x1875064559616512/t30064771210(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:616/0 lens 488/448 e 0 to 0 dl 1788201506 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201495.669334:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d22300 with x1875064559616512 ext(175112192->176160767) 00002000:00010000:0.0:1788201495.669390:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d22300 00000100:00100000:3.0:1788201495.837915:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201495.839572:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559616640 00000100:00100000:1.0:1788201495.839586:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559616640 00002000:00100000:1.0:1788201495.839654:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (176160768->177209343) req@ffff9624b9d21500 x1875064559616640/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:616/0 lens 488/0 e 0 to 0 dl 1788201506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201495.839667:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d21500 with x1875064559616640 ext(176160768->177209343) 00002000:00010000:1.0:1788201495.839672:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d21500 00000100:00100000:1.0:1788201495.839713:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 210 00000100:00100000:1.0:1788201495.839723:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559616640:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201495.866855:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201495.866899:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201495.867028:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559616768 00000100:00100000:3.0:1788201495.867038:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559616768 00002000:00100000:3.0:1788201495.867088:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (154144768->155189247) req@ffff9624b9d25180 x1875064559616768/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:616/0 lens 488/0 e 0 to 0 dl 1788201506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201495.867099:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25180 with x1875064559616768 ext(154144768->155189247) 00002000:00010000:3.0:1788201495.867105:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25180 00000100:00100000:3.0:1788201495.867134:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559616896 00000100:00100000:3.0:1788201495.867137:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559616896 00002000:00100000:3.0:1788201495.867152:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (177209344->177270783) req@ffff9624b9d24700 x1875064559616896/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:616/0 lens 488/0 e 0 to 0 dl 1788201506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201495.867161:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24700 with x1875064559616896 ext(177209344->177270783) 00002000:00010000:3.0:1788201495.867164:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24700 00000100:00100000:3.0:1788201495.867187:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 211 00000100:00100000:3.0:1788201495.867205:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+53:2344:x1875064559616768:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201495.868188:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+55:2343:x1875064559616640:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28460us (30280us total) trans 30064771211 rc 0/0 00000100:00100000:1.0:1788201495.868198:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 210 00002000:00100000:1.0:1788201495.868207:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (176160768->177209343) req@ffff9624b9d21500 x1875064559616640/t30064771211(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:616/0 lens 488/448 e 0 to 0 dl 1788201506 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201495.868218:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d21500 with x1875064559616640 ext(176160768->177209343) 00002000:00010000:1.0:1788201495.868222:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d21500 00000100:00100000:1.0:1788201495.868244:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 212 00000100:00100000:1.0:1788201495.868252:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559616896:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201495.897982:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559616896:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29716us (31068us total) trans 30064771212 rc 0/0 00000100:00100000:1.0:1788201495.897999:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 212 00002000:00100000:1.0:1788201495.898029:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (177209344->177270783) req@ffff9624b9d24700 x1875064559616896/t30064771212(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:616/0 lens 488/448 e 0 to 0 dl 1788201506 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201495.898041:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24700 with x1875064559616896 ext(177209344->177270783) 00002000:00010000:1.0:1788201495.898048:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24700 00000100:00100000:1.0:1788201495.907557:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559616768:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 40348us (40699us total) trans 30064771213 rc 0/0 00000100:00100000:1.0:1788201495.907574:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 211 00002000:00100000:1.0:1788201495.907589:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (154144768->155189247) req@ffff9624b9d25180 x1875064559616768/t30064771213(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:616/0 lens 488/448 e 0 to 0 dl 1788201506 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201495.907600:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25180 with x1875064559616768 ext(154144768->155189247) 00002000:00010000:1.0:1788201495.907625:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25180 00000001:00080000:3.0:1788201496.301743:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771210 is committed 00000001:00080000:3.0:1788201496.301764:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771213 is committed 00010000:00010000:1.0:1788201496.374646:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201496.399831:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201496.399938:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559617024 00000100:00100000:2.0:1788201496.400026:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559617024 00002000:00100000:2.0:1788201496.400085:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (178257920->179306495) req@ffff9624b9d26300 x1875064559617024/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:617/0 lens 488/0 e 0 to 0 dl 1788201507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201496.400322:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26300 with x1875064559617024 ext(178257920->179306495) 00002000:00010000:2.0:1788201496.400328:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26300 00000100:00100000:2.0:1788201496.400441:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 213 00000100:00100000:2.0:1788201496.400452:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559617024:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201496.430567:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559617024:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30100us (30731us total) trans 30064771214 rc 0/0 00000100:00100000:2.0:1788201496.430606:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 213 00002000:00100000:2.0:1788201496.430624:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (178257920->179306495) req@ffff9624b9d26300 x1875064559617024/t30064771214(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:617/0 lens 488/448 e 0 to 0 dl 1788201507 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201496.430637:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26300 with x1875064559617024 ext(178257920->179306495) 00002000:00010000:2.0:1788201496.430645:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26300 00000100:00100000:3.0:1788201496.609609:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201496.610196:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559617152 00000100:00100000:1.0:1788201496.610206:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559617152 00002000:00100000:1.0:1788201496.610273:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (179306496->180355071) req@ffff9624b9d20380 x1875064559617152/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:617/0 lens 488/0 e 0 to 0 dl 1788201507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201496.610285:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d20380 with x1875064559617152 ext(179306496->180355071) 00002000:00010000:1.0:1788201496.610291:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d20380 00000100:00100000:1.0:1788201496.610330:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 214 00000100:00100000:1.0:1788201496.610375:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559617152:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201496.632913:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559617152:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22561us (23303us total) trans 30064771215 rc 0/0 00000100:00100000:1.0:1788201496.632928:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 214 00002000:00100000:1.0:1788201496.632941:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (179306496->180355071) req@ffff9624b9d20380 x1875064559617152/t30064771215(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:617/0 lens 488/448 e 0 to 0 dl 1788201507 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201496.632952:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d20380 with x1875064559617152 ext(179306496->180355071) 00002000:00010000:1.0:1788201496.632959:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d20380 00000100:00100000:0.0:1788201496.825065:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201496.825428:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559617280 00000100:00100000:3.0:1788201496.825448:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559617280 00002000:00100000:3.0:1788201496.825520:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (180355072->181403647) req@ffff9624b9d25500 x1875064559617280/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:617/0 lens 488/0 e 0 to 0 dl 1788201507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201496.825532:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25500 with x1875064559617280 ext(180355072->181403647) 00002000:00010000:3.0:1788201496.825538:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25500 00000100:00100000:3.0:1788201496.825580:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 215 00000100:00100000:3.0:1788201496.825590:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559617280:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201496.838586:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559617280:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12982us (13524us total) trans 30064771216 rc 0/0 00000100:00100000:1.0:1788201496.838602:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 215 00002000:00100000:1.0:1788201496.838619:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (180355072->181403647) req@ffff9624b9d25500 x1875064559617280/t30064771216(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:617/0 lens 488/448 e 0 to 0 dl 1788201507 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201496.838630:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25500 with x1875064559617280 ext(180355072->181403647) 00002000:00010000:1.0:1788201496.838637:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25500 00000100:00100000:0.0:1788201497.107794:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201497.107875:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559617408 00000100:00100000:3.0:1788201497.107883:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559617408 00002000:00100000:3.0:1788201497.107931:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (181403648->182452223) req@ffff9624b9d24380 x1875064559617408/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:618/0 lens 488/0 e 0 to 0 dl 1788201508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201497.107939:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24380 with x1875064559617408 ext(181403648->182452223) 00002000:00010000:3.0:1788201497.107944:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24380 00000100:00100000:3.0:1788201497.107969:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 216 00000100:00100000:3.0:1788201497.107977:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559617408:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201497.108017:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201497.120048:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559617408:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12060us (12249us total) trans 30064771217 rc 0/0 00000100:00100000:1.0:1788201497.120064:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 216 00002000:00100000:1.0:1788201497.120078:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (181403648->182452223) req@ffff9624b9d24380 x1875064559617408/t30064771217(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:618/0 lens 488/448 e 0 to 0 dl 1788201508 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201497.120088:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24380 with x1875064559617408 ext(181403648->182452223) 00002000:00010000:1.0:1788201497.120095:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24380 00000100:00100000:0.0:1788201497.286123:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201497.288991:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559617536 00000100:00100000:2.0:1788201497.289006:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559617536 00002000:00100000:2.0:1788201497.289068:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (182452224->183500799) req@ffff9624b9d25f80 x1875064559617536/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:618/0 lens 488/0 e 0 to 0 dl 1788201508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201497.289080:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25f80 with x1875064559617536 ext(182452224->183500799) 00002000:00010000:2.0:1788201497.289085:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25f80 00000100:00100000:1.0:1788201497.289999:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 217 00000100:00100000:1.0:1788201497.290015:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559617536:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201497.327398:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559617536:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37368us (41263us total) trans 30064771218 rc 0/0 00000100:00100000:1.0:1788201497.327420:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 217 00002000:00100000:1.0:1788201497.327435:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (182452224->183500799) req@ffff9624b9d25f80 x1875064559617536/t30064771218(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:618/0 lens 488/448 e 0 to 0 dl 1788201508 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201497.327446:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25f80 with x1875064559617536 ext(182452224->183500799) 00002000:00010000:1.0:1788201497.327451:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25f80 00010000:00010000:0.0:1788201497.399160:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201497.401337:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201497.401615:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559617664 00000100:00100000:1.0:1788201497.401627:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559617664 00000100:00100000:1.0:1788201497.401688:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 514 00000100:00100000:1.0:1788201497.401699:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559617664:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201497.401777:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559617664:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 78us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.401786:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 514 00000100:00100000:3.0:1788201497.410840:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201497.410892:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201497.411230:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559617920 00000100:00100000:2.0:1788201497.411240:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559617920 00000100:00080000:3.0:1788201497.411314:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201497.411320:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 216 00000100:00100000:2.0:1788201497.411332:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559617920:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201497.411462:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2341:x1875064559617920:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 132us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.411469:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 216 00000100:00100000:0.0:1788201497.412269:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559617792 00000100:00100000:0.0:1788201497.412278:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559617792 00000100:00080000:3.0:1788201497.412644:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201497.413418:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 343 00000100:00100000:2.0:1788201497.413435:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559617792:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201497.413517:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559617792:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 90us (2688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.413524:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 343 00000100:00100000:3.0:1788201497.501193:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201497.501780:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559618048 00000100:00100000:1.0:1788201497.501802:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559618048 00002000:00100000:1.0:1788201497.501853:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (183500800->184549375) req@ffff9624b9d23800 x1875064559618048/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:618/0 lens 488/0 e 0 to 0 dl 1788201508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201497.501865:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d23800 with x1875064559618048 ext(183500800->184549375) 00002000:00010000:1.0:1788201497.501871:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d23800 00000100:00100000:1.0:1788201497.501908:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 218 00000100:00100000:1.0:1788201497.501917:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559618048:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201497.532566:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559618048:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30639us (31372us total) trans 30064771219 rc 0/0 00000100:00100000:2.0:1788201497.533244:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 218 00002000:00100000:2.0:1788201497.533259:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (183500800->184549375) req@ffff9624b9d23800 x1875064559618048/t30064771219(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:618/0 lens 488/448 e 0 to 0 dl 1788201508 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201497.533271:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d23800 with x1875064559618048 ext(183500800->184549375) 00002000:00010000:2.0:1788201497.533277:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d23800 00000100:00100000:3.0:1788201497.663588:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201497.663743:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559618176 00000100:00100000:2.0:1788201497.663753:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559618176 00002000:00100000:2.0:1788201497.663804:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (184549376->185597951) req@ffff9624b9d20000 x1875064559618176/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:618/0 lens 488/0 e 0 to 0 dl 1788201508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201497.663816:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d20000 with x1875064559618176 ext(184549376->185597951) 00002000:00010000:2.0:1788201497.663822:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d20000 00000100:00100000:2.0:1788201497.663858:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 219 00000100:00100000:2.0:1788201497.663879:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559618176:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201497.719708:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559618176:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 55820us (56119us total) trans 30064771220 rc 0/0 00000100:00100000:2.0:1788201497.719722:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 219 00002000:00100000:2.0:1788201497.719733:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (184549376->185597951) req@ffff9624b9d20000 x1875064559618176/t30064771220(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:618/0 lens 488/448 e 0 to 0 dl 1788201508 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201497.719743:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d20000 with x1875064559618176 ext(184549376->185597951) 00002000:00010000:2.0:1788201497.719749:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d20000 00000100:00100000:0.0:1788201497.826617:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201497.826717:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559618304 00000100:00100000:3.0:1788201497.826728:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559618304 00002000:00100000:3.0:1788201497.826780:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (185597952->186646527) req@ffff9624b9d27480 x1875064559618304/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:618/0 lens 488/0 e 0 to 0 dl 1788201508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201497.826807:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27480 with x1875064559618304 ext(185597952->186646527) 00002000:00010000:3.0:1788201497.826813:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27480 00000100:00100000:3.0:1788201497.826853:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 220 00000100:00100000:3.0:1788201497.826864:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559618304:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201497.863553:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559618304:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36679us (36933us total) trans 30064771221 rc 0/0 00000100:00100000:1.0:1788201497.863568:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 220 00002000:00100000:1.0:1788201497.863584:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (185597952->186646527) req@ffff9624b9d27480 x1875064559618304/t30064771221(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:618/0 lens 488/448 e 0 to 0 dl 1788201508 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201497.863594:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27480 with x1875064559618304 ext(185597952->186646527) 00002000:00010000:1.0:1788201497.863600:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27480 00000100:00100000:0.0:1788201498.074179:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201498.074272:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559618432 00000100:00100000:1.0:1788201498.074282:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559618432 00002000:00100000:1.0:1788201498.074333:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (186646528->187695103) req@ffff9624b9d27800 x1875064559618432/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:619/0 lens 488/0 e 0 to 0 dl 1788201509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201498.074381:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27800 with x1875064559618432 ext(186646528->187695103) 00002000:00010000:1.0:1788201498.074387:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27800 00000100:00100000:1.0:1788201498.074424:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 221 00000100:00100000:1.0:1788201498.074435:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559618432:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201498.106980:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559618432:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32536us (32800us total) trans 30064771222 rc 0/0 00000100:00100000:1.0:1788201498.107009:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 221 00002000:00100000:1.0:1788201498.107022:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (186646528->187695103) req@ffff9624b9d27800 x1875064559618432/t30064771222(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:619/0 lens 488/448 e 0 to 0 dl 1788201509 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201498.107033:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27800 with x1875064559618432 ext(186646528->187695103) 00002000:00010000:1.0:1788201498.107040:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27800 00000100:00100000:3.0:1788201498.171698:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570133376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201498.171775:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201498.171917:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570133376 00000100:00100000:0.0:1788201498.171925:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570133376 00000100:00100000:0.0:1788201498.171995:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788201498.172006:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570133376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201498.172042:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788201498.172122:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201498.184109:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570133376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12095us (12323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201498.184135:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:3.0:1788201498.187591:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1c24700 x1875064570133376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201498.187620:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570133376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201498.333552:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201498.333670:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559618560 00000100:00100000:2.0:1788201498.333680:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559618560 00002000:00100000:2.0:1788201498.333753:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (187695104->188743679) req@ffff9624b9d22680 x1875064559618560/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:619/0 lens 488/0 e 0 to 0 dl 1788201509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201498.333764:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d22680 with x1875064559618560 ext(187695104->188743679) 00002000:00010000:2.0:1788201498.333771:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d22680 00000100:00100000:2.0:1788201498.333805:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 222 00000100:00100000:2.0:1788201498.333815:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559618560:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201498.359945:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559618560:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26116us (26393us total) trans 30064771223 rc 0/0 00000100:00100000:2.0:1788201498.359961:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 222 00002000:00100000:2.0:1788201498.359974:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (187695104->188743679) req@ffff9624b9d22680 x1875064559618560/t30064771223(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:619/0 lens 488/448 e 0 to 0 dl 1788201509 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201498.359987:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d22680 with x1875064559618560 ext(187695104->188743679) 00002000:00010000:2.0:1788201498.359994:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d22680 00010000:00010000:2.0:1788201498.422795:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201498.626502:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201498.626859:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559618688 00000100:00100000:2.0:1788201498.626870:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559618688 00002000:00100000:2.0:1788201498.626929:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (188743680->189792255) req@ffff9624b9d6a680 x1875064559618688/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:619/0 lens 488/0 e 0 to 0 dl 1788201509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201498.626940:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6a680 with x1875064559618688 ext(188743680->189792255) 00002000:00010000:2.0:1788201498.626946:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6a680 00000100:00100000:2.0:1788201498.626979:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 223 00000100:00100000:2.0:1788201498.626989:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559618688:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201498.670907:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559618688:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 43902us (44400us total) trans 30064771224 rc 0/0 00000100:00100000:3.0:1788201498.670924:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 223 00002000:00100000:3.0:1788201498.670941:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (188743680->189792255) req@ffff9624b9d6a680 x1875064559618688/t30064771224(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:619/0 lens 488/448 e 0 to 0 dl 1788201509 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201498.670954:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6a680 with x1875064559618688 ext(188743680->189792255) 00002000:00010000:3.0:1788201498.670962:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6a680 00000100:00100000:2.0:1788201498.678894:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201498.678928:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570133504:0@lo:400:kworker.0 00000100:00100000:2.0:1788201498.679073:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201498.679485:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570133504 00000100:00100000:3.0:1788201498.679497:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570133504 00000100:00100000:3.0:1788201498.679569:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1788201498.679583:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570133504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201498.679666:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570133504:12345-0@lo:400:kworker.0 Request processed in 86us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201498.679688:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1788201498.679759:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570133504:0@lo:400:kworker.0 00000100:00100000:0.0:1788201498.679940:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570133760:0@lo:400:kworker.0 00000100:00100000:0.0:1788201498.679982:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201498.680010:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201498.680017:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570133888:0@lo:400:kworker.0 00000100:00100000:0.0:1788201498.680047:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201498.680383:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570133632:0@lo:400:kworker.0 00000100:00100000:3.0:1788201498.680415:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201498.680438:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201498.680445:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570134016:0@lo:400:kworker.0 00000100:00100000:3.0:1788201498.680468:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201498.680500:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570133888 00000100:00100000:3.0:1788201498.680505:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570133888 00000100:00100000:3.0:1788201498.680556:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570133632 00000100:00100000:3.0:1788201498.680559:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570133632 00000100:00100000:3.0:1788201498.680574:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570134016 00000100:00100000:3.0:1788201498.680577:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570134016 00000100:00100000:3.0:1788201498.680593:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788201498.680600:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570133888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201498.680646:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570133888:12345-0@lo:400:kworker.0 Request processed in 47us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201498.680652:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788201498.680668:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788201498.680674:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570133632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201498.680707:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570133632:12345-0@lo:400:kworker.0 Request processed in 34us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201498.680714:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788201498.680725:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788201498.680731:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570134016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201498.680777:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570134016:12345-0@lo:400:kworker.0 Request processed in 46us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201498.680783:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788201498.680820:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570133888:0@lo:400:kworker.0 00000100:00080000:3.0:1788201498.680857:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201498.680886:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570134016:0@lo:400:kworker.0 00000100:00100000:3.0:1788201498.680895:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570133632:0@lo:400:kworker.0 00000100:00100000:0.0:1788201498.682371:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570133760 00000100:00100000:0.0:1788201498.682388:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570133760 00000100:00100000:0.0:1788201498.682487:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788201498.682500:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570133760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201498.682621:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570133760:12345-0@lo:400:kworker.0 Request processed in 124us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201498.682628:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788201498.683003:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570133760:0@lo:400:kworker.0 00000100:00080000:3.0:1788201498.683007:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201498.887453:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201498.888304:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559618816 00000100:00100000:1.0:1788201498.888319:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559618816 00002000:00100000:1.0:1788201498.888428:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (189792256->190840831) req@ffff9624c1c26300 x1875064559618816/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:619/0 lens 488/0 e 0 to 0 dl 1788201509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201498.888441:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c26300 with x1875064559618816 ext(189792256->190840831) 00002000:00010000:1.0:1788201498.888447:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c26300 00000100:00100000:1.0:1788201498.888487:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 224 00000100:00100000:1.0:1788201498.888500:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559618816:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201498.911632:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559618816:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23118us (24180us total) trans 30064771225 rc 0/0 00000100:00100000:1.0:1788201498.911649:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 224 00002000:00100000:1.0:1788201498.911667:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (189792256->190840831) req@ffff9624c1c26300 x1875064559618816/t30064771225(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:619/0 lens 488/448 e 0 to 0 dl 1788201509 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201498.911678:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c26300 with x1875064559618816 ext(189792256->190840831) 00002000:00010000:1.0:1788201498.911704:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c26300 00000100:00100000:0.0:1788201499.099241:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201499.099400:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559618944 00000100:00100000:1.0:1788201499.099417:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559618944 00002000:00100000:1.0:1788201499.099526:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (190840832->191889407) req@ffff9624b9d26680 x1875064559618944/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:620/0 lens 488/0 e 0 to 0 dl 1788201510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201499.099540:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26680 with x1875064559618944 ext(190840832->191889407) 00002000:00010000:1.0:1788201499.099547:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26680 00000100:00100000:1.0:1788201499.099596:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 225 00000100:00100000:1.0:1788201499.099609:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559618944:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201499.101407:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201499.127734:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559618944:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28110us (28486us total) trans 30064771226 rc 0/0 00000100:00100000:1.0:1788201499.127753:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 225 00002000:00100000:1.0:1788201499.127771:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (190840832->191889407) req@ffff9624b9d26680 x1875064559618944/t30064771226(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:620/0 lens 488/448 e 0 to 0 dl 1788201510 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201499.127784:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26680 with x1875064559618944 ext(190840832->191889407) 00002000:00010000:1.0:1788201499.127792:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26680 00000100:00100000:0.0:1788201499.349821:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201499.349962:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559619072 00000100:00100000:2.0:1788201499.349976:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559619072 00002000:00100000:2.0:1788201499.350064:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (191889408->192937983) req@ffff9624b9d24e00 x1875064559619072/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:620/0 lens 488/0 e 0 to 0 dl 1788201510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201499.350078:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24e00 with x1875064559619072 ext(191889408->192937983) 00002000:00010000:2.0:1788201499.350089:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24e00 00000100:00100000:2.0:1788201499.350142:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 226 00000100:00100000:2.0:1788201499.350153:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559619072:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201499.398063:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559619072:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 47894us (48241us total) trans 30064771227 rc 0/0 00000100:00100000:2.0:1788201499.398080:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 226 00002000:00100000:2.0:1788201499.398097:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (191889408->192937983) req@ffff9624b9d24e00 x1875064559619072/t30064771227(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:620/0 lens 488/448 e 0 to 0 dl 1788201510 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201499.398108:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24e00 with x1875064559619072 ext(191889408->192937983) 00002000:00010000:2.0:1788201499.398115:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24e00 00010000:00010000:1.0:1788201499.448630:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201499.672784:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201499.672894:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559619200 00000100:00100000:2.0:1788201499.672913:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559619200 00002000:00100000:2.0:1788201499.672963:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (192937984->193986559) req@ffff9624b9d25c00 x1875064559619200/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:620/0 lens 488/0 e 0 to 0 dl 1788201510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201499.672974:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25c00 with x1875064559619200 ext(192937984->193986559) 00002000:00010000:2.0:1788201499.672980:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25c00 00000100:00100000:2.0:1788201499.673014:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 227 00000100:00100000:2.0:1788201499.673039:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559619200:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201499.696550:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559619200:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23499us (23763us total) trans 30064771228 rc 0/0 00000100:00100000:2.0:1788201499.696565:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 227 00002000:00100000:2.0:1788201499.696579:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (192937984->193986559) req@ffff9624b9d25c00 x1875064559619200/t30064771228(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:620/0 lens 488/448 e 0 to 0 dl 1788201510 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201499.696589:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25c00 with x1875064559619200 ext(192937984->193986559) 00002000:00010000:2.0:1788201499.696595:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25c00 00000100:00100000:3.0:1788201500.028178:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201500.029036:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559619328 00000100:00100000:1.0:1788201500.029140:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559619328 00002000:00100000:1.0:1788201500.029276:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (193986560->195035135) req@ffff9624bfd98e00 x1875064559619328/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:621/0 lens 488/0 e 0 to 0 dl 1788201511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201500.029288:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98e00 with x1875064559619328 ext(193986560->195035135) 00002000:00010000:1.0:1788201500.029295:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98e00 00000100:00100000:1.0:1788201500.029407:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 228 00000100:00100000:1.0:1788201500.029418:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559619328:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201500.041495:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559619328:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12068us (13314us total) trans 30064771229 rc 0/0 00000100:00100000:1.0:1788201500.041510:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 228 00002000:00100000:1.0:1788201500.041522:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (193986560->195035135) req@ffff9624bfd98e00 x1875064559619328/t30064771229(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:621/0 lens 488/448 e 0 to 0 dl 1788201511 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201500.041533:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98e00 with x1875064559619328 ext(193986560->195035135) 00002000:00010000:1.0:1788201500.041539:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98e00 00000100:00100000:3.0:1788201500.332715:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201500.332830:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559619456 00000100:00100000:1.0:1788201500.332841:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559619456 00002000:00100000:1.0:1788201500.332894:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (195035136->196083711) req@ffff9624bfd9a680 x1875064559619456/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:621/0 lens 488/0 e 0 to 0 dl 1788201511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201500.332906:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9a680 with x1875064559619456 ext(195035136->196083711) 00002000:00010000:1.0:1788201500.332913:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9a680 00000100:00100000:1.0:1788201500.332954:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 229 00000100:00100000:1.0:1788201500.332965:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559619456:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201500.348565:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559619456:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15589us (15849us total) trans 30064771230 rc 0/0 00000100:00100000:1.0:1788201500.348580:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 229 00002000:00100000:1.0:1788201500.348595:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (195035136->196083711) req@ffff9624bfd9a680 x1875064559619456/t30064771230(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:621/0 lens 488/448 e 0 to 0 dl 1788201511 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201500.348606:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9a680 with x1875064559619456 ext(195035136->196083711) 00002000:00010000:1.0:1788201500.348613:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9a680 00010000:00010000:0.0:1788201500.470773:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201500.631876:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201500.635649:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559619584 00000100:00100000:2.0:1788201500.635672:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559619584 00002000:00100000:2.0:1788201500.635775:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (196083712->197132287) req@ffff9624b9d26d80 x1875064559619584/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:621/0 lens 488/0 e 0 to 0 dl 1788201511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201500.635788:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26d80 with x1875064559619584 ext(196083712->197132287) 00002000:00010000:2.0:1788201500.635796:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26d80 00000100:00100000:2.0:1788201500.635847:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 230 00000100:00100000:2.0:1788201500.635860:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559619584:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201500.682628:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559619584:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 46754us (50754us total) trans 30064771231 rc 0/0 00000100:00100000:2.0:1788201500.682646:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 230 00002000:00100000:2.0:1788201500.682662:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (196083712->197132287) req@ffff9624b9d26d80 x1875064559619584/t30064771231(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:621/0 lens 488/448 e 0 to 0 dl 1788201511 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201500.682676:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26d80 with x1875064559619584 ext(196083712->197132287) 00002000:00010000:2.0:1788201500.682684:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26d80 00000100:00100000:3.0:1788201500.727921:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570134144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201500.728024:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201500.728141:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570134144 00000100:00100000:0.0:1788201500.728152:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570134144 00000100:00100000:0.0:1788201500.728230:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788201500.728242:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570134144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201500.728273:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 149094400 pending 30670848 free 3681550336 avail 3679453184 00000100:00100000:0.0:1788201500.728362:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570134144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201500.728371:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1788201500.728398:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201500.736580:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570134144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201501.050463:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201501.050647:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559619712 00000100:00100000:2.0:1788201501.050660:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559619712 00002000:00100000:2.0:1788201501.050746:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (197132288->198180863) req@ffff9624b9d26a00 x1875064559619712/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:622/0 lens 488/0 e 0 to 0 dl 1788201512 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201501.050759:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26a00 with x1875064559619712 ext(197132288->198180863) 00002000:00010000:2.0:1788201501.050767:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26a00 00000100:00100000:2.0:1788201501.050820:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 231 00000100:00100000:2.0:1788201501.050833:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559619712:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201501.051808:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201501.088472:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559619712:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37621us (38004us total) trans 30064771232 rc 0/0 00000100:00100000:2.0:1788201501.088493:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 231 00002000:00100000:2.0:1788201501.088512:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (197132288->198180863) req@ffff9624b9d26a00 x1875064559619712/t30064771232(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:622/0 lens 488/448 e 0 to 0 dl 1788201512 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201501.088525:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26a00 with x1875064559619712 ext(197132288->198180863) 00002000:00010000:2.0:1788201501.088533:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26a00 00000100:00100000:2.0:1788201501.297601:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201501.297673:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559619840 00000100:00100000:2.0:1788201501.297687:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559619840 00002000:00100000:2.0:1788201501.297770:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (198180864->199229439) req@ffff9624c1c25500 x1875064559619840/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:622/0 lens 488/0 e 0 to 0 dl 1788201512 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201501.297783:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25500 with x1875064559619840 ext(198180864->199229439) 00002000:00010000:2.0:1788201501.297790:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25500 00000100:00100000:2.0:1788201501.298211:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 232 00000100:00100000:2.0:1788201501.298233:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2341:x1875064559619840:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201501.334552:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2341:x1875064559619840:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36306us (36952us total) trans 30064771233 rc 0/0 00000100:00100000:2.0:1788201501.334571:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 232 00002000:00100000:2.0:1788201501.334589:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (198180864->199229439) req@ffff9624c1c25500 x1875064559619840/t30064771233(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:622/0 lens 488/448 e 0 to 0 dl 1788201512 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201501.334600:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25500 with x1875064559619840 ext(198180864->199229439) 00002000:00010000:2.0:1788201501.334608:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25500 00000001:00080000:1.0:1788201501.399268:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771230 is committed 00000001:00080000:1.0:1788201501.399400:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771232 is committed 00010000:00010000:2.0:1788201501.502183:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201501.519973:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201501.520123:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559619968 00000100:00100000:1.0:1788201501.520138:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559619968 00002000:00100000:1.0:1788201501.520212:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (199229440->200278015) req@ffff9624b9d24000 x1875064559619968/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:622/0 lens 488/0 e 0 to 0 dl 1788201512 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201501.520225:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24000 with x1875064559619968 ext(199229440->200278015) 00002000:00010000:1.0:1788201501.520233:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24000 00000100:00100000:1.0:1788201501.520404:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 233 00000100:00100000:1.0:1788201501.520418:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559619968:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201501.565411:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559619968:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 44980us (45438us total) trans 30064771234 rc 0/0 00000100:00100000:2.0:1788201501.565431:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 233 00002000:00100000:2.0:1788201501.565449:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (199229440->200278015) req@ffff9624b9d24000 x1875064559619968/t30064771234(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:622/0 lens 488/448 e 0 to 0 dl 1788201512 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201501.565462:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24000 with x1875064559619968 ext(199229440->200278015) 00002000:00010000:2.0:1788201501.565470:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24000 00000100:00100000:0.0:1788201501.832460:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201501.832627:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559620096 00000100:00100000:2.0:1788201501.832638:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559620096 00002000:00100000:2.0:1788201501.832689:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (200278016->201326591) req@ffff9624bfd9e680 x1875064559620096/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:622/0 lens 488/0 e 0 to 0 dl 1788201512 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201501.832701:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9e680 with x1875064559620096 ext(200278016->201326591) 00002000:00010000:2.0:1788201501.832707:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9e680 00000100:00100000:2.0:1788201501.832744:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 234 00000100:00100000:2.0:1788201501.832755:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559620096:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201501.891630:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2341:x1875064559620096:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 58522us (58825us total) trans 30064771235 rc 0/0 00000100:00100000:2.0:1788201501.891645:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 234 00002000:00100000:2.0:1788201501.891666:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (200278016->201326591) req@ffff9624bfd9e680 x1875064559620096/t30064771235(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:622/0 lens 488/448 e 0 to 0 dl 1788201512 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201501.891678:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9e680 with x1875064559620096 ext(200278016->201326591) 00002000:00010000:2.0:1788201501.891684:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9e680 00000100:00100000:0.0:1788201502.187791:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201502.187993:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559620224 00000100:00100000:2.0:1788201502.188003:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559620224 00002000:00100000:2.0:1788201502.188054:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (201326592->202375167) req@ffff9624bfd9ed80 x1875064559620224/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:623/0 lens 488/0 e 0 to 0 dl 1788201513 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201502.188066:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ed80 with x1875064559620224 ext(201326592->202375167) 00002000:00010000:2.0:1788201502.188071:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ed80 00000100:00100000:2.0:1788201502.188115:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 235 00000100:00100000:2.0:1788201502.188125:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559620224:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201502.212690:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559620224:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24557us (24909us total) trans 30064771236 rc 0/0 00000100:00100000:2.0:1788201502.212704:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 235 00002000:00100000:2.0:1788201502.212716:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (201326592->202375167) req@ffff9624bfd9ed80 x1875064559620224/t30064771236(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:623/0 lens 488/448 e 0 to 0 dl 1788201513 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201502.212727:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ed80 with x1875064559620224 ext(201326592->202375167) 00002000:00010000:2.0:1788201502.212733:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ed80 00000100:00100000:1.0:1788201502.489916:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201502.490003:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559620352 00000100:00100000:0.0:1788201502.490013:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559620352 00002000:00100000:0.0:1788201502.490139:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (202375168->203423743) req@ffff9624b9d6ad80 x1875064559620352/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:623/0 lens 488/0 e 0 to 0 dl 1788201513 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201502.490151:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6ad80 with x1875064559620352 ext(202375168->203423743) 00002000:00010000:0.0:1788201502.490157:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6ad80 00000100:00100000:0.0:1788201502.490193:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 236 00000100:00100000:0.0:1788201502.490204:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2341:x1875064559620352:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:1.0:1788201502.518935:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201502.531515:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559620352:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 41300us (41596us total) trans 30064771237 rc 0/0 00000100:00100000:0.0:1788201502.531529:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 236 00002000:00100000:0.0:1788201502.531544:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (202375168->203423743) req@ffff9624b9d6ad80 x1875064559620352/t30064771237(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:623/0 lens 488/448 e 0 to 0 dl 1788201513 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201502.531556:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6ad80 with x1875064559620352 ext(202375168->203423743) 00002000:00010000:0.0:1788201502.531562:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6ad80 00000100:00100000:2.0:1788201502.531848:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201502.532116:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559620736 00000100:00100000:0.0:1788201502.532124:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559620736 00000100:00100000:0.0:1788201502.532180:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 160 00000100:00100000:0.0:1788201502.532190:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+5:2340:x1875064559620736:12345-192.168.201.56@tcp:9:kworker.0 00000020:00000080:0.0:1788201502.532216:0:6671:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa81c4c9a2f3cb729 00000100:00080000:0.0:1788201502.532225:0:6671:0:(import.c:65:import_set_state_nolock()) ffff96248591e000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788201502.532252:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:0.0:1788201502.532266:0:6671:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788201502.532314:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201502.542623:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201502.542737:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201502.542798:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559620480 00000100:00100000:1.0:1788201502.542811:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559620480 00000100:00100000:1.0:1788201502.542885:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 516 00000100:00100000:1.0:1788201502.542897:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559620480:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201502.542994:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559620480:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 98us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201502.543002:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 516 00000100:00100000:3.0:1788201502.544115:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559620608 00000100:00100000:3.0:1788201502.544125:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559620608 00000100:00100000:3.0:1788201502.544204:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 347 00000100:00100000:3.0:1788201502.544215:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559620608:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201502.544279:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559620608:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 68us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201502.544287:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 347 00000100:00080000:1.0:1788201502.544475:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201502.545358:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+2:2340:x1875064559620736:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 13138us (13480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201502.545375:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 160 00000100:00100000:1.0:1788201502.874166:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201502.877583:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559620864 00000100:00100000:0.0:1788201502.877597:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559620864 00002000:00100000:0.0:1788201502.877655:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (203423744->204472319) req@ffff9624c1e52d80 x1875064559620864/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:623/0 lens 488/0 e 0 to 0 dl 1788201513 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201502.877666:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e52d80 with x1875064559620864 ext(203423744->204472319) 00002000:00010000:0.0:1788201502.877671:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e52d80 00000100:00100000:0.0:1788201502.877711:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 237 00000100:00100000:0.0:1788201502.877722:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559620864:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201502.901642:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559620864:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23910us (27480us total) trans 30064771238 rc 0/0 00000100:00100000:2.0:1788201502.901657:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 237 00002000:00100000:2.0:1788201502.901671:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (203423744->204472319) req@ffff9624c1e52d80 x1875064559620864/t30064771238(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:623/0 lens 488/448 e 0 to 0 dl 1788201513 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201502.901682:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e52d80 with x1875064559620864 ext(203423744->204472319) 00002000:00010000:2.0:1788201502.901688:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e52d80 00000100:00100000:0.0:1788201503.017331:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201503.017512:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559620992 00000100:00100000:2.0:1788201503.017523:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559620992 00002000:00100000:2.0:1788201503.017644:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (204472320->205520895) req@ffff9624bfd9dc00 x1875064559620992/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:624/0 lens 488/0 e 0 to 0 dl 1788201514 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201503.017657:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9dc00 with x1875064559620992 ext(204472320->205520895) 00002000:00010000:2.0:1788201503.017663:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9dc00 00000100:00100000:2.0:1788201503.017702:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 238 00000100:00100000:2.0:1788201503.017713:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559620992:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201503.030748:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201503.040025:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559620992:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22299us (22691us total) trans 30064771239 rc 0/0 00000100:00100000:3.0:1788201503.040042:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 238 00002000:00100000:3.0:1788201503.040057:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (204472320->205520895) req@ffff9624bfd9dc00 x1875064559620992/t30064771239(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:624/0 lens 488/448 e 0 to 0 dl 1788201514 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201503.040101:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9dc00 with x1875064559620992 ext(204472320->205520895) 00002000:00010000:3.0:1788201503.040108:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9dc00 00000100:00100000:2.0:1788201503.137954:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201503.138599:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559621120 00000100:00100000:3.0:1788201503.138609:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559621120 00002000:00100000:3.0:1788201503.139028:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (205520896->206569471) req@ffff9624c1c24700 x1875064559621120/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:624/0 lens 488/0 e 0 to 0 dl 1788201514 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201503.139041:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c24700 with x1875064559621120 ext(205520896->206569471) 00002000:00010000:3.0:1788201503.139048:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c24700 00000100:00100000:3.0:1788201503.139181:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 239 00000100:00100000:3.0:1788201503.139192:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559621120:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201503.171412:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559621120:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32210us (33455us total) trans 30064771240 rc 0/0 00000100:00100000:3.0:1788201503.171427:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 239 00002000:00100000:3.0:1788201503.171443:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (205520896->206569471) req@ffff9624c1c24700 x1875064559621120/t30064771240(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:624/0 lens 488/448 e 0 to 0 dl 1788201514 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201503.171454:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c24700 with x1875064559621120 ext(205520896->206569471) 00002000:00010000:3.0:1788201503.171461:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c24700 00000100:00100000:2.0:1788201503.265463:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201503.265548:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559621248 00000100:00100000:3.0:1788201503.265557:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559621248 00002000:00100000:3.0:1788201503.265602:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (206569472->207618047) req@ffff9624c1c27b80 x1875064559621248/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:624/0 lens 488/0 e 0 to 0 dl 1788201514 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201503.265614:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c27b80 with x1875064559621248 ext(206569472->207618047) 00002000:00010000:3.0:1788201503.265620:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c27b80 00000100:00100000:3.0:1788201503.265680:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 240 00000100:00100000:3.0:1788201503.265690:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559621248:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201503.286555:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570134272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201503.286638:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201503.286786:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570134272 00000100:00100000:1.0:1788201503.286795:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570134272 00000100:00100000:1.0:1788201503.286876:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788201503.286887:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570134272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201503.286923:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201503.286969:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570134272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201503.286976:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00080000:3.0:1788201503.287063:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e51c00 x1875064570134272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201503.287082:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570134272:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201503.287608:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201503.292904:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559621248:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27201us (27435us total) trans 30064771241 rc 0/0 00000100:00100000:3.0:1788201503.292918:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 240 00002000:00100000:3.0:1788201503.292932:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (206569472->207618047) req@ffff9624c1c27b80 x1875064559621248/t30064771241(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:624/0 lens 488/448 e 0 to 0 dl 1788201514 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201503.292944:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c27b80 with x1875064559621248 ext(206569472->207618047) 00002000:00010000:3.0:1788201503.292951:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c27b80 00000100:00100000:0.0:1788201503.509926:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201503.510336:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559621376 00000100:00100000:2.0:1788201503.510375:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559621376 00002000:00100000:2.0:1788201503.510432:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (207618048->208666623) req@ffff9624bfd9f100 x1875064559621376/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:624/0 lens 488/0 e 0 to 0 dl 1788201514 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201503.510444:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9f100 with x1875064559621376 ext(207618048->208666623) 00002000:00010000:2.0:1788201503.510450:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9f100 00000100:00100000:2.0:1788201503.510489:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 241 00000100:00100000:2.0:1788201503.510516:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559621376:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201503.529512:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559621376:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18988us (19595us total) trans 30064771242 rc 0/0 00000100:00100000:2.0:1788201503.529524:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 241 00002000:00100000:2.0:1788201503.529535:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (207618048->208666623) req@ffff9624bfd9f100 x1875064559621376/t30064771242(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:624/0 lens 488/448 e 0 to 0 dl 1788201514 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201503.529543:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9f100 with x1875064559621376 ext(207618048->208666623) 00002000:00010000:2.0:1788201503.529548:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9f100 00010000:00010000:2.0:1788201503.542595:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201503.800462:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570134656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201503.800529:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201503.800578:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201503.800584:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570134528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201503.800604:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201503.800629:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570134656 00000100:00100000:1.0:1788201503.800635:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570134656 00000100:00100000:1.0:1788201503.800682:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788201503.800690:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570134656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201503.800733:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570134656:12345-0@lo:400:kworker.0 Request processed in 44us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201503.800740:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788201503.800774:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570134656:0@lo:400:kworker.0 00000100:00080000:1.0:1788201503.800792:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201503.800883:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570134528 00000100:00100000:3.0:1788201503.800887:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570134528 00000100:00100000:3.0:1788201503.800921:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788201503.800928:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570134528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.800973:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570134528:12345-0@lo:400:kworker.0 Request processed in 45us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201503.800978:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788201503.801003:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570134784:0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.801027:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.801045:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201503.801065:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570134400:0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.801090:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.801108:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570134912:0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.801127:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.801150:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570134784 00000100:00100000:3.0:1788201503.801153:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570134784 00000100:00100000:3.0:1788201503.801176:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570134912 00000100:00100000:3.0:1788201503.801179:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570134912 00000100:00100000:3.0:1788201503.801192:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788201503.801197:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570134784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.801230:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570134784:12345-0@lo:400:kworker.0 Request processed in 32us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201503.801237:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788201503.801249:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788201503.801255:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570134912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.801295:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570134912:12345-0@lo:400:kworker.0 Request processed in 41us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201503.801301:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788201503.801328:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570134912:0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.801337:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570134784:0@lo:400:kworker.0 00000100:00100000:2.0:1788201503.801434:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570134400 00000100:00100000:2.0:1788201503.801438:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570134400 00000100:00100000:2.0:1788201503.801476:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1788201503.801483:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570134400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201503.801522:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570134400:12345-0@lo:400:kworker.0 Request processed in 40us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201503.801528:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1788201503.801565:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570134400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201503.803256:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570134528:0@lo:400:kworker.0 00000100:00080000:1.0:1788201503.803295:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201503.816198:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201503.820769:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559621504 00000100:00100000:2.0:1788201503.820789:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559621504 00002000:00100000:2.0:1788201503.820854:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (208666624->209715199) req@ffff9624bfd9ca80 x1875064559621504/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:624/0 lens 488/0 e 0 to 0 dl 1788201514 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201503.820867:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ca80 with x1875064559621504 ext(208666624->209715199) 00002000:00010000:2.0:1788201503.820873:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ca80 00000100:00100000:2.0:1788201503.820919:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 242 00000100:00100000:2.0:1788201503.820946:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559621504:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201503.839451:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559621504:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18494us (23255us total) trans 30064771243 rc 0/0 00000100:00100000:2.0:1788201503.839467:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 242 00002000:00100000:2.0:1788201503.839481:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (208666624->209715199) req@ffff9624bfd9ca80 x1875064559621504/t30064771243(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:624/0 lens 488/448 e 0 to 0 dl 1788201514 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201503.839493:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ca80 with x1875064559621504 ext(208666624->209715199) 00002000:00010000:2.0:1788201503.839500:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ca80 00000100:00100000:0.0:1788201503.957272:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201503.960560:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559621632 00000100:00100000:2.0:1788201503.960578:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559621632 00002000:00100000:2.0:1788201503.960643:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (209715200->210763775) req@ffff9624bfd9fb80 x1875064559621632/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:624/0 lens 488/0 e 0 to 0 dl 1788201514 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201503.960655:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9fb80 with x1875064559621632 ext(209715200->210763775) 00002000:00010000:2.0:1788201503.960661:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9fb80 00000100:00100000:2.0:1788201503.960710:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 243 00000100:00100000:2.0:1788201503.960722:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559621632:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201503.975093:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559621632:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14361us (17838us total) trans 30064771244 rc 0/0 00000100:00100000:2.0:1788201503.975108:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 243 00002000:00100000:2.0:1788201503.975122:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (209715200->210763775) req@ffff9624bfd9fb80 x1875064559621632/t30064771244(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:624/0 lens 488/448 e 0 to 0 dl 1788201514 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201503.975134:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9fb80 with x1875064559621632 ext(209715200->210763775) 00002000:00010000:2.0:1788201503.975140:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9fb80 00000100:00100000:3.0:1788201504.221721:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201504.221841:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559621760 00000100:00100000:0.0:1788201504.221853:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559621760 00002000:00100000:0.0:1788201504.221903:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (210763776->211812351) req@ffff9624bfd9bb80 x1875064559621760/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:625/0 lens 488/0 e 0 to 0 dl 1788201515 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201504.221915:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9bb80 with x1875064559621760 ext(210763776->211812351) 00002000:00010000:0.0:1788201504.221919:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9bb80 00000100:00100000:0.0:1788201504.221952:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 244 00000100:00100000:0.0:1788201504.221962:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559621760:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201504.251186:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559621760:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29214us (29465us total) trans 30064771245 rc 0/0 00000100:00100000:0.0:1788201504.251200:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 244 00002000:00100000:0.0:1788201504.251213:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (210763776->211812351) req@ffff9624bfd9bb80 x1875064559621760/t30064771245(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:625/0 lens 488/448 e 0 to 0 dl 1788201515 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201504.251223:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9bb80 with x1875064559621760 ext(210763776->211812351) 00002000:00010000:0.0:1788201504.251230:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9bb80 00000100:00100000:1.0:1788201504.529910:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201504.530025:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559621888 00000100:00100000:0.0:1788201504.530036:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559621888 00002000:00100000:0.0:1788201504.530096:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (211812352->212860927) req@ffff9624c1e50a80 x1875064559621888/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:625/0 lens 488/0 e 0 to 0 dl 1788201515 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201504.530107:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e50a80 with x1875064559621888 ext(211812352->212860927) 00002000:00010000:0.0:1788201504.530127:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e50a80 00000100:00100000:0.0:1788201504.530165:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 245 00000100:00100000:0.0:1788201504.530176:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559621888:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201504.554524:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559621888:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24339us (24613us total) trans 30064771246 rc 0/0 00000100:00100000:0.0:1788201504.554538:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 245 00002000:00100000:0.0:1788201504.554550:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (211812352->212860927) req@ffff9624c1e50a80 x1875064559621888/t30064771246(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:625/0 lens 488/448 e 0 to 0 dl 1788201515 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201504.554561:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e50a80 with x1875064559621888 ext(211812352->212860927) 00002000:00010000:0.0:1788201504.554566:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e50a80 00010000:00010000:1.0:1788201504.567872:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201504.808302:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201504.808443:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559622016 00000100:00100000:2.0:1788201504.808453:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559622016 00002000:00100000:2.0:1788201504.808541:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (212860928->213909503) req@ffff9624c1e53b80 x1875064559622016/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:625/0 lens 488/0 e 0 to 0 dl 1788201515 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201504.808563:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e53b80 with x1875064559622016 ext(212860928->213909503) 00002000:00010000:2.0:1788201504.808569:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e53b80 00000100:00100000:2.0:1788201504.808665:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 246 00000100:00100000:2.0:1788201504.808695:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559622016:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201504.835916:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559622016:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27199us (27603us total) trans 30064771247 rc 0/0 00000100:00100000:2.0:1788201504.835932:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 246 00002000:00100000:2.0:1788201504.835945:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (212860928->213909503) req@ffff9624c1e53b80 x1875064559622016/t30064771247(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:625/0 lens 488/448 e 0 to 0 dl 1788201515 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201504.835956:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e53b80 with x1875064559622016 ext(212860928->213909503) 00002000:00010000:2.0:1788201504.835963:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e53b80 00000100:00100000:3.0:1788201505.023246:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201505.023376:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559622144 00000100:00100000:0.0:1788201505.023386:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559622144 00002000:00100000:0.0:1788201505.023442:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (213909504->214958079) req@ffff9624bfd99880 x1875064559622144/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:626/0 lens 488/0 e 0 to 0 dl 1788201516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201505.023455:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99880 with x1875064559622144 ext(213909504->214958079) 00002000:00010000:0.0:1788201505.023460:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99880 00000100:00100000:0.0:1788201505.023496:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 247 00000100:00100000:0.0:1788201505.023517:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559622144:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201505.024497:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201505.043624:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559622144:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20106us (20375us total) trans 30064771248 rc 0/0 00000100:00100000:1.0:1788201505.043640:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 247 00002000:00100000:1.0:1788201505.043653:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (213909504->214958079) req@ffff9624bfd99880 x1875064559622144/t30064771248(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:626/0 lens 488/448 e 0 to 0 dl 1788201516 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201505.043663:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99880 with x1875064559622144 ext(213909504->214958079) 00002000:00010000:1.0:1788201505.043670:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99880 00000100:00100000:2.0:1788201505.155880:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201505.156025:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559622272 00000100:00100000:0.0:1788201505.156046:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559622272 00002000:00100000:0.0:1788201505.156098:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (214958080->216006655) req@ffff9624c1c26d80 x1875064559622272/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:626/0 lens 488/0 e 0 to 0 dl 1788201516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201505.156110:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c26d80 with x1875064559622272 ext(214958080->216006655) 00002000:00010000:0.0:1788201505.156115:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c26d80 00000100:00100000:0.0:1788201505.156161:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 248 00000100:00100000:0.0:1788201505.156171:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559622272:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201505.174910:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559622272:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18729us (19032us total) trans 30064771249 rc 0/0 00000100:00100000:1.0:1788201505.174925:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 248 00002000:00100000:1.0:1788201505.174940:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (214958080->216006655) req@ffff9624c1c26d80 x1875064559622272/t30064771249(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:626/0 lens 488/448 e 0 to 0 dl 1788201516 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201505.174949:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c26d80 with x1875064559622272 ext(214958080->216006655) 00002000:00010000:1.0:1788201505.174955:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c26d80 00000100:00100000:3.0:1788201505.276259:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201505.282350:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559622400 00000100:00100000:2.0:1788201505.282429:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559622400 00002000:00100000:2.0:1788201505.282530:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (216006656->217055231) req@ffff9624bfd9aa00 x1875064559622400/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:626/0 lens 488/0 e 0 to 0 dl 1788201516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201505.282540:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9aa00 with x1875064559622400 ext(216006656->217055231) 00002000:00010000:2.0:1788201505.282546:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9aa00 00000100:00100000:2.0:1788201505.283013:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 249 00000100:00100000:2.0:1788201505.283149:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559622400:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201505.306406:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559622400:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23371us (30154us total) trans 30064771250 rc 0/0 00000100:00100000:0.0:1788201505.306421:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 249 00002000:00100000:0.0:1788201505.306434:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (216006656->217055231) req@ffff9624bfd9aa00 x1875064559622400/t30064771250(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:626/0 lens 488/448 e 0 to 0 dl 1788201516 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201505.306446:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9aa00 with x1875064559622400 ext(216006656->217055231) 00002000:00010000:0.0:1788201505.306453:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9aa00 00000100:00100000:2.0:1788201505.465638:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201505.472207:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559622528 00000100:00100000:3.0:1788201505.472225:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559622528 00002000:00100000:3.0:1788201505.472306:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (217055232->218103807) req@ffff9624c1c24a80 x1875064559622528/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:626/0 lens 488/0 e 0 to 0 dl 1788201516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201505.472332:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c24a80 with x1875064559622528 ext(217055232->218103807) 00002000:00010000:3.0:1788201505.472338:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c24a80 00000100:00100000:3.0:1788201505.472426:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 250 00000100:00100000:3.0:1788201505.472438:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559622528:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201505.508975:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559622528:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36521us (43329us total) trans 30064771251 rc 0/0 00000100:00100000:3.0:1788201505.508994:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 250 00002000:00100000:3.0:1788201505.509011:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (217055232->218103807) req@ffff9624c1c24a80 x1875064559622528/t30064771251(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:626/0 lens 488/448 e 0 to 0 dl 1788201516 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201505.509024:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c24a80 with x1875064559622528 ext(217055232->218103807) 00002000:00010000:3.0:1788201505.509031:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c24a80 00010000:00010000:1.0:1788201505.593258:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201505.694695:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201505.694923:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559622656 00000100:00100000:1.0:1788201505.694935:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559622656 00002000:00100000:1.0:1788201505.694987:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (218103808->219152383) req@ffff9624c1c26680 x1875064559622656/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:626/0 lens 488/0 e 0 to 0 dl 1788201516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201505.694998:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c26680 with x1875064559622656 ext(218103808->219152383) 00002000:00010000:1.0:1788201505.695004:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c26680 00000100:00100000:1.0:1788201505.695094:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 251 00000100:00100000:1.0:1788201505.695105:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2342:x1875064559622656:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201505.710807:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2342:x1875064559622656:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15681us (16100us total) trans 30064771252 rc 0/0 00000100:00100000:1.0:1788201505.710845:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 251 00002000:00100000:1.0:1788201505.710863:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (218103808->219152383) req@ffff9624c1c26680 x1875064559622656/t30064771252(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:626/0 lens 488/448 e 0 to 0 dl 1788201516 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201505.710877:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c26680 with x1875064559622656 ext(218103808->219152383) 00002000:00010000:1.0:1788201505.710885:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c26680 00000100:00100000:2.0:1788201505.847533:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570135040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201505.847669:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201505.847921:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570135040 00000100:00100000:0.0:1788201505.847931:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570135040 00000100:00100000:0.0:1788201505.848025:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788201505.848039:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570135040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201505.848069:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3407872 granted 188284928 pending 34078720 free 3661627392 avail 3659530240 00000100:00100000:0.0:1788201505.848124:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570135040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201505.848132:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1788201505.850272:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201505.850412:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570135040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201505.876457:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201505.876599:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559622784 00000100:00100000:1.0:1788201505.876613:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559622784 00002000:00100000:1.0:1788201505.876682:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (219152384->220200959) req@ffff9624bfd99180 x1875064559622784/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:626/0 lens 488/0 e 0 to 0 dl 1788201516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201505.876696:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99180 with x1875064559622784 ext(219152384->220200959) 00002000:00010000:1.0:1788201505.876703:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99180 00000100:00100000:1.0:1788201505.876756:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 252 00000100:00100000:1.0:1788201505.876768:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2342:x1875064559622784:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201505.892913:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2342:x1875064559622784:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16130us (16453us total) trans 30064771253 rc 0/0 00000100:00100000:1.0:1788201505.892930:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 252 00002000:00100000:1.0:1788201505.892947:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (219152384->220200959) req@ffff9624bfd99180 x1875064559622784/t30064771253(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:626/0 lens 488/448 e 0 to 0 dl 1788201516 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201505.892961:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99180 with x1875064559622784 ext(219152384->220200959) 00002000:00010000:1.0:1788201505.892970:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99180 00000100:00100000:2.0:1788201506.125627:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201506.125780:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559622912 00000100:00100000:0.0:1788201506.125794:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559622912 00002000:00100000:0.0:1788201506.125866:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (220200960->221249535) req@ffff9624c1e56a00 x1875064559622912/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:627/0 lens 488/0 e 0 to 0 dl 1788201517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201506.125880:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56a00 with x1875064559622912 ext(220200960->221249535) 00002000:00010000:0.0:1788201506.125887:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56a00 00000100:00100000:0.0:1788201506.125928:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 253 00000100:00100000:0.0:1788201506.125939:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559622912:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201506.172147:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559622912:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 45762us (46089us total) trans 30064771254 rc 0/0 00000100:00100000:3.0:1788201506.172170:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 253 00002000:00100000:3.0:1788201506.172193:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (220200960->221249535) req@ffff9624c1e56a00 x1875064559622912/t30064771254(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:627/0 lens 488/448 e 0 to 0 dl 1788201517 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201506.172206:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56a00 with x1875064559622912 ext(220200960->221249535) 00002000:00010000:3.0:1788201506.172214:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56a00 00000100:00100000:0.0:1788201506.465374:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201506.465409:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559623040 00000100:00100000:3.0:1788201506.465421:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559623040 00002000:00100000:3.0:1788201506.465473:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (221249536->222298111) req@ffff9624bfd9ea00 x1875064559623040/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:627/0 lens 488/0 e 0 to 0 dl 1788201517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201506.465500:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ea00 with x1875064559623040 ext(221249536->222298111) 00002000:00010000:3.0:1788201506.465505:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ea00 00000100:00100000:3.0:1788201506.465541:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 254 00000100:00100000:3.0:1788201506.465551:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559623040:12345-192.168.201.56@tcp:4:iozone.0 00000001:00100000:2.0:1788201506.469113:0:7629:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:2.0:1788201506.469124:0:7629:0:(genops.c:906:class_export_put()) final put ffff962485918000/986744c8-ee81-4a47-8d91-97f81ede1f3e 00000020:00000080:2.0:1788201506.469157:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff962485918000/986744c8-ee81-4a47-8d91-97f81ede1f3e for lustre-OST0001 00000020:00000080:2.0:1788201506.469208:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96248591e000 for lustre-OST0001 00000100:00100000:2.0:1788201506.488444:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559623040:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22881us (23104us total) trans 30064771255 rc 0/0 00000100:00100000:2.0:1788201506.488458:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 254 00002000:00100000:2.0:1788201506.488471:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (221249536->222298111) req@ffff9624bfd9ea00 x1875064559623040/t30064771255(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:627/0 lens 488/448 e 0 to 0 dl 1788201517 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201506.488481:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ea00 with x1875064559623040 ext(221249536->222298111) 00002000:00010000:2.0:1788201506.488488:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ea00 00000001:00080000:3.0:1788201506.489915:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771250 is committed 00000001:00080000:3.0:1788201506.490014:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771253 is committed 00000001:00080000:3.0:1788201506.490283:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771254 is committed 00010000:00010000:2.0:1788201506.614592:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201506.656589:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201506.656681:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559623168 00000100:00100000:1.0:1788201506.656691:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559623168 00002000:00100000:1.0:1788201506.656737:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (222298112->223346687) req@ffff9624c1e55180 x1875064559623168/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:627/0 lens 488/0 e 0 to 0 dl 1788201517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201506.656758:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55180 with x1875064559623168 ext(222298112->223346687) 00002000:00010000:1.0:1788201506.656777:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55180 00000100:00100000:1.0:1788201506.656815:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 255 00000100:00100000:1.0:1788201506.656825:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559623168:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201506.712095:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559623168:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 55258us (55503us total) trans 30064771256 rc 0/0 00000100:00100000:1.0:1788201506.712110:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 255 00002000:00100000:1.0:1788201506.712127:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (222298112->223346687) req@ffff9624c1e55180 x1875064559623168/t30064771256(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:627/0 lens 488/448 e 0 to 0 dl 1788201517 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201506.712138:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55180 with x1875064559623168 ext(222298112->223346687) 00002000:00010000:1.0:1788201506.712145:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55180 00000100:00100000:0.0:1788201506.897103:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201506.897384:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559623296 00000100:00100000:1.0:1788201506.897400:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559623296 00002000:00100000:1.0:1788201506.897464:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (223346688->224395263) req@ffff9624bfd9d180 x1875064559623296/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:627/0 lens 488/0 e 0 to 0 dl 1788201517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201506.897477:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9d180 with x1875064559623296 ext(223346688->224395263) 00002000:00010000:1.0:1788201506.897483:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9d180 00000100:00100000:1.0:1788201506.897528:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 256 00000100:00100000:1.0:1788201506.897539:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559623296:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201506.913194:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2341:x1875064559623296:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15646us (16097us total) trans 30064771257 rc 0/0 00000100:00100000:1.0:1788201506.913209:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 256 00002000:00100000:1.0:1788201506.913246:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (223346688->224395263) req@ffff9624bfd9d180 x1875064559623296/t30064771257(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:627/0 lens 488/448 e 0 to 0 dl 1788201517 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201506.913257:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9d180 with x1875064559623296 ext(223346688->224395263) 00002000:00010000:1.0:1788201506.913263:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9d180 00000100:00100000:0.0:1788201507.123167:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201507.126621:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559623424 00000100:00100000:3.0:1788201507.126638:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559623424 00002000:00100000:3.0:1788201507.126797:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (224395264->225443839) req@ffff9624bfd9c700 x1875064559623424/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:628/0 lens 488/0 e 0 to 0 dl 1788201518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201507.126808:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9c700 with x1875064559623424 ext(224395264->225443839) 00002000:00010000:3.0:1788201507.126813:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9c700 00000100:00100000:3.0:1788201507.126851:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 257 00000100:00100000:3.0:1788201507.126863:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559623424:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201507.133002:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201507.161675:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559623424:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34804us (38578us total) trans 30064771258 rc 0/0 00000100:00100000:2.0:1788201507.161689:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 257 00002000:00100000:2.0:1788201507.161702:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (224395264->225443839) req@ffff9624bfd9c700 x1875064559623424/t30064771258(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:628/0 lens 488/448 e 0 to 0 dl 1788201518 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201507.161726:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9c700 with x1875064559623424 ext(224395264->225443839) 00002000:00010000:2.0:1788201507.161733:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9c700 00000100:00100000:1.0:1788201507.398893:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201507.406663:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559623552 00000100:00100000:2.0:1788201507.406680:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559623552 00002000:00100000:2.0:1788201507.406808:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (225443840->226492415) req@ffff9624c1e52300 x1875064559623552/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:628/0 lens 488/0 e 0 to 0 dl 1788201518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201507.406820:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e52300 with x1875064559623552 ext(225443840->226492415) 00002000:00010000:2.0:1788201507.406826:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e52300 00000100:00100000:2.0:1788201507.406881:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 258 00000100:00100000:2.0:1788201507.406891:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559623552:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201507.432764:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559623552:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25863us (33870us total) trans 30064771259 rc 0/0 00000100:00100000:3.0:1788201507.432778:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 258 00002000:00100000:3.0:1788201507.432792:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (225443840->226492415) req@ffff9624c1e52300 x1875064559623552/t30064771259(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:628/0 lens 488/448 e 0 to 0 dl 1788201518 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201507.432803:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e52300 with x1875064559623552 ext(225443840->226492415) 00002000:00010000:3.0:1788201507.432809:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e52300 00010000:00010000:1.0:1788201507.639069:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201507.641534:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201507.641690:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201507.641762:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559623808 00000100:00100000:3.0:1788201507.641774:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559623808 00000100:00100000:3.0:1788201507.641886:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 351 00000100:00100000:3.0:1788201507.641900:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559623808:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201507.642330:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559623808:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 433us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201507.642339:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 351 00000100:00080000:1.0:1788201507.642480:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201507.646748:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559623680 00000100:00100000:2.0:1788201507.646764:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559623680 00000100:00100000:2.0:1788201507.646884:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 518 00000100:00100000:2.0:1788201507.646910:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559623680:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201507.646999:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559623680:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 106us (5475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201507.647007:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 518 00000100:00100000:3.0:1788201507.696707:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201507.697289:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559623936 00000100:00100000:1.0:1788201507.697302:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559623936 00002000:00100000:1.0:1788201507.697402:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (226492416->227540991) req@ffff9624bfd98700 x1875064559623936/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:628/0 lens 488/0 e 0 to 0 dl 1788201518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201507.697414:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98700 with x1875064559623936 ext(226492416->227540991) 00002000:00010000:1.0:1788201507.697420:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98700 00000100:00100000:1.0:1788201507.697455:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 259 00000100:00100000:1.0:1788201507.697466:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559623936:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201507.714832:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559623936:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17357us (18142us total) trans 30064771260 rc 0/0 00000100:00100000:1.0:1788201507.714846:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 259 00002000:00100000:1.0:1788201507.714868:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (226492416->227540991) req@ffff9624bfd98700 x1875064559623936/t30064771260(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:628/0 lens 488/448 e 0 to 0 dl 1788201518 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201507.714878:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98700 with x1875064559623936 ext(226492416->227540991) 00002000:00010000:1.0:1788201507.714884:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98700 00000100:00100000:3.0:1788201507.931209:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201507.931317:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559624064 00000100:00100000:1.0:1788201507.931327:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559624064 00002000:00100000:1.0:1788201507.931413:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (227540992->228589567) req@ffff9624bfd9a300 x1875064559624064/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:628/0 lens 488/0 e 0 to 0 dl 1788201518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201507.931437:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9a300 with x1875064559624064 ext(227540992->228589567) 00002000:00010000:1.0:1788201507.931444:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9a300 00000100:00100000:1.0:1788201507.931479:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 260 00000100:00100000:1.0:1788201507.931490:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559624064:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201507.966070:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559624064:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34570us (34870us total) trans 30064771261 rc 0/0 00000100:00100000:1.0:1788201507.966084:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 260 00002000:00100000:1.0:1788201507.966098:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (227540992->228589567) req@ffff9624bfd9a300 x1875064559624064/t30064771261(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:628/0 lens 488/448 e 0 to 0 dl 1788201518 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201507.966109:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9a300 with x1875064559624064 ext(227540992->228589567) 00002000:00010000:1.0:1788201507.966116:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9a300 00000100:00100000:3.0:1788201508.164665:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201508.165080:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559624192 00000100:00100000:2.0:1788201508.165091:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559624192 00002000:00100000:2.0:1788201508.165143:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (228589568->229638143) req@ffff9624bfd99500 x1875064559624192/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:629/0 lens 488/0 e 0 to 0 dl 1788201519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201508.165154:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99500 with x1875064559624192 ext(228589568->229638143) 00002000:00010000:2.0:1788201508.165159:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99500 00000100:00100000:2.0:1788201508.165215:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 261 00000100:00100000:2.0:1788201508.165225:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559624192:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201508.193526:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559624192:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28292us (28861us total) trans 30064771262 rc 0/0 00000100:00100000:2.0:1788201508.193540:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 261 00002000:00100000:2.0:1788201508.193553:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (228589568->229638143) req@ffff9624bfd99500 x1875064559624192/t30064771262(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:629/0 lens 488/448 e 0 to 0 dl 1788201519 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201508.193563:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99500 with x1875064559624192 ext(228589568->229638143) 00002000:00010000:2.0:1788201508.193569:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99500 00000100:00100000:2.0:1788201508.409628:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570135168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201508.409726:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201508.409986:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570135168 00000100:00100000:0.0:1788201508.409995:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570135168 00000100:00100000:0.0:1788201508.410072:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788201508.410083:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570135168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201508.410121:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201508.410170:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570135168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201508.410177:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00010000:00080000:0.0:1788201508.410228:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e51500 x1875064570135168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201508.410246:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570135168:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201508.410369:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201508.514664:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201508.514863:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559624320 00000100:00100000:2.0:1788201508.514875:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559624320 00002000:00100000:2.0:1788201508.514926:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (229638144->230686719) req@ffff9624bfd98380 x1875064559624320/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:629/0 lens 488/0 e 0 to 0 dl 1788201519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201508.514937:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98380 with x1875064559624320 ext(229638144->230686719) 00002000:00010000:2.0:1788201508.514942:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98380 00000100:00100000:2.0:1788201508.515026:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 262 00000100:00100000:2.0:1788201508.515037:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559624320:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201508.529949:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559624320:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14904us (15285us total) trans 30064771263 rc 0/0 00000100:00100000:2.0:1788201508.529963:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 262 00002000:00100000:2.0:1788201508.530291:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (229638144->230686719) req@ffff9624bfd98380 x1875064559624320/t30064771263(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:629/0 lens 488/448 e 0 to 0 dl 1788201519 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201508.530321:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98380 with x1875064559624320 ext(229638144->230686719) 00002000:00010000:2.0:1788201508.530328:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98380 00010000:00010000:1.0:1788201508.663490:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201508.699456:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201508.699913:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559624448 00000100:00100000:1.0:1788201508.699923:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559624448 00002000:00100000:1.0:1788201508.699987:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (230686720->231735295) req@ffff9624bfd99f80 x1875064559624448/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:629/0 lens 488/0 e 0 to 0 dl 1788201519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201508.699999:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99f80 with x1875064559624448 ext(230686720->231735295) 00002000:00010000:1.0:1788201508.700004:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99f80 00000100:00100000:1.0:1788201508.700038:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 263 00000100:00100000:1.0:1788201508.700049:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559624448:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201508.730655:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559624448:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30597us (31198us total) trans 30064771264 rc 0/0 00000100:00100000:1.0:1788201508.730687:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 263 00002000:00100000:1.0:1788201508.730701:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (230686720->231735295) req@ffff9624bfd99f80 x1875064559624448/t30064771264(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:629/0 lens 488/448 e 0 to 0 dl 1788201519 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201508.730711:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99f80 with x1875064559624448 ext(230686720->231735295) 00002000:00010000:1.0:1788201508.730718:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99f80 00000100:00100000:0.0:1788201508.898546:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201508.899488:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559624576 00000100:00100000:1.0:1788201508.899503:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559624576 00002000:00100000:1.0:1788201508.899563:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (231735296->232783871) req@ffff9624bfd9d500 x1875064559624576/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:629/0 lens 488/0 e 0 to 0 dl 1788201519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201508.899576:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9d500 with x1875064559624576 ext(231735296->232783871) 00002000:00010000:1.0:1788201508.899582:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9d500 00000100:00100000:1.0:1788201508.899694:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 264 00000100:00100000:1.0:1788201508.899706:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559624576:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201508.920436:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570135552:0@lo:400:kworker.0 00000100:00100000:0.0:1788201508.920500:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570135296:0@lo:400:kworker.0 00000100:00100000:2.0:1788201508.920514:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201508.920579:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201508.920583:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201508.920593:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570135680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201508.920634:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570135808:0@lo:400:kworker.0 00000100:00100000:2.0:1788201508.920642:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201508.920820:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570135424:0@lo:400:kworker.0 00000100:00100000:1.0:1788201508.920851:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201508.926524:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570135296 00000100:00100000:3.0:1788201508.926539:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570135296 00000100:00100000:3.0:1788201508.926586:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1788201508.926595:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570135296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.926681:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570135296:12345-0@lo:400:kworker.0 Request processed in 86us (6103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201508.926687:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1788201508.926740:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570135552 00000100:00100000:3.0:1788201508.926745:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570135552 00000100:00100000:3.0:1788201508.926790:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788201508.926798:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570135552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.926845:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570135552:12345-0@lo:400:kworker.0 Request processed in 49us (6334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201508.926851:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788201508.927154:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570135552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.927835:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570135680 00000100:00080000:1.0:1788201508.927928:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201508.928386:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570135680 00000100:00100000:3.0:1788201508.928430:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570135424 00000100:00100000:3.0:1788201508.928434:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570135424 00000100:00100000:3.0:1788201508.928456:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788201508.928464:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570135680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.928527:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570135680:12345-0@lo:400:kworker.0 Request processed in 64us (7890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201508.928534:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788201508.928551:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788201508.928558:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570135424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.928586:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570135424:12345-0@lo:400:kworker.0 Request processed in 30us (7735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201508.928592:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788201508.928632:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570135680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201508.929606:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201508.929689:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570135808 00000100:00100000:3.0:1788201508.929696:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570135808 00000100:00100000:0.0:1788201508.929782:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570135296:0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.929791:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788201508.929804:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570135808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.929858:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570135808:12345-0@lo:400:kworker.0 Request processed in 58us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201508.929865:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788201508.930256:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570135424:0@lo:400:kworker.0 00000100:00100000:0.0:1788201508.930284:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570135808:0@lo:400:kworker.0 00000100:00080000:0.0:1788201508.930319:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201508.931579:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559624576:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31870us (33045us total) trans 30064771265 rc 0/0 00000100:00100000:1.0:1788201508.931591:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 264 00002000:00100000:1.0:1788201508.931604:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (231735296->232783871) req@ffff9624bfd9d500 x1875064559624576/t30064771265(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:629/0 lens 488/448 e 0 to 0 dl 1788201519 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201508.931615:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9d500 with x1875064559624576 ext(231735296->232783871) 00002000:00010000:1.0:1788201508.931623:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9d500 00000100:00100000:3.0:1788201509.084932:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201509.085012:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559624704 00000100:00100000:2.0:1788201509.085022:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559624704 00002000:00100000:2.0:1788201509.085170:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (232783872->233832447) req@ffff9624bfd9b480 x1875064559624704/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:630/0 lens 488/0 e 0 to 0 dl 1788201520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201509.085191:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9b480 with x1875064559624704 ext(232783872->233832447) 00002000:00010000:2.0:1788201509.085198:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9b480 00000100:00080000:0.0:1788201509.085293:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201509.086261:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 265 00000100:00100000:2.0:1788201509.086279:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559624704:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201509.110067:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559624704:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23783us (25134us total) trans 30064771266 rc 0/0 00000100:00100000:2.0:1788201509.110084:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 265 00002000:00100000:2.0:1788201509.110099:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (232783872->233832447) req@ffff9624bfd9b480 x1875064559624704/t30064771266(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:630/0 lens 488/448 e 0 to 0 dl 1788201520 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201509.110109:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9b480 with x1875064559624704 ext(232783872->233832447) 00002000:00010000:2.0:1788201509.110115:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9b480 00000100:00100000:1.0:1788201509.232490:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201509.235605:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559624832 00000100:00100000:2.0:1788201509.235642:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559624832 00002000:00100000:2.0:1788201509.236084:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (233832448->234881023) req@ffff9624c1e51f80 x1875064559624832/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:630/0 lens 488/0 e 0 to 0 dl 1788201520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201509.236096:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e51f80 with x1875064559624832 ext(233832448->234881023) 00002000:00010000:2.0:1788201509.236102:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e51f80 00000100:00100000:2.0:1788201509.236218:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 266 00000100:00100000:2.0:1788201509.236229:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559624832:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201509.255996:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559624832:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19757us (23504us total) trans 30064771267 rc 0/0 00000100:00100000:2.0:1788201509.256012:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 266 00002000:00100000:2.0:1788201509.256026:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (233832448->234881023) req@ffff9624c1e51f80 x1875064559624832/t30064771267(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:630/0 lens 488/448 e 0 to 0 dl 1788201520 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201509.256037:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e51f80 with x1875064559624832 ext(233832448->234881023) 00002000:00010000:2.0:1788201509.256044:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e51f80 00000100:00100000:1.0:1788201509.442141:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201509.442304:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559624960 00000100:00100000:0.0:1788201509.442316:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559624960 00002000:00100000:0.0:1788201509.442404:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (234881024->235929599) req@ffff9624c1e53480 x1875064559624960/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:630/0 lens 488/0 e 0 to 0 dl 1788201520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201509.442416:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e53480 with x1875064559624960 ext(234881024->235929599) 00002000:00010000:0.0:1788201509.442422:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e53480 00000100:00100000:0.0:1788201509.442460:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 267 00000100:00100000:0.0:1788201509.442471:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559624960:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201509.476249:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559624960:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33768us (34107us total) trans 30064771268 rc 0/0 00000100:00100000:2.0:1788201509.476263:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 267 00002000:00100000:2.0:1788201509.476276:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (234881024->235929599) req@ffff9624c1e53480 x1875064559624960/t30064771268(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:630/0 lens 488/448 e 0 to 0 dl 1788201520 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201509.476287:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e53480 with x1875064559624960 ext(234881024->235929599) 00002000:00010000:2.0:1788201509.476294:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e53480 00010000:00010000:2.0:1788201509.686884:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201509.721144:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201509.721418:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559625088 00000100:00100000:1.0:1788201509.721430:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559625088 00002000:00100000:1.0:1788201509.721485:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (235929600->236978175) req@ffff9624bfd9df80 x1875064559625088/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:630/0 lens 488/0 e 0 to 0 dl 1788201520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201509.721496:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9df80 with x1875064559625088 ext(235929600->236978175) 00002000:00010000:1.0:1788201509.721501:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9df80 00000100:00100000:1.0:1788201509.721537:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 268 00000100:00100000:1.0:1788201509.721547:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559625088:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201509.757544:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559625088:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35988us (36400us total) trans 30064771269 rc 0/0 00000100:00100000:1.0:1788201509.757558:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 268 00002000:00100000:1.0:1788201509.757570:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (235929600->236978175) req@ffff9624bfd9df80 x1875064559625088/t30064771269(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:630/0 lens 488/448 e 0 to 0 dl 1788201520 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201509.757581:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9df80 with x1875064559625088 ext(235929600->236978175) 00002000:00010000:1.0:1788201509.757587:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9df80 00000100:00100000:0.0:1788201510.020373:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201510.020467:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559625216 00000100:00100000:2.0:1788201510.020478:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559625216 00002000:00100000:2.0:1788201510.020545:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (236978176->238026751) req@ffff9624bfd9f480 x1875064559625216/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:631/0 lens 488/0 e 0 to 0 dl 1788201521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201510.020557:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9f480 with x1875064559625216 ext(236978176->238026751) 00002000:00010000:2.0:1788201510.020563:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9f480 00000100:00100000:2.0:1788201510.020597:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 269 00000100:00100000:2.0:1788201510.020607:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559625216:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201510.042215:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559625216:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21595us (21864us total) trans 30064771270 rc 0/0 00000100:00100000:2.0:1788201510.042233:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 269 00002000:00100000:2.0:1788201510.042249:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (236978176->238026751) req@ffff9624bfd9f480 x1875064559625216/t30064771270(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:631/0 lens 488/448 e 0 to 0 dl 1788201521 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201510.042261:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9f480 with x1875064559625216 ext(236978176->238026751) 00002000:00010000:2.0:1788201510.042267:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9f480 00000100:00100000:1.0:1788201510.275883:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201510.276220:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559625344 00000100:00100000:2.0:1788201510.276231:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559625344 00002000:00100000:2.0:1788201510.276283:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (238026752->239075327) req@ffff9624c1e53800 x1875064559625344/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:631/0 lens 488/0 e 0 to 0 dl 1788201521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201510.276293:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e53800 with x1875064559625344 ext(238026752->239075327) 00002000:00010000:2.0:1788201510.276299:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e53800 00000100:00100000:2.0:1788201510.276330:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 270 00000100:00100000:2.0:1788201510.276364:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559625344:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201510.317884:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559625344:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 41532us (41999us total) trans 30064771271 rc 0/0 00000100:00100000:2.0:1788201510.317921:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 270 00002000:00100000:2.0:1788201510.317937:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (238026752->239075327) req@ffff9624c1e53800 x1875064559625344/t30064771271(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:631/0 lens 488/448 e 0 to 0 dl 1788201521 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201510.318069:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e53800 with x1875064559625344 ext(238026752->239075327) 00002000:00010000:2.0:1788201510.318076:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e53800 00000100:00100000:0.0:1788201510.561824:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201510.568999:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559625472 00000100:00100000:2.0:1788201510.569015:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559625472 00002000:00100000:2.0:1788201510.569400:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (239075328->240123903) req@ffff9624bfd9f800 x1875064559625472/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:631/0 lens 488/0 e 0 to 0 dl 1788201521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201510.569412:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9f800 with x1875064559625472 ext(239075328->240123903) 00002000:00010000:2.0:1788201510.569418:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9f800 00000100:00100000:2.0:1788201510.569447:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 271 00000100:00100000:2.0:1788201510.569458:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559625472:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201510.594442:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2341:x1875064559625472:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24974us (32617us total) trans 30064771272 rc 0/0 00000100:00100000:2.0:1788201510.594457:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 271 00002000:00100000:2.0:1788201510.594470:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (239075328->240123903) req@ffff9624bfd9f800 x1875064559625472/t30064771272(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:631/0 lens 488/448 e 0 to 0 dl 1788201521 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201510.594479:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9f800 with x1875064559625472 ext(239075328->240123903) 00002000:00010000:2.0:1788201510.594486:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9f800 00010000:00010000:1.0:1788201510.710567:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201510.829769:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201510.829875:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559625600 00000100:00100000:1.0:1788201510.829886:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559625600 00002000:00100000:1.0:1788201510.829936:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (240123904->241172479) req@ffff9624bfd9c000 x1875064559625600/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:631/0 lens 488/0 e 0 to 0 dl 1788201521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201510.829947:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9c000 with x1875064559625600 ext(240123904->241172479) 00002000:00010000:1.0:1788201510.829953:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9c000 00000100:00100000:1.0:1788201510.829999:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 272 00000100:00100000:1.0:1788201510.830010:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559625600:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201510.851236:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559625600:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21216us (21465us total) trans 30064771273 rc 0/0 00000100:00100000:1.0:1788201510.851250:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 272 00002000:00100000:1.0:1788201510.851262:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (240123904->241172479) req@ffff9624bfd9c000 x1875064559625600/t30064771273(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:631/0 lens 488/448 e 0 to 0 dl 1788201521 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201510.851274:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9c000 with x1875064559625600 ext(240123904->241172479) 00002000:00010000:1.0:1788201510.851280:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9c000 00000100:00100000:1.0:1788201510.967966:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201510.968000:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570135936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201510.968091:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201510.968364:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570135936 00000100:00100000:0.0:1788201510.968373:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570135936 00000100:00100000:0.0:1788201510.968445:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788201510.968455:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570135936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201510.968501:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3407872 granted 222363648 pending 32374784 free 3638558720 avail 3636461568 00000100:00100000:0.0:1788201510.968548:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570135936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201510.968555:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:1.0:1788201510.968952:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201510.969001:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570135936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201511.124636:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201511.124771:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559625728 00000100:00100000:0.0:1788201511.124788:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559625728 00002000:00100000:0.0:1788201511.124869:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (241172480->242221055) req@ffff9624bfd9b800 x1875064559625728/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:632/0 lens 488/0 e 0 to 0 dl 1788201522 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201511.124900:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9b800 with x1875064559625728 ext(241172480->242221055) 00002000:00010000:0.0:1788201511.124907:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9b800 00000100:00100000:0.0:1788201511.124941:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 273 00000100:00100000:0.0:1788201511.124951:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559625728:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201511.125585:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201511.159519:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559625728:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34559us (34889us total) trans 30064771274 rc 0/0 00000100:00100000:2.0:1788201511.159550:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 273 00002000:00100000:2.0:1788201511.159562:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (241172480->242221055) req@ffff9624bfd9b800 x1875064559625728/t30064771274(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:632/0 lens 488/448 e 0 to 0 dl 1788201522 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201511.159574:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9b800 with x1875064559625728 ext(241172480->242221055) 00002000:00010000:2.0:1788201511.159581:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9b800 00000100:00100000:0.0:1788201511.353549:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201511.353662:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559625856 00000100:00100000:2.0:1788201511.353671:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559625856 00002000:00100000:2.0:1788201511.353721:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (242221056->243269631) req@ffff9624bfd9ce00 x1875064559625856/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:632/0 lens 488/0 e 0 to 0 dl 1788201522 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201511.353733:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ce00 with x1875064559625856 ext(242221056->243269631) 00002000:00010000:2.0:1788201511.353739:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ce00 00000100:00100000:2.0:1788201511.353773:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 274 00000100:00100000:2.0:1788201511.353783:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559625856:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201511.391491:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559625856:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37697us (37941us total) trans 30064771275 rc 0/0 00000100:00100000:0.0:1788201511.391505:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 274 00002000:00100000:0.0:1788201511.391519:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (242221056->243269631) req@ffff9624bfd9ce00 x1875064559625856/t30064771275(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:632/0 lens 488/448 e 0 to 0 dl 1788201522 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201511.391529:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ce00 with x1875064559625856 ext(242221056->243269631) 00002000:00010000:0.0:1788201511.391535:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ce00 00000100:00100000:3.0:1788201511.562327:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201511.562553:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559625984 00000100:00100000:2.0:1788201511.562562:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559625984 00002000:00100000:2.0:1788201511.562611:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (243269632->244318207) req@ffff9624bfd98000 x1875064559625984/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:632/0 lens 488/0 e 0 to 0 dl 1788201522 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201511.562622:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98000 with x1875064559625984 ext(243269632->244318207) 00002000:00010000:2.0:1788201511.562628:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98000 00000100:00100000:2.0:1788201511.562673:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 275 00000100:00100000:2.0:1788201511.562682:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559625984:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201511.577238:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559625984:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14543us (14907us total) trans 30064771276 rc 0/0 00000100:00100000:3.0:1788201511.581006:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 275 00002000:00100000:3.0:1788201511.581025:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (243269632->244318207) req@ffff9624bfd98000 x1875064559625984/t30064771276(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:632/0 lens 488/448 e 0 to 0 dl 1788201522 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201511.581035:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98000 with x1875064559625984 ext(243269632->244318207) 00002000:00010000:3.0:1788201511.581041:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98000 00000001:00080000:3.0:1788201511.622515:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771275 is committed 00000100:00100000:0.0:1788201511.704282:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201511.704435:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559626112 00000100:00100000:1.0:1788201511.704446:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559626112 00002000:00100000:1.0:1788201511.704499:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (244318208->245366783) req@ffff9624bfd9d880 x1875064559626112/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:632/0 lens 488/0 e 0 to 0 dl 1788201522 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201511.704511:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9d880 with x1875064559626112 ext(244318208->245366783) 00002000:00010000:1.0:1788201511.704517:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9d880 00000100:00100000:1.0:1788201511.704589:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 276 00000100:00100000:1.0:1788201511.704599:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559626112:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201511.722631:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559626112:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18021us (18348us total) trans 30064771277 rc 0/0 00000100:00100000:1.0:1788201511.722658:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 276 00002000:00100000:1.0:1788201511.722671:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (244318208->245366783) req@ffff9624bfd9d880 x1875064559626112/t30064771277(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:632/0 lens 488/448 e 0 to 0 dl 1788201522 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201511.722683:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9d880 with x1875064559626112 ext(244318208->245366783) 00002000:00010000:1.0:1788201511.722689:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9d880 00010000:00010000:1.0:1788201511.734710:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201511.803823:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201511.804016:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559626240 00000100:00100000:2.0:1788201511.804026:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559626240 00002000:00100000:2.0:1788201511.804087:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (245366784->246415359) req@ffff962485aadf80 x1875064559626240/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:632/0 lens 488/0 e 0 to 0 dl 1788201522 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201511.804099:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aadf80 with x1875064559626240 ext(245366784->246415359) 00002000:00010000:2.0:1788201511.804105:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aadf80 00000100:00100000:2.0:1788201511.804163:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 277 00000100:00100000:2.0:1788201511.804174:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559626240:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201511.830430:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559626240:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26246us (26606us total) trans 30064771278 rc 0/0 00000100:00100000:2.0:1788201511.830443:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 277 00002000:00100000:2.0:1788201511.830458:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (245366784->246415359) req@ffff962485aadf80 x1875064559626240/t30064771278(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:632/0 lens 488/448 e 0 to 0 dl 1788201522 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201511.830468:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aadf80 with x1875064559626240 ext(245366784->246415359) 00002000:00010000:2.0:1788201511.830473:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aadf80 00000100:00100000:0.0:1788201511.929367:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201511.929901:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559626368 00000100:00100000:2.0:1788201511.929923:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559626368 00002000:00100000:2.0:1788201511.929975:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (246415360->247463935) req@ffff962485681c00 x1875064559626368/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:632/0 lens 488/0 e 0 to 0 dl 1788201522 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201511.929986:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681c00 with x1875064559626368 ext(246415360->247463935) 00002000:00010000:2.0:1788201511.929992:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681c00 00000100:00100000:2.0:1788201511.930037:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 278 00000100:00100000:2.0:1788201511.930048:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559626368:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201511.949947:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559626368:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19887us (20602us total) trans 30064771279 rc 0/0 00000100:00100000:2.0:1788201511.949981:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 278 00002000:00100000:2.0:1788201511.949998:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (246415360->247463935) req@ffff962485681c00 x1875064559626368/t30064771279(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:632/0 lens 488/448 e 0 to 0 dl 1788201522 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201511.950011:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681c00 with x1875064559626368 ext(246415360->247463935) 00002000:00010000:2.0:1788201511.950018:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681c00 00000100:00100000:1.0:1788201512.116121:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201512.116525:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559626496 00000100:00100000:3.0:1788201512.116538:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559626496 00002000:00100000:3.0:1788201512.116599:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (247463936->248512511) req@ffff9624c1e50e00 x1875064559626496/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:633/0 lens 488/0 e 0 to 0 dl 1788201523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201512.116611:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e50e00 with x1875064559626496 ext(247463936->248512511) 00002000:00010000:3.0:1788201512.116617:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e50e00 00000100:00100000:3.0:1788201512.116654:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 279 00000100:00100000:3.0:1788201512.116664:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559626496:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201512.127022:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559626496:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10348us (10902us total) trans 30064771280 rc 0/0 00000100:00100000:2.0:1788201512.127038:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 279 00002000:00100000:2.0:1788201512.127052:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (247463936->248512511) req@ffff9624c1e50e00 x1875064559626496/t30064771280(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:633/0 lens 488/448 e 0 to 0 dl 1788201523 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201512.127730:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e50e00 with x1875064559626496 ext(247463936->248512511) 00002000:00010000:2.0:1788201512.127739:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e50e00 00000100:00100000:0.0:1788201512.316646:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201512.316809:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559626624 00000100:00100000:1.0:1788201512.316820:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559626624 00002000:00100000:1.0:1788201512.316871:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (248512512->249561087) req@ffff962485683100 x1875064559626624/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:633/0 lens 488/0 e 0 to 0 dl 1788201523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201512.316883:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683100 with x1875064559626624 ext(248512512->249561087) 00002000:00010000:1.0:1788201512.316888:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683100 00000100:00100000:1.0:1788201512.316923:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 280 00000100:00100000:1.0:1788201512.316934:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559626624:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201512.326395:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559626624:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9451us (9751us total) trans 30064771281 rc 0/0 00000100:00100000:2.0:1788201512.326409:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 280 00002000:00100000:2.0:1788201512.326423:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (248512512->249561087) req@ffff962485683100 x1875064559626624/t30064771281(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:633/0 lens 488/448 e 0 to 0 dl 1788201523 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201512.326434:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683100 with x1875064559626624 ext(248512512->249561087) 00002000:00010000:2.0:1788201512.326440:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683100 00000100:00100000:1.0:1788201512.478415:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201512.478544:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559626752 00000100:00100000:2.0:1788201512.478556:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559626752 00002000:00100000:2.0:1788201512.478607:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (249561088->250609663) req@ffff9624c1e52680 x1875064559626752/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:633/0 lens 488/0 e 0 to 0 dl 1788201523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201512.478642:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e52680 with x1875064559626752 ext(249561088->250609663) 00002000:00010000:2.0:1788201512.478648:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e52680 00000100:00100000:2.0:1788201512.478686:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 281 00000100:00100000:2.0:1788201512.478695:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559626752:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201512.510646:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559626752:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31941us (32230us total) trans 30064771282 rc 0/0 00000100:00100000:2.0:1788201512.510661:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 281 00002000:00100000:2.0:1788201512.510676:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (249561088->250609663) req@ffff9624c1e52680 x1875064559626752/t30064771282(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:633/0 lens 488/448 e 0 to 0 dl 1788201523 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201512.510687:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e52680 with x1875064559626752 ext(249561088->250609663) 00002000:00010000:2.0:1788201512.510693:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e52680 00000100:00100000:3.0:1788201512.740739:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201512.741370:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559626880 00000100:00100000:2.0:1788201512.741382:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559626880 00002000:00100000:2.0:1788201512.741434:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (250609664->251658239) req@ffff962485aaf480 x1875064559626880/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:633/0 lens 488/0 e 0 to 0 dl 1788201523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201512.741445:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaf480 with x1875064559626880 ext(250609664->251658239) 00002000:00010000:2.0:1788201512.741461:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaf480 00000100:00100000:2.0:1788201512.741506:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 282 00000100:00100000:2.0:1788201512.741516:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559626880:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:2.0:1788201512.763073:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201512.764175:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201512.764233:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201512.764336:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559627008 00000100:00100000:2.0:1788201512.764371:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559627008 00000100:00100000:2.0:1788201512.764438:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 520 00000100:00100000:2.0:1788201512.764464:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559627008:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201512.764544:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559627008:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 83us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201512.764551:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 520 00000100:00100000:3.0:1788201512.764636:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559627136 00000100:00100000:3.0:1788201512.764641:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559627136 00000100:00100000:3.0:1788201512.764683:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 355 00000100:00100000:3.0:1788201512.764691:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559627136:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201512.764725:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559627136:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 35us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201512.764731:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 355 00000100:00080000:1.0:1788201512.764948:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201512.817398:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559626880:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 75871us (76659us total) trans 30064771283 rc 0/0 00000100:00100000:0.0:1788201512.817414:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 282 00002000:00100000:0.0:1788201512.817426:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (250609664->251658239) req@ffff962485aaf480 x1875064559626880/t30064771283(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:633/0 lens 488/448 e 0 to 0 dl 1788201523 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201512.817436:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaf480 with x1875064559626880 ext(250609664->251658239) 00002000:00010000:0.0:1788201512.817442:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaf480 00000100:00100000:2.0:1788201512.904533:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201512.904629:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559627264 00000100:00100000:3.0:1788201512.904656:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559627264 00002000:00100000:3.0:1788201512.904709:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (251658240->252706815) req@ffff9624c1e54e00 x1875064559627264/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:633/0 lens 488/0 e 0 to 0 dl 1788201523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201512.904721:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54e00 with x1875064559627264 ext(251658240->252706815) 00002000:00010000:3.0:1788201512.904726:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54e00 00000100:00100000:3.0:1788201512.904760:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 283 00000100:00100000:3.0:1788201512.904770:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559627264:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201512.937542:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559627264:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32760us (33006us total) trans 30064771284 rc 0/0 00000100:00100000:3.0:1788201512.937555:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 283 00002000:00100000:3.0:1788201512.937567:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (251658240->252706815) req@ffff9624c1e54e00 x1875064559627264/t30064771284(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:633/0 lens 488/448 e 0 to 0 dl 1788201523 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201512.937576:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54e00 with x1875064559627264 ext(251658240->252706815) 00002000:00010000:3.0:1788201512.937583:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54e00 00000100:00100000:2.0:1788201513.064408:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201513.065841:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559627392 00000100:00100000:1.0:1788201513.065853:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559627392 00002000:00100000:1.0:1788201513.065944:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (252706816->253755391) req@ffff9624c1e56680 x1875064559627392/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:634/0 lens 488/0 e 0 to 0 dl 1788201524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201513.065956:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56680 with x1875064559627392 ext(252706816->253755391) 00002000:00010000:1.0:1788201513.065979:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56680 00000100:00080000:2.0:1788201513.066075:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201513.066215:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 284 00000100:00100000:1.0:1788201513.066228:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559627392:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201513.085498:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559627392:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19261us (21090us total) trans 30064771285 rc 0/0 00000100:00100000:1.0:1788201513.085514:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 284 00002000:00100000:1.0:1788201513.085526:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (252706816->253755391) req@ffff9624c1e56680 x1875064559627392/t30064771285(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:634/0 lens 488/448 e 0 to 0 dl 1788201524 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201513.085537:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56680 with x1875064559627392 ext(252706816->253755391) 00002000:00010000:1.0:1788201513.085544:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56680 00000100:00100000:2.0:1788201513.235761:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201513.235854:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559627520 00000100:00100000:3.0:1788201513.235865:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559627520 00002000:00100000:3.0:1788201513.235925:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (253755392->254803967) req@ffff9624c1e56d80 x1875064559627520/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:634/0 lens 488/0 e 0 to 0 dl 1788201524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201513.235937:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56d80 with x1875064559627520 ext(253755392->254803967) 00002000:00010000:3.0:1788201513.235943:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56d80 00000100:00100000:3.0:1788201513.235973:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 285 00000100:00100000:3.0:1788201513.235983:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559627520:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201513.268029:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559627520:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32027us (32260us total) trans 30064771286 rc 0/0 00000100:00100000:2.0:1788201513.268048:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 285 00002000:00100000:2.0:1788201513.268067:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (253755392->254803967) req@ffff9624c1e56d80 x1875064559627520/t30064771286(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:634/0 lens 488/448 e 0 to 0 dl 1788201524 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201513.268079:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56d80 with x1875064559627520 ext(253755392->254803967) 00002000:00010000:2.0:1788201513.268086:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56d80 00000100:00100000:2.0:1788201513.388871:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201513.389708:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559627648 00000100:00100000:0.0:1788201513.389727:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559627648 00002000:00100000:0.0:1788201513.389798:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (254803968->255852543) req@ffff9624c1e55c00 x1875064559627648/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:634/0 lens 488/0 e 0 to 0 dl 1788201524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201513.389809:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55c00 with x1875064559627648 ext(254803968->255852543) 00002000:00010000:0.0:1788201513.389814:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55c00 00000100:00100000:0.0:1788201513.389851:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 286 00000100:00100000:0.0:1788201513.389860:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559627648:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201513.415915:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559627648:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26034us (27037us total) trans 30064771287 rc 0/0 00000100:00100000:3.0:1788201513.415953:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 286 00002000:00100000:3.0:1788201513.415971:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (254803968->255852543) req@ffff9624c1e55c00 x1875064559627648/t30064771287(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:634/0 lens 488/448 e 0 to 0 dl 1788201524 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201513.415985:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55c00 with x1875064559627648 ext(254803968->255852543) 00002000:00010000:3.0:1788201513.415994:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55c00 00000100:00100000:3.0:1788201513.526725:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570136064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201513.526830:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201513.527139:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570136064 00000100:00100000:0.0:1788201513.527150:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570136064 00000100:00100000:0.0:1788201513.527256:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788201513.527268:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570136064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201513.527315:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201513.527397:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570136064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201513.527412:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00010000:00080000:1.0:1788201513.527486:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e53100 x1875064570136064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201513.527507:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570136064:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201513.527843:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201513.616577:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201513.617057:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559627776 00000100:00100000:3.0:1788201513.617261:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559627776 00002000:00100000:3.0:1788201513.617370:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (255852544->256901119) req@ffff9624c1e57100 x1875064559627776/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:634/0 lens 488/0 e 0 to 0 dl 1788201524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201513.617385:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57100 with x1875064559627776 ext(255852544->256901119) 00002000:00010000:3.0:1788201513.617392:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57100 00000100:00100000:3.0:1788201513.617434:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 287 00000100:00100000:3.0:1788201513.617447:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559627776:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201513.648121:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559627776:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30665us (31549us total) trans 30064771288 rc 0/0 00000100:00100000:3.0:1788201513.648135:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 287 00002000:00100000:3.0:1788201513.648148:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (255852544->256901119) req@ffff9624c1e57100 x1875064559627776/t30064771288(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:634/0 lens 488/448 e 0 to 0 dl 1788201524 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201513.648159:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57100 with x1875064559627776 ext(255852544->256901119) 00002000:00010000:3.0:1788201513.648165:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57100 00000100:00100000:2.0:1788201513.767150:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201513.771418:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559627904 00000100:00100000:1.0:1788201513.771435:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559627904 00002000:00100000:1.0:1788201513.771502:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (256901120->257949695) req@ffff9624c1e54a80 x1875064559627904/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:634/0 lens 488/0 e 0 to 0 dl 1788201524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201513.771515:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54a80 with x1875064559627904 ext(256901120->257949695) 00002000:00010000:1.0:1788201513.771520:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54a80 00000100:00100000:1.0:1788201513.772213:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 288 00000100:00100000:1.0:1788201513.772226:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559627904:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:1.0:1788201513.782677:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201513.801272:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559627904:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29038us (34120us total) trans 30064771289 rc 0/0 00000100:00100000:2.0:1788201513.801286:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 288 00002000:00100000:2.0:1788201513.801423:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (256901120->257949695) req@ffff9624c1e54a80 x1875064559627904/t30064771289(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:634/0 lens 488/448 e 0 to 0 dl 1788201524 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201513.801435:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54a80 with x1875064559627904 ext(256901120->257949695) 00002000:00010000:2.0:1788201513.801455:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54a80 00000100:00100000:1.0:1788201513.903593:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201513.904561:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559628032 00000100:00100000:2.0:1788201513.904579:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559628032 00002000:00100000:2.0:1788201513.904646:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (257949696->258998271) req@ffff9624c1e53100 x1875064559628032/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:634/0 lens 488/0 e 0 to 0 dl 1788201524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201513.904658:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e53100 with x1875064559628032 ext(257949696->258998271) 00002000:00010000:2.0:1788201513.904664:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e53100 00000100:00100000:2.0:1788201513.904704:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 289 00000100:00100000:2.0:1788201513.904715:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559628032:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201513.925332:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559628032:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20602us (21747us total) trans 30064771290 rc 0/0 00000100:00100000:3.0:1788201513.925388:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 289 00002000:00100000:3.0:1788201513.925405:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (257949696->258998271) req@ffff9624c1e53100 x1875064559628032/t30064771290(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:634/0 lens 488/448 e 0 to 0 dl 1788201524 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201513.925418:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e53100 with x1875064559628032 ext(257949696->258998271) 00002000:00010000:3.0:1788201513.925425:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e53100 00000100:00100000:2.0:1788201514.038714:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570136448:0@lo:400:kworker.0 00000100:00100000:2.0:1788201514.038858:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201514.038976:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788201514.038986:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570136320:0@lo:400:kworker.0 00000100:00100000:0.0:1788201514.039232:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570136192:0@lo:400:kworker.0 00000100:00100000:2.0:1788201514.039260:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201514.039302:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570136832:0@lo:400:kworker.0 00000100:00100000:0.0:1788201514.039318:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201514.039446:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570136576:0@lo:400:kworker.0 00000100:00100000:2.0:1788201514.039491:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201514.041246:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570136192 00000100:00100000:3.0:1788201514.041263:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570136192 00000100:00100000:3.0:1788201514.041334:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1788201514.041362:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570136192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201514.045520:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201514.045633:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570136448 00000100:00100000:1.0:1788201514.045643:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570136448 00000100:00100000:1.0:1788201514.045709:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788201514.045721:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570136448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201514.045790:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570136448:12345-0@lo:400:kworker.0 Request processed in 73us (6938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201514.045799:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:1.0:1788201514.045820:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201514.045833:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570136320 00000100:00100000:1.0:1788201514.045837:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570136320 00000100:00100000:1.0:1788201514.045862:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570136832 00000100:00100000:1.0:1788201514.045865:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570136832 00000100:00100000:1.0:1788201514.045882:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570136576 00000100:00100000:1.0:1788201514.045885:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570136576 00000100:00100000:1.0:1788201514.045901:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788201514.045907:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570136320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201514.045957:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570136320:12345-0@lo:400:kworker.0 Request processed in 50us (6699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201514.045963:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788201514.045975:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788201514.045981:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570136832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201514.046021:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570136832:12345-0@lo:400:kworker.0 Request processed in 31us (6520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201514.046028:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788201514.046039:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788201514.046045:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570136576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201514.046104:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570136576:12345-0@lo:400:kworker.0 Request processed in 59us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201514.046111:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00080000:1.0:1788201514.046127:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201514.046161:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570136576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201514.046219:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570136704:0@lo:400:kworker.0 00000100:00100000:1.0:1788201514.046256:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201514.046427:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570136704 00000100:00100000:1.0:1788201514.046431:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570136704 00000100:00100000:1.0:1788201514.046456:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788201514.046462:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570136704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201514.046499:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570136704:12345-0@lo:400:kworker.0 Request processed in 37us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201514.046505:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00080000:1.0:1788201514.046530:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e55f80 x1875064570136704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201514.046540:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570136704:0@lo:400:kworker.0 00000100:00100000:2.0:1788201514.051517:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570136832:0@lo:400:kworker.0 00000100:00100000:2.0:1788201514.051665:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570136448:0@lo:400:kworker.0 00000100:00100000:2.0:1788201514.051696:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570136320:0@lo:400:kworker.0 00000100:00100000:3.0:1788201514.054217:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570136192:12345-0@lo:400:kworker.0 Request processed in 12838us (14882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201514.054237:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1788201514.056913:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570136192:0@lo:400:kworker.0 00000100:00100000:1.0:1788201514.069861:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201514.070020:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559628160 00000100:00100000:3.0:1788201514.070032:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559628160 00002000:00100000:3.0:1788201514.070108:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (258998272->260046847) req@ffff9624c1e51c00 x1875064559628160/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:635/0 lens 488/0 e 0 to 0 dl 1788201525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201514.070122:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e51c00 with x1875064559628160 ext(258998272->260046847) 00002000:00010000:3.0:1788201514.070130:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e51c00 00000100:00100000:3.0:1788201514.070166:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 290 00000100:00100000:3.0:1788201514.070176:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559628160:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201514.096555:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559628160:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25680us (26006us total) trans 30064771291 rc 0/0 00000100:00100000:3.0:1788201514.097021:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 290 00002000:00100000:3.0:1788201514.097060:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (258998272->260046847) req@ffff9624c1e51c00 x1875064559628160/t30064771291(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:635/0 lens 488/448 e 0 to 0 dl 1788201525 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201514.097072:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e51c00 with x1875064559628160 ext(258998272->260046847) 00002000:00010000:3.0:1788201514.097080:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e51c00 00000100:00100000:0.0:1788201514.233981:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201514.234161:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559628288 00000100:00100000:3.0:1788201514.234175:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559628288 00002000:00100000:3.0:1788201514.234250:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (260046848->261095423) req@ffff962485680a80 x1875064559628288/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:635/0 lens 488/0 e 0 to 0 dl 1788201525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201514.234262:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485680a80 with x1875064559628288 ext(260046848->261095423) 00002000:00010000:3.0:1788201514.234267:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485680a80 00000100:00100000:3.0:1788201514.234308:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 291 00000100:00100000:3.0:1788201514.234321:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559628288:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201514.249651:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559628288:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15317us (15670us total) trans 30064771292 rc 0/0 00000100:00100000:3.0:1788201514.249670:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 291 00002000:00100000:3.0:1788201514.249685:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (260046848->261095423) req@ffff962485680a80 x1875064559628288/t30064771292(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:635/0 lens 488/448 e 0 to 0 dl 1788201525 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201514.249696:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485680a80 with x1875064559628288 ext(260046848->261095423) 00002000:00010000:3.0:1788201514.249704:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485680a80 00000100:00100000:1.0:1788201514.387985:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201514.388445:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559628416 00000100:00100000:2.0:1788201514.388459:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559628416 00002000:00100000:2.0:1788201514.388528:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (261095424->262143999) req@ffff9624c1e57b80 x1875064559628416/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:635/0 lens 488/0 e 0 to 0 dl 1788201525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201514.388567:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57b80 with x1875064559628416 ext(261095424->262143999) 00002000:00010000:2.0:1788201514.388583:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57b80 00000100:00100000:2.0:1788201514.388634:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 292 00000100:00100000:2.0:1788201514.388645:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559628416:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201514.403910:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559628416:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15249us (15921us total) trans 30064771293 rc 0/0 00000100:00100000:2.0:1788201514.403930:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 292 00002000:00100000:2.0:1788201514.403950:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (261095424->262143999) req@ffff9624c1e57b80 x1875064559628416/t30064771293(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:635/0 lens 488/448 e 0 to 0 dl 1788201525 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201514.403963:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57b80 with x1875064559628416 ext(261095424->262143999) 00002000:00010000:2.0:1788201514.403973:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57b80 00000100:00100000:0.0:1788201514.495002:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201514.497737:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559628544 00000100:00100000:2.0:1788201514.497761:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559628544 00002000:00100000:2.0:1788201514.497844:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (262144000->263192575) req@ffff962485683b80 x1875064559628544/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:635/0 lens 488/0 e 0 to 0 dl 1788201525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201514.497859:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683b80 with x1875064559628544 ext(262144000->263192575) 00002000:00010000:2.0:1788201514.497990:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683b80 00000100:00100000:2.0:1788201514.498127:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 293 00000100:00100000:2.0:1788201514.498140:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559628544:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201514.518502:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559628544:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20354us (23504us total) trans 30064771294 rc 0/0 00000100:00100000:2.0:1788201514.518514:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 293 00002000:00100000:2.0:1788201514.518546:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (262144000->263192575) req@ffff962485683b80 x1875064559628544/t30064771294(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:635/0 lens 488/448 e 0 to 0 dl 1788201525 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201514.518557:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683b80 with x1875064559628544 ext(262144000->263192575) 00002000:00010000:2.0:1788201514.518563:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683b80 00000100:00100000:1.0:1788201514.656325:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201514.658677:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559628672 00000100:00100000:0.0:1788201514.658698:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559628672 00002000:00100000:0.0:1788201514.658787:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (263192576->264241151) req@ffff9624c1e57480 x1875064559628672/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:635/0 lens 488/0 e 0 to 0 dl 1788201525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201514.658800:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57480 with x1875064559628672 ext(263192576->264241151) 00002000:00010000:0.0:1788201514.658834:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57480 00000100:00100000:2.0:1788201514.658978:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 294 00000100:00100000:2.0:1788201514.659020:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559628672:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201514.672773:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559628672:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13768us (16453us total) trans 30064771295 rc 0/0 00000100:00100000:2.0:1788201514.672789:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 294 00002000:00100000:2.0:1788201514.672805:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (263192576->264241151) req@ffff9624c1e57480 x1875064559628672/t30064771295(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:635/0 lens 488/448 e 0 to 0 dl 1788201525 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201514.672817:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57480 with x1875064559628672 ext(263192576->264241151) 00002000:00010000:2.0:1788201514.672824:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57480 00010000:00010000:1.0:1788201514.806642:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201514.854726:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201514.855289:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559628800 00000100:00100000:0.0:1788201514.855304:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559628800 00002000:00100000:0.0:1788201514.855416:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (264241152->265289727) req@ffff962485aac000 x1875064559628800/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:635/0 lens 488/0 e 0 to 0 dl 1788201525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201514.855430:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aac000 with x1875064559628800 ext(264241152->265289727) 00002000:00010000:0.0:1788201514.855438:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aac000 00000100:00100000:0.0:1788201514.855519:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 295 00000100:00100000:0.0:1788201514.855532:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2342:x1875064559628800:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201514.879328:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2342:x1875064559628800:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23778us (24608us total) trans 30064771296 rc 0/0 00000100:00100000:0.0:1788201514.879367:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 295 00002000:00100000:0.0:1788201514.879384:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (264241152->265289727) req@ffff962485aac000 x1875064559628800/t30064771296(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:635/0 lens 488/448 e 0 to 0 dl 1788201525 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201514.879397:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aac000 with x1875064559628800 ext(264241152->265289727) 00002000:00010000:0.0:1788201514.879404:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aac000 00000100:00100000:1.0:1788201515.053718:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201515.053942:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559628928 00000100:00100000:0.0:1788201515.053956:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559628928 00002000:00100000:0.0:1788201515.054050:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (265289728->266338303) req@ffff9624c1e55500 x1875064559628928/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:636/0 lens 488/0 e 0 to 0 dl 1788201526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201515.054065:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55500 with x1875064559628928 ext(265289728->266338303) 00002000:00010000:0.0:1788201515.054071:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55500 00000100:00100000:0.0:1788201515.054139:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 296 00000100:00100000:0.0:1788201515.054151:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2341:x1875064559628928:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201515.054817:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201515.073685:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2341:x1875064559628928:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19520us (19975us total) trans 30064771297 rc 0/0 00000100:00100000:0.0:1788201515.073747:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 296 00002000:00100000:0.0:1788201515.073765:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (265289728->266338303) req@ffff9624c1e55500 x1875064559628928/t30064771297(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:636/0 lens 488/448 e 0 to 0 dl 1788201526 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201515.073777:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55500 with x1875064559628928 ext(265289728->266338303) 00002000:00010000:0.0:1788201515.073784:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55500 00000100:00100000:3.0:1788201515.206513:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201515.206660:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559629056 00000100:00100000:2.0:1788201515.206679:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559629056 00002000:00100000:2.0:1788201515.206755:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (266338304->267386879) req@ffff962485aace00 x1875064559629056/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:636/0 lens 488/0 e 0 to 0 dl 1788201526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201515.206767:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aace00 with x1875064559629056 ext(266338304->267386879) 00002000:00010000:2.0:1788201515.206772:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aace00 00000100:00100000:2.0:1788201515.206821:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 297 00000100:00100000:2.0:1788201515.206833:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559629056:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201515.239573:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559629056:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32725us (33061us total) trans 30064771298 rc 0/0 00000100:00100000:0.0:1788201515.239591:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 297 00002000:00100000:0.0:1788201515.239605:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (266338304->267386879) req@ffff962485aace00 x1875064559629056/t30064771298(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:636/0 lens 488/448 e 0 to 0 dl 1788201526 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201515.239617:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aace00 with x1875064559629056 ext(266338304->267386879) 00002000:00010000:0.0:1788201515.239624:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aace00 00000100:00100000:3.0:1788201515.443474:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201515.444176:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559629184 00000100:00100000:2.0:1788201515.444190:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559629184 00002000:00100000:2.0:1788201515.444812:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (267386880->268435455) req@ffff962485aae680 x1875064559629184/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:636/0 lens 488/0 e 0 to 0 dl 1788201526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201515.444829:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aae680 with x1875064559629184 ext(267386880->268435455) 00002000:00010000:2.0:1788201515.444838:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aae680 00000100:00100000:2.0:1788201515.445014:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 298 00000100:00100000:2.0:1788201515.445040:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2342:x1875064559629184:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201515.501270:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2342:x1875064559629184:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 56229us (57796us total) trans 30064771299 rc 0/0 00000100:00100000:2.0:1788201515.503734:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 298 00002000:00100000:2.0:1788201515.503759:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (267386880->268435455) req@ffff962485aae680 x1875064559629184/t30064771299(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:636/0 lens 488/448 e 0 to 0 dl 1788201526 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201515.503774:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aae680 with x1875064559629184 ext(267386880->268435455) 00002000:00010000:2.0:1788201515.503782:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aae680 00000100:00100000:1.0:1788201515.648285:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201515.648639:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559629312 00000100:00100000:0.0:1788201515.648651:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559629312 00002000:00100000:0.0:1788201515.648706:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (268435456->269484031) req@ffff9624c1e54380 x1875064559629312/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:636/0 lens 488/0 e 0 to 0 dl 1788201526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201515.648728:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54380 with x1875064559629312 ext(268435456->269484031) 00002000:00010000:0.0:1788201515.648734:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54380 00000100:00100000:0.0:1788201515.648771:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 299 00000100:00100000:0.0:1788201515.648784:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559629312:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201515.669886:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559629312:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21095us (21603us total) trans 30064771300 rc 0/0 00000100:00100000:0.0:1788201515.669916:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 299 00002000:00100000:0.0:1788201515.669929:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (268435456->269484031) req@ffff9624c1e54380 x1875064559629312/t30064771300(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:636/0 lens 488/448 e 0 to 0 dl 1788201526 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201515.669941:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54380 with x1875064559629312 ext(268435456->269484031) 00002000:00010000:0.0:1788201515.669948:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54380 00000100:00100000:3.0:1788201515.802758:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201515.802841:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559629440 00000100:00100000:0.0:1788201515.802852:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559629440 00002000:00100000:0.0:1788201515.802905:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (269484032->270532607) req@ffff962485aaed80 x1875064559629440/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:636/0 lens 488/0 e 0 to 0 dl 1788201526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201515.802916:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaed80 with x1875064559629440 ext(269484032->270532607) 00002000:00010000:0.0:1788201515.802922:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaed80 00000100:00100000:0.0:1788201515.802954:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 300 00000100:00100000:0.0:1788201515.802964:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559629440:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:2.0:1788201515.830801:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201515.835506:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559629440:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32528us (32743us total) trans 30064771301 rc 0/0 00000100:00100000:2.0:1788201515.835524:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 300 00002000:00100000:2.0:1788201515.835540:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (269484032->270532607) req@ffff962485aaed80 x1875064559629440/t30064771301(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:636/0 lens 488/448 e 0 to 0 dl 1788201526 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201515.835552:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaed80 with x1875064559629440 ext(269484032->270532607) 00002000:00010000:2.0:1788201515.835560:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaed80 00000100:00100000:3.0:1788201516.069253:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201516.070704:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559629568 00000100:00100000:2.0:1788201516.070724:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559629568 00002000:00100000:2.0:1788201516.070810:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (270532608->271581183) req@ffff962485aadc00 x1875064559629568/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:637/0 lens 488/0 e 0 to 0 dl 1788201527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201516.070841:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aadc00 with x1875064559629568 ext(270532608->271581183) 00002000:00010000:2.0:1788201516.070849:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aadc00 00000100:00100000:2.0:1788201516.070898:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 301 00000100:00100000:2.0:1788201516.070911:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2344:x1875064559629568:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201516.086755:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201516.086779:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570136960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201516.086873:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201516.088245:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570136960 00000100:00100000:3.0:1788201516.088255:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570136960 00000100:00100000:3.0:1788201516.088331:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788201516.088469:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570136960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201516.088499:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 285409280 pending 46006272 free 3616538624 avail 3614441472 00000100:00100000:3.0:1788201516.088569:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570136960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 229us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201516.088576:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788201516.088623:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570136960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201516.089909:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2344:x1875064559629568:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18992us (20660us total) trans 30064771302 rc 0/0 00000100:00100000:2.0:1788201516.089920:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 301 00002000:00100000:2.0:1788201516.089930:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (270532608->271581183) req@ffff962485aadc00 x1875064559629568/t30064771302(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:637/0 lens 488/448 e 0 to 0 dl 1788201527 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201516.089941:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aadc00 with x1875064559629568 ext(270532608->271581183) 00002000:00010000:2.0:1788201516.089947:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aadc00 00000100:00080000:0.0:1788201516.090572:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201516.205101:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201516.205464:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559629696 00000100:00100000:2.0:1788201516.205476:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559629696 00002000:00100000:2.0:1788201516.205530:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (271581184->272629759) req@ffff9624c1e55f80 x1875064559629696/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:637/0 lens 488/0 e 0 to 0 dl 1788201527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201516.205540:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55f80 with x1875064559629696 ext(271581184->272629759) 00002000:00010000:2.0:1788201516.205546:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55f80 00000100:00100000:2.0:1788201516.205596:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 302 00000100:00100000:2.0:1788201516.205606:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2343:x1875064559629696:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201516.236831:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2343:x1875064559629696:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31207us (31721us total) trans 30064771303 rc 0/0 00000100:00100000:2.0:1788201516.236861:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 302 00002000:00100000:2.0:1788201516.236895:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (271581184->272629759) req@ffff9624c1e55f80 x1875064559629696/t30064771303(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:637/0 lens 488/448 e 0 to 0 dl 1788201527 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201516.236907:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55f80 with x1875064559629696 ext(271581184->272629759) 00002000:00010000:2.0:1788201516.236916:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55f80 00000100:00100000:3.0:1788201516.404042:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201516.404294:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559629824 00000100:00100000:0.0:1788201516.404309:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559629824 00002000:00100000:0.0:1788201516.404429:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (272629760->273678335) req@ffff962485aaf100 x1875064559629824/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:637/0 lens 488/0 e 0 to 0 dl 1788201527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201516.404443:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaf100 with x1875064559629824 ext(272629760->273678335) 00002000:00010000:0.0:1788201516.404450:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaf100 00000100:00100000:0.0:1788201516.404492:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 303 00000100:00100000:0.0:1788201516.404504:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2342:x1875064559629824:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201516.425266:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2342:x1875064559629824:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20747us (21223us total) trans 30064771304 rc 0/0 00000100:00100000:3.0:1788201516.425283:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 303 00002000:00100000:3.0:1788201516.425300:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (272629760->273678335) req@ffff962485aaf100 x1875064559629824/t30064771304(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:637/0 lens 488/448 e 0 to 0 dl 1788201527 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201516.425311:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaf100 with x1875064559629824 ext(272629760->273678335) 00002000:00010000:3.0:1788201516.425319:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaf100 00000100:00100000:2.0:1788201516.666116:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201516.666760:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559629952 00000100:00100000:0.0:1788201516.666796:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559629952 00002000:00100000:0.0:1788201516.666851:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (273678336->274726911) req@ffff962485685180 x1875064559629952/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:637/0 lens 488/0 e 0 to 0 dl 1788201527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201516.666864:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485685180 with x1875064559629952 ext(273678336->274726911) 00002000:00010000:0.0:1788201516.666869:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485685180 00000100:00100000:0.0:1788201516.666894:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 304 00000100:00100000:0.0:1788201516.666903:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2344:x1875064559629952:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201516.702933:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2344:x1875064559629952:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36020us (36821us total) trans 30064771305 rc 0/0 00000100:00100000:2.0:1788201516.702948:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 304 00002000:00100000:2.0:1788201516.702962:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (273678336->274726911) req@ffff962485685180 x1875064559629952/t30064771305(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:637/0 lens 488/448 e 0 to 0 dl 1788201527 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201516.702974:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485685180 with x1875064559629952 ext(273678336->274726911) 00002000:00010000:2.0:1788201516.702981:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485685180 00000001:00080000:3.0:1788201516.798784:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771300 is committed 00000001:00080000:3.0:1788201516.798999:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771303 is committed 00000001:00080000:3.0:1788201516.801095:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771304 is committed 00000100:00100000:3.0:1788201516.828007:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201516.828429:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559630080 00000100:00100000:2.0:1788201516.828442:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559630080 00002000:00100000:2.0:1788201516.828499:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (274726912->275775487) req@ffff962485aaca80 x1875064559630080/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:637/0 lens 488/0 e 0 to 0 dl 1788201527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201516.828511:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaca80 with x1875064559630080 ext(274726912->275775487) 00002000:00010000:2.0:1788201516.828516:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaca80 00000100:00100000:2.0:1788201516.828551:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 305 00000100:00100000:2.0:1788201516.828562:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559630080:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201516.847959:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559630080:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19387us (19950us total) trans 30064771306 rc 0/0 00000100:00100000:1.0:1788201516.847973:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 305 00002000:00100000:1.0:1788201516.847987:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (274726912->275775487) req@ffff962485aaca80 x1875064559630080/t30064771306(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:637/0 lens 488/448 e 0 to 0 dl 1788201527 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201516.847999:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaca80 with x1875064559630080 ext(274726912->275775487) 00002000:00010000:1.0:1788201516.848005:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaca80 00010000:00010000:1.0:1788201516.854625:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201516.970296:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201516.970577:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559630208 00000100:00100000:2.0:1788201516.970590:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559630208 00002000:00100000:2.0:1788201516.970650:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (275775488->276824063) req@ffff962485681880 x1875064559630208/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:637/0 lens 488/0 e 0 to 0 dl 1788201527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201516.970686:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681880 with x1875064559630208 ext(275775488->276824063) 00002000:00010000:2.0:1788201516.970692:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681880 00000100:00100000:2.0:1788201516.970731:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 306 00000100:00100000:2.0:1788201516.970743:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559630208:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201516.997958:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559630208:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27208us (27662us total) trans 30064771307 rc 0/0 00000100:00100000:1.0:1788201516.997970:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 306 00002000:00100000:1.0:1788201516.997981:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (275775488->276824063) req@ffff962485681880 x1875064559630208/t30064771307(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:637/0 lens 488/448 e 0 to 0 dl 1788201527 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201516.997988:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681880 with x1875064559630208 ext(275775488->276824063) 00002000:00010000:1.0:1788201516.997993:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681880 00000100:00100000:0.0:1788201517.131531:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201517.131687:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559630336 00000100:00100000:3.0:1788201517.131703:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559630336 00002000:00100000:3.0:1788201517.133994:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (276824064->277872639) req@ffff962485682a00 x1875064559630336/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:638/0 lens 488/0 e 0 to 0 dl 1788201528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201517.134008:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485682a00 with x1875064559630336 ext(276824064->277872639) 00002000:00010000:3.0:1788201517.134033:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485682a00 00000100:00100000:3.0:1788201517.134169:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 307 00000100:00100000:3.0:1788201517.134185:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559630336:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201517.136706:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201517.149498:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559630336:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15298us (17956us total) trans 30064771308 rc 0/0 00000100:00100000:1.0:1788201517.149527:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 307 00002000:00100000:1.0:1788201517.149544:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (276824064->277872639) req@ffff962485682a00 x1875064559630336/t30064771308(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:638/0 lens 488/448 e 0 to 0 dl 1788201528 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201517.149585:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485682a00 with x1875064559630336 ext(276824064->277872639) 00002000:00010000:1.0:1788201517.149593:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485682a00 00000100:00100000:0.0:1788201517.257558:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201517.260016:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559630464 00000100:00100000:3.0:1788201517.260045:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559630464 00002000:00100000:3.0:1788201517.260132:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (277872640->278921215) req@ffff962485681180 x1875064559630464/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:638/0 lens 488/0 e 0 to 0 dl 1788201528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201517.260148:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681180 with x1875064559630464 ext(277872640->278921215) 00002000:00010000:3.0:1788201517.260156:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681180 00000100:00100000:3.0:1788201517.260298:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 308 00000100:00100000:3.0:1788201517.260310:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559630464:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201517.277800:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559630464:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17475us (20239us total) trans 30064771309 rc 0/0 00000100:00100000:3.0:1788201517.277834:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 308 00002000:00100000:3.0:1788201517.277852:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (277872640->278921215) req@ffff962485681180 x1875064559630464/t30064771309(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:638/0 lens 488/448 e 0 to 0 dl 1788201528 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201517.277865:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681180 with x1875064559630464 ext(277872640->278921215) 00002000:00010000:3.0:1788201517.277872:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681180 00000100:00100000:0.0:1788201517.449374:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201517.449505:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559630592 00000100:00100000:1.0:1788201517.449533:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559630592 00002000:00100000:1.0:1788201517.449609:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (278921216->279969791) req@ffff962485680700 x1875064559630592/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:638/0 lens 488/0 e 0 to 0 dl 1788201528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201517.449623:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485680700 with x1875064559630592 ext(278921216->279969791) 00002000:00010000:1.0:1788201517.449630:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485680700 00000100:00100000:1.0:1788201517.449677:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 309 00000100:00100000:1.0:1788201517.449688:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559630592:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201517.471915:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559630592:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22210us (22560us total) trans 30064771310 rc 0/0 00000100:00100000:1.0:1788201517.471936:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 309 00002000:00100000:1.0:1788201517.471953:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (278921216->279969791) req@ffff962485680700 x1875064559630592/t30064771310(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:638/0 lens 488/448 e 0 to 0 dl 1788201528 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201517.471966:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485680700 with x1875064559630592 ext(278921216->279969791) 00002000:00010000:1.0:1788201517.471974:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485680700 00000100:00100000:2.0:1788201517.569648:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201517.569827:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559630720 00000100:00100000:1.0:1788201517.569839:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559630720 00002000:00100000:1.0:1788201517.569897:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (279969792->281018367) req@ffff962485684700 x1875064559630720/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:638/0 lens 488/0 e 0 to 0 dl 1788201528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201517.569909:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684700 with x1875064559630720 ext(279969792->281018367) 00002000:00010000:1.0:1788201517.569915:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684700 00000100:00100000:1.0:1788201517.569970:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 310 00000100:00100000:1.0:1788201517.569981:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559630720:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201517.578447:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559630720:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8454us (8796us total) trans 30064771311 rc 0/0 00000100:00100000:1.0:1788201517.578463:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 310 00002000:00100000:1.0:1788201517.578477:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (279969792->281018367) req@ffff962485684700 x1875064559630720/t30064771311(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:638/0 lens 488/448 e 0 to 0 dl 1788201528 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201517.578489:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684700 with x1875064559630720 ext(279969792->281018367) 00002000:00010000:1.0:1788201517.578495:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684700 00000100:00100000:2.0:1788201517.663570:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201517.663710:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559630848 00000100:00100000:3.0:1788201517.663721:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559630848 00002000:00100000:3.0:1788201517.663772:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (281018368->282066943) req@ffff962485686300 x1875064559630848/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:638/0 lens 488/0 e 0 to 0 dl 1788201528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201517.663783:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485686300 with x1875064559630848 ext(281018368->282066943) 00002000:00010000:3.0:1788201517.663788:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485686300 00000100:00100000:3.0:1788201517.663836:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 311 00000100:00100000:3.0:1788201517.663845:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559630848:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201517.691794:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559630848:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27939us (28225us total) trans 30064771312 rc 0/0 00000100:00100000:1.0:1788201517.691807:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 311 00002000:00100000:1.0:1788201517.691835:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (281018368->282066943) req@ffff962485686300 x1875064559630848/t30064771312(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:638/0 lens 488/448 e 0 to 0 dl 1788201528 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201517.691857:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485686300 with x1875064559630848 ext(281018368->282066943) 00002000:00010000:1.0:1788201517.691863:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485686300 00000100:00100000:2.0:1788201517.832136:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201517.832237:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559630976 00000100:00100000:3.0:1788201517.832248:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559630976 00002000:00100000:3.0:1788201517.832319:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (282066944->283115519) req@ffff962485685500 x1875064559630976/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:638/0 lens 488/0 e 0 to 0 dl 1788201528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201517.832329:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485685500 with x1875064559630976 ext(282066944->283115519) 00002000:00010000:3.0:1788201517.832335:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485685500 00000100:00100000:3.0:1788201517.832401:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 312 00000100:00100000:3.0:1788201517.832411:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559630976:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201517.860219:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559630976:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27796us (28081us total) trans 30064771313 rc 0/0 00000100:00100000:3.0:1788201517.860235:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 312 00002000:00100000:3.0:1788201517.860249:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (282066944->283115519) req@ffff962485685500 x1875064559630976/t30064771313(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:638/0 lens 488/448 e 0 to 0 dl 1788201528 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201517.860260:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485685500 with x1875064559630976 ext(282066944->283115519) 00002000:00010000:3.0:1788201517.860266:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485685500 00010000:00010000:1.0:1788201517.879907:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201517.882712:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201517.882825:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201517.882987:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559631104 00000100:00100000:3.0:1788201517.883004:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559631104 00000100:00100000:3.0:1788201517.883179:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 522 00000100:00100000:3.0:1788201517.883193:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559631104:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201517.883267:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559631232 00000100:00100000:1.0:1788201517.883278:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559631232 00000100:00100000:3.0:1788201517.883306:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559631104:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 114us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.883330:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 522 00000100:00100000:1.0:1788201517.883398:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 359 00000100:00100000:1.0:1788201517.883415:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559631232:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201517.883496:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559631232:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 87us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.883517:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 359 00000100:00080000:1.0:1788201517.883715:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201518.057588:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201518.057708:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559631360 00000100:00100000:1.0:1788201518.057719:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559631360 00002000:00100000:1.0:1788201518.057779:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (283115520->284164095) req@ffff962485684380 x1875064559631360/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:639/0 lens 488/0 e 0 to 0 dl 1788201529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201518.057791:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684380 with x1875064559631360 ext(283115520->284164095) 00002000:00010000:1.0:1788201518.057798:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684380 00000100:00100000:1.0:1788201518.057856:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 313 00000100:00100000:1.0:1788201518.057866:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559631360:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201518.069312:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559631360:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11434us (11720us total) trans 30064771314 rc 0/0 00000100:00100000:1.0:1788201518.069328:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 313 00002000:00100000:1.0:1788201518.069355:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (283115520->284164095) req@ffff962485684380 x1875064559631360/t30064771314(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:639/0 lens 488/448 e 0 to 0 dl 1788201529 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201518.069366:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684380 with x1875064559631360 ext(283115520->284164095) 00002000:00010000:1.0:1788201518.069372:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684380 00000100:00100000:0.0:1788201518.235677:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201518.235783:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559631488 00000100:00100000:1.0:1788201518.235794:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559631488 00002000:00100000:1.0:1788201518.235853:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (284164096->285212671) req@ffff962485681500 x1875064559631488/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:639/0 lens 488/0 e 0 to 0 dl 1788201529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201518.235872:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681500 with x1875064559631488 ext(284164096->285212671) 00002000:00010000:1.0:1788201518.235877:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681500 00000100:00100000:1.0:1788201518.235906:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 314 00000100:00100000:1.0:1788201518.235915:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559631488:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201518.273674:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559631488:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37749us (37996us total) trans 30064771315 rc 0/0 00000100:00100000:1.0:1788201518.273689:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 314 00002000:00100000:1.0:1788201518.273703:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (284164096->285212671) req@ffff962485681500 x1875064559631488/t30064771315(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:639/0 lens 488/448 e 0 to 0 dl 1788201529 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201518.273714:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681500 with x1875064559631488 ext(284164096->285212671) 00002000:00010000:1.0:1788201518.273720:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681500 00000100:00100000:2.0:1788201518.418032:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201518.418170:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559631616 00000100:00100000:1.0:1788201518.418183:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559631616 00002000:00100000:1.0:1788201518.418245:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (285212672->286261247) req@ffff962485685f80 x1875064559631616/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:639/0 lens 488/0 e 0 to 0 dl 1788201529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201518.418256:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485685f80 with x1875064559631616 ext(285212672->286261247) 00002000:00010000:1.0:1788201518.418263:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485685f80 00000100:00100000:1.0:1788201518.419556:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 315 00000100:00100000:1.0:1788201518.419576:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559631616:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201518.473543:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559631616:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 53960us (55514us total) trans 30064771316 rc 0/0 00000100:00100000:1.0:1788201518.473562:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 315 00002000:00100000:1.0:1788201518.473593:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (285212672->286261247) req@ffff962485685f80 x1875064559631616/t30064771316(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:639/0 lens 488/448 e 0 to 0 dl 1788201529 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201518.473605:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485685f80 with x1875064559631616 ext(285212672->286261247) 00002000:00010000:1.0:1788201518.473613:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485685f80 00000100:00100000:3.0:1788201518.600307:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201518.600639:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559631744 00000100:00100000:0.0:1788201518.600651:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559631744 00002000:00100000:0.0:1788201518.600719:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (286261248->287309823) req@ffff962485aafb80 x1875064559631744/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:639/0 lens 488/0 e 0 to 0 dl 1788201529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201518.600732:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aafb80 with x1875064559631744 ext(286261248->287309823) 00002000:00010000:0.0:1788201518.600739:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aafb80 00000100:00100000:0.0:1788201518.600769:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 316 00000100:00100000:0.0:1788201518.600781:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559631744:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201518.617121:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559631744:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16328us (16816us total) trans 30064771317 rc 0/0 00000100:00100000:1.0:1788201518.617150:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 316 00002000:00100000:1.0:1788201518.617164:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (286261248->287309823) req@ffff962485aafb80 x1875064559631744/t30064771317(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:639/0 lens 488/448 e 0 to 0 dl 1788201529 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201518.617175:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aafb80 with x1875064559631744 ext(286261248->287309823) 00002000:00010000:1.0:1788201518.617182:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aafb80 00000100:00100000:3.0:1788201518.646638:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201518.646675:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cc95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570137088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201518.646767:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201518.647183:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570137088 00000100:00100000:0.0:1788201518.647193:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570137088 00000100:00100000:0.0:1788201518.647290:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788201518.647302:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570137088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201518.647387:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201518.647453:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570137088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201518.647461:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00010000:00080000:3.0:1788201518.647492:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248cc95880 x1875064570137088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201518.647527:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cc95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570137088:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201518.647622:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201518.684465:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201518.684582:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559631872 00000100:00100000:2.0:1788201518.684594:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559631872 00002000:00100000:2.0:1788201518.684669:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (287309824->288358399) req@ffff962485aaea00 x1875064559631872/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:639/0 lens 488/0 e 0 to 0 dl 1788201529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201518.684682:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaea00 with x1875064559631872 ext(287309824->288358399) 00002000:00010000:2.0:1788201518.684689:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaea00 00000100:00100000:2.0:1788201518.684735:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 317 00000100:00100000:2.0:1788201518.684747:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559631872:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201518.713754:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559631872:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28990us (29282us total) trans 30064771318 rc 0/0 00000100:00100000:2.0:1788201518.713773:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 317 00002000:00100000:2.0:1788201518.713791:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (287309824->288358399) req@ffff962485aaea00 x1875064559631872/t30064771318(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:639/0 lens 488/448 e 0 to 0 dl 1788201529 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201518.713803:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaea00 with x1875064559631872 ext(287309824->288358399) 00002000:00010000:2.0:1788201518.713828:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaea00 00000100:00100000:3.0:1788201518.841971:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201518.848166:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559632000 00000100:00100000:1.0:1788201518.848184:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559632000 00002000:00100000:1.0:1788201518.848251:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (288358400->289406975) req@ffff962485aad180 x1875064559632000/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:639/0 lens 488/0 e 0 to 0 dl 1788201529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201518.848261:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aad180 with x1875064559632000 ext(288358400->289406975) 00002000:00010000:1.0:1788201518.848267:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aad180 00000100:00100000:1.0:1788201518.848309:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 318 00000100:00100000:1.0:1788201518.848318:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559632000:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201518.861604:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559632000:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13272us (19630us total) trans 30064771319 rc 0/0 00000100:00100000:1.0:1788201518.861618:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 318 00002000:00100000:1.0:1788201518.861632:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (288358400->289406975) req@ffff962485aad180 x1875064559632000/t30064771319(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:639/0 lens 488/448 e 0 to 0 dl 1788201529 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201518.861644:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aad180 with x1875064559632000 ext(288358400->289406975) 00002000:00010000:1.0:1788201518.861649:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aad180 00010000:00010000:2.0:1788201518.902567:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201519.039630:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201519.039730:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559632128 00000100:00100000:1.0:1788201519.039742:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559632128 00000100:00080000:0.0:1788201519.039835:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1788201519.039843:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (289406976->290455551) req@ffff962485aac700 x1875064559632128/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:640/0 lens 488/0 e 0 to 0 dl 1788201530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201519.039855:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aac700 with x1875064559632128 ext(289406976->290455551) 00002000:00010000:1.0:1788201519.039861:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aac700 00000100:00100000:1.0:1788201519.039896:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 319 00000100:00100000:1.0:1788201519.039907:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559632128:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201519.053460:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559632128:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13540us (13827us total) trans 30064771320 rc 0/0 00000100:00100000:1.0:1788201519.053479:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 319 00002000:00100000:1.0:1788201519.053507:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (289406976->290455551) req@ffff962485aac700 x1875064559632128/t30064771320(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:640/0 lens 488/448 e 0 to 0 dl 1788201530 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201519.053520:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aac700 with x1875064559632128 ext(289406976->290455551) 00002000:00010000:1.0:1788201519.053526:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aac700 00000100:00100000:0.0:1788201519.159131:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570137216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201519.159215:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201519.159324:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201519.159333:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570137344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201519.159387:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201519.159434:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570137216 00000100:00100000:0.0:1788201519.159443:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570137216 00000100:00100000:0.0:1788201519.159494:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1788201519.159504:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570137216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201519.159554:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570137216:12345-0@lo:400:kworker.0 Request processed in 51us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201519.159561:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1788201519.159629:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570137216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201519.159933:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570137472:0@lo:400:kworker.0 00000100:00100000:0.0:1788201519.159965:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201519.160176:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570137600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201519.160207:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201519.160227:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201519.160233:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570137728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201519.160253:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201519.160525:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570137856:0@lo:400:kworker.0 00000100:00100000:0.0:1788201519.160553:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201519.161193:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570137344 00000100:00100000:1.0:1788201519.161203:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570137344 00000100:00100000:1.0:1788201519.161263:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570137600 00000100:00100000:1.0:1788201519.161267:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570137600 00000100:00100000:1.0:1788201519.161303:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570137856 00000100:00100000:1.0:1788201519.161306:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570137856 00000100:00100000:1.0:1788201519.161321:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788201519.161330:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570137344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201519.161407:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570137344:12345-0@lo:400:kworker.0 Request processed in 77us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201519.161413:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788201519.161429:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788201519.161435:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570137600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201519.165526:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570137472 00000100:00100000:2.0:1788201519.165543:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570137472 00000100:00100000:2.0:1788201519.167502:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570137728 00000100:00100000:2.0:1788201519.167518:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570137728 00000100:00100000:2.0:1788201519.167545:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788201519.167553:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570137472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201519.167661:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570137472:12345-0@lo:400:kworker.0 Request processed in 109us (7696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201519.167666:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788201519.167679:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788201519.167683:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570137728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201519.174175:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788201519.174222:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570137856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201519.174929:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570137856:12345-0@lo:400:kworker.0 Request processed in 718us (14372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201519.174939:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788201519.175112:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570137856:0@lo:400:kworker.0 00000100:00080000:0.0:1788201519.175156:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201519.175160:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201519.175361:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570137600:12345-0@lo:400:kworker.0 Request processed in 13923us (15150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201519.175369:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788201519.177316:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570137728:12345-0@lo:400:kworker.0 Request processed in 9623us (17052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201519.177331:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00010000:00080000:0.0:1788201519.178641:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e71f80 x1875064570137728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201519.178656:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570137728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201519.178667:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570137600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201519.179120:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570137472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201519.179135:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570137344:0@lo:400:kworker.0 00000100:00100000:3.0:1788201519.228250:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201519.228604:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559632256 00000100:00100000:1.0:1788201519.228616:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559632256 00002000:00100000:1.0:1788201519.228679:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (290455552->291504127) req@ffff9624c1e70e00 x1875064559632256/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:640/0 lens 488/0 e 0 to 0 dl 1788201530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201519.228691:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70e00 with x1875064559632256 ext(290455552->291504127) 00002000:00010000:1.0:1788201519.228697:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70e00 00000100:00100000:1.0:1788201519.228810:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 320 00000100:00100000:1.0:1788201519.228823:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559632256:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201519.242960:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559632256:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14129us (14775us total) trans 30064771321 rc 0/0 00000100:00100000:1.0:1788201519.242976:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 320 00002000:00100000:1.0:1788201519.242989:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (290455552->291504127) req@ffff9624c1e70e00 x1875064559632256/t30064771321(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:640/0 lens 488/448 e 0 to 0 dl 1788201530 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201519.243009:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70e00 with x1875064559632256 ext(290455552->291504127) 00002000:00010000:1.0:1788201519.243016:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70e00 00000100:00100000:3.0:1788201519.427265:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201519.427438:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559632384 00000100:00100000:2.0:1788201519.427448:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559632384 00002000:00100000:2.0:1788201519.427507:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (291504128->292552703) req@ffff9624c1e72680 x1875064559632384/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:640/0 lens 488/0 e 0 to 0 dl 1788201530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201519.427517:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72680 with x1875064559632384 ext(291504128->292552703) 00002000:00010000:2.0:1788201519.427523:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72680 00000100:00100000:2.0:1788201519.427562:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 321 00000100:00100000:2.0:1788201519.427572:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2342:x1875064559632384:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201519.446390:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2342:x1875064559632384:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18805us (19122us total) trans 30064771322 rc 0/0 00000100:00100000:1.0:1788201519.446405:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 321 00002000:00100000:1.0:1788201519.446420:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (291504128->292552703) req@ffff9624c1e72680 x1875064559632384/t30064771322(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:640/0 lens 488/448 e 0 to 0 dl 1788201530 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201519.446456:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72680 with x1875064559632384 ext(291504128->292552703) 00002000:00010000:1.0:1788201519.446463:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72680 00000100:00100000:2.0:1788201519.604051:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201519.604174:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559632512 00000100:00100000:1.0:1788201519.604186:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559632512 00002000:00100000:1.0:1788201519.604242:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (292552704->293601279) req@ffff962485687480 x1875064559632512/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:640/0 lens 488/0 e 0 to 0 dl 1788201530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201519.604254:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485687480 with x1875064559632512 ext(292552704->293601279) 00002000:00010000:1.0:1788201519.604260:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485687480 00000100:00100000:1.0:1788201519.604296:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 322 00000100:00100000:1.0:1788201519.604307:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559632512:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201519.614959:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559632512:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10642us (10909us total) trans 30064771323 rc 0/0 00000100:00100000:1.0:1788201519.614973:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 322 00002000:00100000:1.0:1788201519.614987:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (292552704->293601279) req@ffff962485687480 x1875064559632512/t30064771323(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:640/0 lens 488/448 e 0 to 0 dl 1788201530 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201519.615006:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485687480 with x1875064559632512 ext(292552704->293601279) 00002000:00010000:1.0:1788201519.615013:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485687480 00000100:00100000:0.0:1788201519.873184:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201519.875933:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559632640 00000100:00100000:1.0:1788201519.875952:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559632640 00002000:00100000:1.0:1788201519.876038:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (293601280->294649855) req@ffff962485683800 x1875064559632640/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:640/0 lens 488/0 e 0 to 0 dl 1788201530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201519.876051:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683800 with x1875064559632640 ext(293601280->294649855) 00002000:00010000:1.0:1788201519.876060:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683800 00000100:00100000:1.0:1788201519.876267:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 323 00000100:00100000:1.0:1788201519.876278:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559632640:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201519.890662:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559632640:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14374us (17480us total) trans 30064771324 rc 0/0 00000100:00100000:1.0:1788201519.890677:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 323 00002000:00100000:1.0:1788201519.890691:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (293601280->294649855) req@ffff962485683800 x1875064559632640/t30064771324(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:640/0 lens 488/448 e 0 to 0 dl 1788201530 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201519.890703:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683800 with x1875064559632640 ext(293601280->294649855) 00002000:00010000:1.0:1788201519.890710:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683800 00010000:00010000:1.0:1788201519.927260:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201520.057259:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201520.065333:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559632768 00000100:00100000:3.0:1788201520.065378:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559632768 00002000:00100000:3.0:1788201520.065446:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (294649856->295698431) req@ffff962485687800 x1875064559632768/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:641/0 lens 488/0 e 0 to 0 dl 1788201531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201520.065458:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485687800 with x1875064559632768 ext(294649856->295698431) 00002000:00010000:3.0:1788201520.065478:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485687800 00000100:00100000:3.0:1788201520.065533:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 324 00000100:00100000:3.0:1788201520.065544:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2341:x1875064559632768:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201520.085898:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2341:x1875064559632768:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20341us (28634us total) trans 30064771325 rc 0/0 00000100:00100000:3.0:1788201520.085916:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 324 00002000:00100000:3.0:1788201520.085933:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (294649856->295698431) req@ffff962485687800 x1875064559632768/t30064771325(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:641/0 lens 488/448 e 0 to 0 dl 1788201531 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201520.085944:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485687800 with x1875064559632768 ext(294649856->295698431) 00002000:00010000:3.0:1788201520.085951:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485687800 00000100:00100000:0.0:1788201520.239462:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201520.239602:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559632896 00000100:00100000:2.0:1788201520.239615:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559632896 00002000:00100000:2.0:1788201520.239674:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (295698432->296747007) req@ffff962485680000 x1875064559632896/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:641/0 lens 488/0 e 0 to 0 dl 1788201531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201520.239687:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485680000 with x1875064559632896 ext(295698432->296747007) 00002000:00010000:2.0:1788201520.239693:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485680000 00000100:00100000:2.0:1788201520.239732:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 325 00000100:00100000:2.0:1788201520.239744:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2342:x1875064559632896:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201520.256844:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559632896:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17091us (17384us total) trans 30064771326 rc 0/0 00000100:00100000:1.0:1788201520.256855:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 325 00002000:00100000:1.0:1788201520.256869:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (295698432->296747007) req@ffff962485680000 x1875064559632896/t30064771326(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:641/0 lens 488/448 e 0 to 0 dl 1788201531 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201520.256880:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485680000 with x1875064559632896 ext(295698432->296747007) 00002000:00010000:1.0:1788201520.256887:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485680000 00000100:00100000:3.0:1788201520.450841:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201520.450919:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559633024 00000100:00100000:1.0:1788201520.450938:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559633024 00002000:00100000:1.0:1788201520.451717:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (296747008->297795583) req@ffff9624c1e72d80 x1875064559633024/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:641/0 lens 488/0 e 0 to 0 dl 1788201531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201520.451730:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72d80 with x1875064559633024 ext(296747008->297795583) 00002000:00010000:1.0:1788201520.451737:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72d80 00000100:00100000:1.0:1788201520.451861:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 326 00000100:00100000:1.0:1788201520.451889:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2341:x1875064559633024:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201520.483094:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2341:x1875064559633024:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31196us (32253us total) trans 30064771327 rc 0/0 00000100:00100000:1.0:1788201520.483111:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 326 00002000:00100000:1.0:1788201520.483125:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (296747008->297795583) req@ffff9624c1e72d80 x1875064559633024/t30064771327(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:641/0 lens 488/448 e 0 to 0 dl 1788201531 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201520.483137:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72d80 with x1875064559633024 ext(296747008->297795583) 00002000:00010000:1.0:1788201520.483143:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72d80 00000100:00100000:3.0:1788201520.668313:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201520.668492:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559633152 00000100:00100000:1.0:1788201520.668504:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559633152 00002000:00100000:1.0:1788201520.668557:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (297795584->298844159) req@ffff9624c1e71c00 x1875064559633152/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:641/0 lens 488/0 e 0 to 0 dl 1788201531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201520.668568:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71c00 with x1875064559633152 ext(297795584->298844159) 00002000:00010000:1.0:1788201520.668573:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71c00 00000100:00100000:1.0:1788201520.668612:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 327 00000100:00100000:1.0:1788201520.668621:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559633152:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201520.693903:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559633152:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25267us (25585us total) trans 30064771328 rc 0/0 00000100:00100000:1.0:1788201520.693919:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 327 00002000:00100000:1.0:1788201520.693936:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (297795584->298844159) req@ffff9624c1e71c00 x1875064559633152/t30064771328(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:641/0 lens 488/448 e 0 to 0 dl 1788201531 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201520.693949:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71c00 with x1875064559633152 ext(297795584->298844159) 00002000:00010000:1.0:1788201520.693956:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71c00 00000100:00100000:2.0:1788201520.893468:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201520.893564:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559633280 00000100:00100000:3.0:1788201520.893576:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559633280 00002000:00100000:3.0:1788201520.893632:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (298844160->299892735) req@ffff962485684000 x1875064559633280/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:641/0 lens 488/0 e 0 to 0 dl 1788201531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201520.893644:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684000 with x1875064559633280 ext(298844160->299892735) 00002000:00010000:3.0:1788201520.893650:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684000 00000100:00100000:3.0:1788201520.893688:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 328 00000100:00100000:3.0:1788201520.893698:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559633280:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201520.934261:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559633280:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 40547us (40798us total) trans 30064771329 rc 0/0 00000100:00100000:1.0:1788201520.934279:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 328 00002000:00100000:1.0:1788201520.934295:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (298844160->299892735) req@ffff962485684000 x1875064559633280/t30064771329(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:641/0 lens 488/448 e 0 to 0 dl 1788201531 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201520.934307:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684000 with x1875064559633280 ext(298844160->299892735) 00002000:00010000:1.0:1788201520.934314:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684000 00010000:00010000:1.0:1788201520.953849:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201521.102765:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201521.102917:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559633408 00000100:00100000:2.0:1788201521.102931:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559633408 00002000:00100000:2.0:1788201521.103022:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (299892736->300941311) req@ffff962485680e00 x1875064559633408/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:642/0 lens 488/0 e 0 to 0 dl 1788201532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201521.103035:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485680e00 with x1875064559633408 ext(299892736->300941311) 00002000:00010000:2.0:1788201521.103042:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485680e00 00000100:00100000:2.0:1788201521.103095:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 329 00000100:00100000:2.0:1788201521.103106:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559633408:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201521.104401:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201521.122917:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2342:x1875064559633408:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19801us (20167us total) trans 30064771330 rc 0/0 00000100:00100000:2.0:1788201521.122932:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 329 00002000:00100000:2.0:1788201521.122946:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (299892736->300941311) req@ffff962485680e00 x1875064559633408/t30064771330(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:642/0 lens 488/448 e 0 to 0 dl 1788201532 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201521.122957:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485680e00 with x1875064559633408 ext(299892736->300941311) 00002000:00010000:2.0:1788201521.122963:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485680e00 00000100:00100000:0.0:1788201521.206830:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201521.206855:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cc96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570137984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201521.206952:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201521.207141:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570137984 00000100:00100000:1.0:1788201521.207151:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570137984 00000100:00100000:1.0:1788201521.207226:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788201521.207237:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e3ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570137984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201521.207261:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 331415552 pending 44302336 free 3586129920 avail 3584032768 00000100:00100000:1.0:1788201521.207315:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e3ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570137984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201521.207324:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788201521.207651:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cc96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570137984:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201521.207760:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201521.310857:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201521.311073:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559633536 00000100:00100000:1.0:1788201521.311086:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559633536 00002000:00100000:1.0:1788201521.311144:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (300941312->301989887) req@ffff9624c1e73100 x1875064559633536/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:642/0 lens 488/0 e 0 to 0 dl 1788201532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201521.311156:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73100 with x1875064559633536 ext(300941312->301989887) 00002000:00010000:1.0:1788201521.311163:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73100 00000100:00100000:1.0:1788201521.311203:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 330 00000100:00100000:1.0:1788201521.311214:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2341:x1875064559633536:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201521.339175:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2341:x1875064559633536:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27949us (28317us total) trans 30064771331 rc 0/0 00000100:00100000:1.0:1788201521.339190:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 330 00002000:00100000:1.0:1788201521.339205:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (300941312->301989887) req@ffff9624c1e73100 x1875064559633536/t30064771331(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:642/0 lens 488/448 e 0 to 0 dl 1788201532 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201521.339218:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73100 with x1875064559633536 ext(300941312->301989887) 00002000:00010000:1.0:1788201521.339224:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73100 00000100:00100000:3.0:1788201521.513820:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201521.517655:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559633664 00000100:00100000:1.0:1788201521.517672:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559633664 00002000:00100000:1.0:1788201521.520466:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (301989888->303038463) req@ffff9624c1e70a80 x1875064559633664/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:642/0 lens 488/0 e 0 to 0 dl 1788201532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201521.520482:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70a80 with x1875064559633664 ext(301989888->303038463) 00002000:00010000:1.0:1788201521.520490:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70a80 00000100:00100000:1.0:1788201521.520615:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 331 00000100:00100000:1.0:1788201521.520633:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2342:x1875064559633664:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201521.551086:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2342:x1875064559633664:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30446us (37263us total) trans 30064771332 rc 0/0 00000100:00100000:3.0:1788201521.551101:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 331 00002000:00100000:3.0:1788201521.551132:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (301989888->303038463) req@ffff9624c1e70a80 x1875064559633664/t30064771332(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:642/0 lens 488/448 e 0 to 0 dl 1788201532 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201521.551144:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70a80 with x1875064559633664 ext(301989888->303038463) 00002000:00010000:3.0:1788201521.551152:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70a80 00000100:00100000:3.0:1788201521.726160:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201521.729128:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559633792 00000100:00100000:1.0:1788201521.729146:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559633792 00002000:00100000:1.0:1788201521.729211:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (303038464->304087039) req@ffff9624c1e73b80 x1875064559633792/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:642/0 lens 488/0 e 0 to 0 dl 1788201532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201521.729223:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73b80 with x1875064559633792 ext(303038464->304087039) 00002000:00010000:1.0:1788201521.729229:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73b80 00000100:00100000:1.0:1788201521.729276:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 332 00000100:00100000:1.0:1788201521.729286:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2341:x1875064559633792:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201521.768979:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2341:x1875064559633792:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39671us (42807us total) trans 30064771333 rc 0/0 00000100:00100000:0.0:1788201521.768997:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 332 00002000:00100000:0.0:1788201521.769016:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (303038464->304087039) req@ffff9624c1e73b80 x1875064559633792/t30064771333(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:642/0 lens 488/448 e 0 to 0 dl 1788201532 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201521.769028:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73b80 with x1875064559633792 ext(303038464->304087039) 00002000:00010000:0.0:1788201521.769044:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73b80 00000001:00080000:3.0:1788201521.854259:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771331 is committed 00000001:00080000:3.0:1788201521.854399:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771332 is committed 00010000:00010000:2.0:1788201521.974564:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201521.983520:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201521.986034:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559633920 00000100:00100000:1.0:1788201521.986050:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559633920 00002000:00100000:1.0:1788201521.986125:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (304087040->305135615) req@ffff962485684e00 x1875064559633920/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:642/0 lens 488/0 e 0 to 0 dl 1788201532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201521.986136:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684e00 with x1875064559633920 ext(304087040->305135615) 00002000:00010000:1.0:1788201521.986142:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684e00 00000100:00100000:1.0:1788201521.986253:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 333 00000100:00100000:1.0:1788201521.986275:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559633920:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201522.025462:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559633920:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39177us (41939us total) trans 30064771334 rc 0/0 00000100:00100000:3.0:1788201522.025479:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 333 00002000:00100000:3.0:1788201522.025494:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (304087040->305135615) req@ffff962485684e00 x1875064559633920/t30064771334(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:642/0 lens 488/448 e 0 to 0 dl 1788201532 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201522.025506:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684e00 with x1875064559633920 ext(304087040->305135615) 00002000:00010000:3.0:1788201522.025513:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684e00 00000100:00100000:2.0:1788201522.255273:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201522.255486:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559634048 00000100:00100000:3.0:1788201522.255498:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559634048 00002000:00100000:3.0:1788201522.255558:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (305135616->306184191) req@ffff962485686680 x1875064559634048/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:643/0 lens 488/0 e 0 to 0 dl 1788201533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201522.255569:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485686680 with x1875064559634048 ext(305135616->306184191) 00002000:00010000:3.0:1788201522.255575:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485686680 00000100:00100000:3.0:1788201522.255614:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 334 00000100:00100000:3.0:1788201522.255626:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559634048:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201522.278118:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559634048:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22478us (22842us total) trans 30064771335 rc 0/0 00000100:00100000:3.0:1788201522.278172:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 334 00002000:00100000:3.0:1788201522.278187:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (305135616->306184191) req@ffff962485686680 x1875064559634048/t30064771335(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:643/0 lens 488/448 e 0 to 0 dl 1788201533 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201522.278197:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485686680 with x1875064559634048 ext(305135616->306184191) 00002000:00010000:3.0:1788201522.278204:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485686680 00000100:00100000:2.0:1788201522.504701:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201522.505376:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559634176 00000100:00100000:3.0:1788201522.505391:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559634176 00002000:00100000:3.0:1788201522.505455:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (306184192->307232767) req@ffff962485686d80 x1875064559634176/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:643/0 lens 488/0 e 0 to 0 dl 1788201533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201522.505468:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485686d80 with x1875064559634176 ext(306184192->307232767) 00002000:00010000:3.0:1788201522.505475:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485686d80 00000100:00100000:3.0:1788201522.505513:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 335 00000100:00100000:3.0:1788201522.505523:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559634176:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201522.568971:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559634176:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 63423us (64255us total) trans 30064771336 rc 0/0 00000100:00100000:2.0:1788201522.568991:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 335 00002000:00100000:2.0:1788201522.569007:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (306184192->307232767) req@ffff962485686d80 x1875064559634176/t30064771336(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:643/0 lens 488/448 e 0 to 0 dl 1788201533 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201522.569020:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485686d80 with x1875064559634176 ext(306184192->307232767) 00002000:00010000:2.0:1788201522.569029:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485686d80 00000100:00100000:1.0:1788201522.738455:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201522.738570:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559634304 00000100:00100000:0.0:1788201522.738589:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559634304 00002000:00100000:0.0:1788201522.738689:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (307232768->308281343) req@ffff96248cc96a00 x1875064559634304/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:643/0 lens 488/0 e 0 to 0 dl 1788201533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201522.738703:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc96a00 with x1875064559634304 ext(307232768->308281343) 00002000:00010000:0.0:1788201522.738711:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc96a00 00000100:00100000:0.0:1788201522.738762:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 336 00000100:00100000:0.0:1788201522.738775:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559634304:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201522.760976:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559634304:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22192us (22522us total) trans 30064771337 rc 0/0 00000100:00100000:0.0:1788201522.760990:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 336 00002000:00100000:0.0:1788201522.761004:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (307232768->308281343) req@ffff96248cc96a00 x1875064559634304/t30064771337(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:643/0 lens 488/448 e 0 to 0 dl 1788201533 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201522.761015:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc96a00 with x1875064559634304 ext(307232768->308281343) 00002000:00010000:0.0:1788201522.761022:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc96a00 00000100:00100000:2.0:1788201522.993844:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201522.993900:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201522.994002:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559634688 00000100:00100000:0.0:1788201522.994014:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559634688 00000100:00100000:0.0:1788201522.994103:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 363 00000100:00100000:0.0:1788201522.994115:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559634688:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201522.994201:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559634688:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201522.994209:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 363 00000100:00080000:1.0:1788201522.994281:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201522.994384:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559634560 00000100:00100000:3.0:1788201522.994390:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559634560 00000100:00100000:3.0:1788201522.994474:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 524 00000100:00100000:3.0:1788201522.994482:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559634560:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201522.994509:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559634560:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 29us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201522.994516:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 524 00010000:00010000:1.0:1788201523.002392:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201523.013251:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201523.013397:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559634432 00000100:00100000:3.0:1788201523.013410:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559634432 00002000:00100000:3.0:1788201523.013493:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (308281344->309329919) req@ffff96248cc95180 x1875064559634432/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:644/0 lens 488/0 e 0 to 0 dl 1788201534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201523.013523:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc95180 with x1875064559634432 ext(308281344->309329919) 00002000:00010000:3.0:1788201523.013529:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc95180 00000100:00100000:3.0:1788201523.013568:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 337 00000100:00100000:3.0:1788201523.013580:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559634432:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201523.013709:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201523.038851:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559634432:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25260us (25598us total) trans 30064771338 rc 0/0 00000100:00100000:3.0:1788201523.038875:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 337 00002000:00100000:3.0:1788201523.038889:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (308281344->309329919) req@ffff96248cc95180 x1875064559634432/t30064771338(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:644/0 lens 488/448 e 0 to 0 dl 1788201534 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201523.038899:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc95180 with x1875064559634432 ext(308281344->309329919) 00002000:00010000:3.0:1788201523.038904:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc95180 00000100:00100000:2.0:1788201523.213276:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201523.213506:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559634816 00000100:00100000:3.0:1788201523.213518:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559634816 00002000:00100000:3.0:1788201523.213572:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (309329920->310378495) req@ffff962485687100 x1875064559634816/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:644/0 lens 488/0 e 0 to 0 dl 1788201534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201523.213585:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485687100 with x1875064559634816 ext(309329920->310378495) 00002000:00010000:3.0:1788201523.213590:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485687100 00000100:00100000:3.0:1788201523.213626:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 338 00000100:00100000:3.0:1788201523.213635:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559634816:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201523.223235:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559634816:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9590us (9959us total) trans 30064771339 rc 0/0 00000100:00100000:3.0:1788201523.223249:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 338 00002000:00100000:3.0:1788201523.223275:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (309329920->310378495) req@ffff962485687100 x1875064559634816/t30064771339(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:644/0 lens 488/448 e 0 to 0 dl 1788201534 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201523.223548:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485687100 with x1875064559634816 ext(309329920->310378495) 00002000:00010000:3.0:1788201523.223555:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485687100 00000100:00100000:1.0:1788201523.343261:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201523.343425:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559634944 00000100:00100000:2.0:1788201523.343438:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559634944 00002000:00100000:2.0:1788201523.343491:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (310378496->311427071) req@ffff96248cc94700 x1875064559634944/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:644/0 lens 488/0 e 0 to 0 dl 1788201534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201523.343503:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc94700 with x1875064559634944 ext(310378496->311427071) 00002000:00010000:2.0:1788201523.343508:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc94700 00000100:00100000:2.0:1788201523.343544:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 339 00000100:00100000:2.0:1788201523.343554:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559634944:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201523.363182:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559634944:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19614us (19917us total) trans 30064771340 rc 0/0 00000100:00100000:2.0:1788201523.363199:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 339 00002000:00100000:2.0:1788201523.363245:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (310378496->311427071) req@ffff96248cc94700 x1875064559634944/t30064771340(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:644/0 lens 488/448 e 0 to 0 dl 1788201534 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201523.363256:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc94700 with x1875064559634944 ext(310378496->311427071) 00002000:00010000:2.0:1788201523.363262:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc94700 00000100:00100000:1.0:1788201523.590825:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201523.590943:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559635072 00000100:00100000:0.0:1788201523.590968:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559635072 00002000:00100000:0.0:1788201523.591035:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (311427072->312475647) req@ffff96248cc96300 x1875064559635072/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:644/0 lens 488/0 e 0 to 0 dl 1788201534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201523.591047:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc96300 with x1875064559635072 ext(311427072->312475647) 00002000:00010000:0.0:1788201523.591053:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc96300 00000100:00100000:0.0:1788201523.591091:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 340 00000100:00100000:0.0:1788201523.591103:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559635072:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201523.618013:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559635072:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26899us (27188us total) trans 30064771341 rc 0/0 00000100:00100000:2.0:1788201523.618029:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 340 00002000:00100000:2.0:1788201523.618046:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (311427072->312475647) req@ffff96248cc96300 x1875064559635072/t30064771341(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:644/0 lens 488/448 e 0 to 0 dl 1788201534 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201523.618057:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc96300 with x1875064559635072 ext(311427072->312475647) 00002000:00010000:2.0:1788201523.618064:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc96300 00000100:00100000:0.0:1788201523.766661:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cc95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570138112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201523.766751:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201523.767214:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570138112 00000100:00100000:1.0:1788201523.767225:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570138112 00000100:00100000:1.0:1788201523.767310:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788201523.767321:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570138112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201523.767398:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201523.767451:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570138112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201523.767459:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:0.0:1788201523.767846:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201523.767886:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248cc95500 x1875064570138112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201523.767906:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cc95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570138112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201523.859531:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201523.859631:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559635200 00000100:00100000:3.0:1788201523.859643:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559635200 00002000:00100000:3.0:1788201523.859699:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (312475648->313524223) req@ffff962485682d80 x1875064559635200/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:644/0 lens 488/0 e 0 to 0 dl 1788201534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201523.859721:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485682d80 with x1875064559635200 ext(312475648->313524223) 00002000:00010000:3.0:1788201523.859727:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485682d80 00000100:00100000:3.0:1788201523.859810:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 341 00000100:00100000:3.0:1788201523.859821:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559635200:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201523.897697:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559635200:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37865us (38164us total) trans 30064771342 rc 0/0 00000100:00100000:1.0:1788201523.897711:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 341 00002000:00100000:1.0:1788201523.897739:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (312475648->313524223) req@ffff962485682d80 x1875064559635200/t30064771342(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:644/0 lens 488/448 e 0 to 0 dl 1788201534 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201523.897750:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485682d80 with x1875064559635200 ext(312475648->313524223) 00002000:00010000:1.0:1788201523.897756:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485682d80 00010000:00010000:1.0:1788201524.022587:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201524.280504:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570138496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201524.280510:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570138240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201524.280594:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570138624:0@lo:400:kworker.0 00000100:00100000:1.0:1788201524.280656:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570138368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201524.283049:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201524.283118:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570138752:0@lo:400:kworker.0 00000100:00100000:2.0:1788201524.283167:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201524.283230:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570138240 00000100:00100000:2.0:1788201524.283238:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570138240 00000100:00100000:2.0:1788201524.283284:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:2.0:1788201524.283292:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570138240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201524.283359:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570138240:12345-0@lo:400:kworker.0 Request processed in 67us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201524.283366:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:2.0:1788201524.283416:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570138240:0@lo:400:kworker.0 00000100:00100000:2.0:1788201524.283653:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570138752 00000100:00100000:2.0:1788201524.283671:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570138752 00000100:00100000:2.0:1788201524.283706:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788201524.283713:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570138752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201524.283752:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570138752:12345-0@lo:400:kworker.0 Request processed in 39us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201524.283759:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00010000:00080000:2.0:1788201524.283785:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e72300 x1875064570138752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201524.283797:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570138752:0@lo:400:kworker.0 00000100:00100000:0.0:1788201524.285587:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201524.285678:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570138624 00000100:00100000:2.0:1788201524.285686:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570138624 00000100:00100000:2.0:1788201524.285752:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788201524.285761:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570138624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201524.285818:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570138624:12345-0@lo:400:kworker.0 Request processed in 58us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201524.285825:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00080000:0.0:1788201524.285890:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201524.286093:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570138624:0@lo:400:kworker.0 00000100:00100000:3.0:1788201524.290287:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201524.295092:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201524.295136:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570138880:0@lo:400:kworker.0 00000100:00100000:1.0:1788201524.295183:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201524.295414:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570138368 00000100:00100000:2.0:1788201524.295424:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570138368 00000100:00100000:2.0:1788201524.295476:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570138880 00000100:00100000:2.0:1788201524.295479:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570138880 00000100:00100000:2.0:1788201524.295520:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788201524.295529:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570138368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201524.295586:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570138368:12345-0@lo:400:kworker.0 Request processed in 58us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201524.295593:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788201524.295610:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788201524.295616:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570138880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201524.295659:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570138880:12345-0@lo:400:kworker.0 Request processed in 44us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201524.295666:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00080000:2.0:1788201524.295698:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201524.295798:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570138368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201524.295808:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570138880:0@lo:400:kworker.0 00000100:00100000:0.0:1788201524.298671:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570138496 00000100:00100000:0.0:1788201524.298696:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570138496 00000100:00100000:0.0:1788201524.298888:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788201524.298901:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570138496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201524.299021:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570138496:12345-0@lo:400:kworker.0 Request processed in 123us (8741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201524.299062:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788201524.299206:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570138496:0@lo:400:kworker.0 00000100:00080000:2.0:1788201524.299571:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201524.328971:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201524.335027:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559635328 00000100:00100000:1.0:1788201524.335047:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559635328 00002000:00100000:1.0:1788201524.335117:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (313524224->314572799) req@ffff9624c1e71180 x1875064559635328/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:645/0 lens 488/0 e 0 to 0 dl 1788201535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201524.335129:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71180 with x1875064559635328 ext(313524224->314572799) 00002000:00010000:1.0:1788201524.335135:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71180 00000100:00100000:0.0:1788201524.339167:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 342 00000100:00100000:0.0:1788201524.339197:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559635328:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201524.385490:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559635328:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 46297us (56763us total) trans 30064771343 rc 0/0 00000100:00100000:0.0:1788201524.385505:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 342 00002000:00100000:0.0:1788201524.385518:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (313524224->314572799) req@ffff9624c1e71180 x1875064559635328/t30064771343(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:645/0 lens 488/448 e 0 to 0 dl 1788201535 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201524.385529:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71180 with x1875064559635328 ext(313524224->314572799) 00002000:00010000:0.0:1788201524.385535:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71180 00000100:00100000:1.0:1788201524.581032:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201524.581135:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559635456 00000100:00100000:2.0:1788201524.581147:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559635456 00002000:00100000:2.0:1788201524.581208:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (314572800->315621375) req@ffff96248cc97480 x1875064559635456/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:645/0 lens 488/0 e 0 to 0 dl 1788201535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201524.581219:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97480 with x1875064559635456 ext(314572800->315621375) 00002000:00010000:2.0:1788201524.581225:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97480 00000100:00100000:2.0:1788201524.581261:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 343 00000100:00100000:2.0:1788201524.581272:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559635456:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201524.600585:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559635456:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19300us (19551us total) trans 30064771344 rc 0/0 00000100:00100000:3.0:1788201524.600610:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 343 00002000:00100000:3.0:1788201524.600626:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (314572800->315621375) req@ffff96248cc97480 x1875064559635456/t30064771344(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:645/0 lens 488/448 e 0 to 0 dl 1788201535 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201524.600638:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97480 with x1875064559635456 ext(314572800->315621375) 00002000:00010000:3.0:1788201524.600645:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97480 00000100:00100000:2.0:1788201524.739982:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201524.740271:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559635584 00000100:00100000:0.0:1788201524.740282:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559635584 00002000:00100000:0.0:1788201524.740335:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (315621376->316669951) req@ffff9624bfd2f800 x1875064559635584/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:645/0 lens 488/0 e 0 to 0 dl 1788201535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201524.740371:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2f800 with x1875064559635584 ext(315621376->316669951) 00002000:00010000:0.0:1788201524.740377:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2f800 00000100:00100000:0.0:1788201524.740415:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 344 00000100:00100000:0.0:1788201524.740425:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559635584:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201524.755174:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559635584:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14738us (15189us total) trans 30064771345 rc 0/0 00000100:00100000:0.0:1788201524.755188:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 344 00002000:00100000:0.0:1788201524.755201:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (315621376->316669951) req@ffff9624bfd2f800 x1875064559635584/t30064771345(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:645/0 lens 488/448 e 0 to 0 dl 1788201535 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201524.755309:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2f800 with x1875064559635584 ext(315621376->316669951) 00002000:00010000:0.0:1788201524.755320:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2f800 00000100:00100000:2.0:1788201524.823869:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201524.825858:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559635712 00000100:00100000:1.0:1788201524.825875:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559635712 00002000:00100000:1.0:1788201524.825961:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (316669952->317718527) req@ffff962382b17b80 x1875064559635712/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:645/0 lens 488/0 e 0 to 0 dl 1788201535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201524.825975:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17b80 with x1875064559635712 ext(316669952->317718527) 00002000:00010000:1.0:1788201524.825982:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17b80 00000100:00100000:1.0:1788201524.826102:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 345 00000100:00100000:1.0:1788201524.826111:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559635712:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201524.854276:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559635712:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28148us (30405us total) trans 30064771346 rc 0/0 00000100:00100000:1.0:1788201524.854292:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 345 00002000:00100000:1.0:1788201524.854309:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (316669952->317718527) req@ffff962382b17b80 x1875064559635712/t30064771346(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:645/0 lens 488/448 e 0 to 0 dl 1788201535 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201524.854318:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17b80 with x1875064559635712 ext(316669952->317718527) 00002000:00010000:1.0:1788201524.854324:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17b80 00000100:00100000:2.0:1788201524.911083:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201524.911266:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559635840 00000100:00100000:3.0:1788201524.911277:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559635840 00002000:00100000:3.0:1788201524.911335:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (317718528->318767103) req@ffff962382b15f80 x1875064559635840/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:645/0 lens 488/0 e 0 to 0 dl 1788201535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201524.911394:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15f80 with x1875064559635840 ext(317718528->318767103) 00002000:00010000:3.0:1788201524.911401:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15f80 00000100:00100000:3.0:1788201524.911430:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 346 00000100:00100000:3.0:1788201524.911441:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559635840:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201524.936302:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559635840:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24845us (25214us total) trans 30064771347 rc 0/0 00000100:00100000:3.0:1788201524.936319:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 346 00002000:00100000:3.0:1788201524.936334:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (317718528->318767103) req@ffff962382b15f80 x1875064559635840/t30064771347(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:645/0 lens 488/448 e 0 to 0 dl 1788201535 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201524.936368:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15f80 with x1875064559635840 ext(317718528->318767103) 00002000:00010000:3.0:1788201524.936376:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15f80 00000100:00100000:2.0:1788201525.015470:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201525.015561:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559635968 00000100:00100000:3.0:1788201525.015571:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559635968 00002000:00100000:3.0:1788201525.015641:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (318767104->319815679) req@ffff962382b17800 x1875064559635968/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/0 e 0 to 0 dl 1788201536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201525.015651:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17800 with x1875064559635968 ext(318767104->319815679) 00002000:00010000:3.0:1788201525.015656:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17800 00000100:00100000:3.0:1788201525.015688:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 347 00000100:00100000:3.0:1788201525.015696:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559635968:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201525.016145:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201525.039732:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559635968:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24017us (24256us total) trans 30064771348 rc 0/0 00000100:00100000:3.0:1788201525.039771:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 347 00002000:00100000:3.0:1788201525.039787:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (318767104->319815679) req@ffff962382b17800 x1875064559635968/t30064771348(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/448 e 0 to 0 dl 1788201536 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201525.039798:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17800 with x1875064559635968 ext(318767104->319815679) 00002000:00010000:3.0:1788201525.039806:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17800 00010000:00010000:2.0:1788201525.049200:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201525.162570:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201525.162683:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559636096 00000100:00100000:0.0:1788201525.162698:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559636096 00002000:00100000:0.0:1788201525.162780:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (319815680->320864255) req@ffff962382b14a80 x1875064559636096/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/0 e 0 to 0 dl 1788201536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201525.162795:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14a80 with x1875064559636096 ext(319815680->320864255) 00002000:00010000:0.0:1788201525.162802:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14a80 00000100:00100000:0.0:1788201525.162912:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 348 00000100:00100000:0.0:1788201525.162926:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559636096:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201525.173482:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559636096:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10545us (10916us total) trans 30064771349 rc 0/0 00000100:00100000:0.0:1788201525.173497:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 348 00002000:00100000:0.0:1788201525.173509:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (319815680->320864255) req@ffff962382b14a80 x1875064559636096/t30064771349(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/448 e 0 to 0 dl 1788201536 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201525.173519:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14a80 with x1875064559636096 ext(319815680->320864255) 00002000:00010000:0.0:1788201525.173526:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14a80 00000100:00100000:3.0:1788201525.285989:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201525.286242:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559636224 00000100:00100000:1.0:1788201525.286256:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559636224 00002000:00100000:1.0:1788201525.286324:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (320864256->321912831) req@ffff9624c1e71500 x1875064559636224/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/0 e 0 to 0 dl 1788201536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201525.286336:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71500 with x1875064559636224 ext(320864256->321912831) 00002000:00010000:1.0:1788201525.286397:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71500 00000100:00100000:1.0:1788201525.286436:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 349 00000100:00100000:1.0:1788201525.286446:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559636224:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201525.314267:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559636224:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27804us (28280us total) trans 30064771350 rc 0/0 00000100:00100000:3.0:1788201525.314286:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 349 00002000:00100000:3.0:1788201525.314303:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (320864256->321912831) req@ffff9624c1e71500 x1875064559636224/t30064771350(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/448 e 0 to 0 dl 1788201536 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201525.314316:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71500 with x1875064559636224 ext(320864256->321912831) 00002000:00010000:3.0:1788201525.314324:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71500 00000100:00100000:1.0:1788201525.434504:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201525.435485:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559636352 00000100:00100000:3.0:1788201525.435502:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559636352 00002000:00100000:3.0:1788201525.435573:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (321912832->322961407) req@ffff96248cc97800 x1875064559636352/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/0 e 0 to 0 dl 1788201536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201525.435587:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97800 with x1875064559636352 ext(321912832->322961407) 00002000:00010000:3.0:1788201525.435593:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97800 00000100:00100000:3.0:1788201525.435625:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 350 00000100:00100000:3.0:1788201525.435636:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559636352:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201525.459545:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559636352:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23892us (25039us total) trans 30064771351 rc 0/0 00000100:00100000:3.0:1788201525.459587:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 350 00002000:00100000:3.0:1788201525.459605:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (321912832->322961407) req@ffff96248cc97800 x1875064559636352/t30064771351(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/448 e 0 to 0 dl 1788201536 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201525.459618:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97800 with x1875064559636352 ext(321912832->322961407) 00002000:00010000:3.0:1788201525.459626:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97800 00000100:00100000:2.0:1788201525.616741:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201525.616867:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559636480 00000100:00100000:3.0:1788201525.616879:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559636480 00002000:00100000:3.0:1788201525.616958:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (322961408->324009983) req@ffff96248c9c4a80 x1875064559636480/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/0 e 0 to 0 dl 1788201536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201525.616971:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4a80 with x1875064559636480 ext(322961408->324009983) 00002000:00010000:3.0:1788201525.616978:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4a80 00000100:00100000:3.0:1788201525.617088:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 351 00000100:00100000:3.0:1788201525.617101:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559636480:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201525.632716:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559636480:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15601us (15975us total) trans 30064771352 rc 0/0 00000100:00100000:3.0:1788201525.632733:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 351 00002000:00100000:3.0:1788201525.632749:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (322961408->324009983) req@ffff96248c9c4a80 x1875064559636480/t30064771352(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/448 e 0 to 0 dl 1788201536 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201525.632762:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4a80 with x1875064559636480 ext(322961408->324009983) 00002000:00010000:3.0:1788201525.632769:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4a80 00000100:00100000:2.0:1788201525.758908:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201525.759211:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559636608 00000100:00100000:0.0:1788201525.759223:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559636608 00002000:00100000:0.0:1788201525.759281:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (324009984->325058559) req@ffff96248c9c4e00 x1875064559636608/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/0 e 0 to 0 dl 1788201536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201525.759296:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4e00 with x1875064559636608 ext(324009984->325058559) 00002000:00010000:0.0:1788201525.759302:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4e00 00000100:00100000:0.0:1788201525.759438:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 352 00000100:00100000:0.0:1788201525.759450:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559636608:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201525.796383:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559636608:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36880us (37446us total) trans 30064771353 rc 0/0 00000100:00100000:0.0:1788201525.796405:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 352 00002000:00100000:0.0:1788201525.796426:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (324009984->325058559) req@ffff96248c9c4e00 x1875064559636608/t30064771353(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/448 e 0 to 0 dl 1788201536 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201525.796438:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4e00 with x1875064559636608 ext(324009984->325058559) 00002000:00010000:0.0:1788201525.796448:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4e00 00000100:00100000:1.0:1788201525.995604:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201525.995703:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559636736 00000100:00100000:3.0:1788201525.995715:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559636736 00002000:00100000:3.0:1788201525.995773:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (325058560->326107135) req@ffff96248cc94000 x1875064559636736/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/0 e 0 to 0 dl 1788201536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201525.995800:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc94000 with x1875064559636736 ext(325058560->326107135) 00002000:00010000:3.0:1788201525.995806:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc94000 00000100:00100000:3.0:1788201525.995844:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 353 00000100:00100000:3.0:1788201525.995855:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2342:x1875064559636736:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201526.034539:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559636736:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 38675us (38935us total) trans 30064771354 rc 0/0 00000100:00100000:3.0:1788201526.034555:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 353 00002000:00100000:3.0:1788201526.034967:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (325058560->326107135) req@ffff96248cc94000 x1875064559636736/t30064771354(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:646/0 lens 488/448 e 0 to 0 dl 1788201536 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201526.034981:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc94000 with x1875064559636736 ext(325058560->326107135) 00002000:00010000:3.0:1788201526.034988:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc94000 00010000:00010000:1.0:1788201526.074668:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201526.221482:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201526.222153:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559636864 00000100:00100000:3.0:1788201526.222166:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559636864 00002000:00100000:3.0:1788201526.222244:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (326107136->327155711) req@ffff96248cc94e00 x1875064559636864/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:647/0 lens 488/0 e 0 to 0 dl 1788201537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201526.222257:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc94e00 with x1875064559636864 ext(326107136->327155711) 00002000:00010000:3.0:1788201526.222263:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc94e00 00000100:00100000:3.0:1788201526.222290:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 354 00000100:00100000:3.0:1788201526.222301:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559636864:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201526.241766:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559636864:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19450us (20280us total) trans 30064771355 rc 0/0 00000100:00100000:3.0:1788201526.241786:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 354 00002000:00100000:3.0:1788201526.241821:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (326107136->327155711) req@ffff96248cc94e00 x1875064559636864/t30064771355(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:647/0 lens 488/448 e 0 to 0 dl 1788201537 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201526.241834:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc94e00 with x1875064559636864 ext(326107136->327155711) 00002000:00010000:3.0:1788201526.241842:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc94e00 00000100:00100000:1.0:1788201526.327229:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201526.327256:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570139008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201526.327337:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201526.327559:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570139008 00000100:00100000:0.0:1788201526.327569:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570139008 00000100:00100000:0.0:1788201526.327644:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788201526.327656:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570139008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201526.327680:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 368902144 pending 39190528 free 3556769792 avail 3554672640 00000100:00100000:0.0:1788201526.327727:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570139008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201526.327735:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:2.0:1788201526.328952:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201526.329060:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570139008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201526.494587:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201526.494725:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559636992 00000100:00100000:3.0:1788201526.494736:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559636992 00002000:00100000:3.0:1788201526.494797:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (327155712->328204287) req@ffff9624c1cc5180 x1875064559636992/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:647/0 lens 488/0 e 0 to 0 dl 1788201537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201526.494914:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5180 with x1875064559636992 ext(327155712->328204287) 00002000:00010000:3.0:1788201526.494922:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5180 00000100:00100000:3.0:1788201526.494961:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 355 00000100:00100000:3.0:1788201526.494972:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2341:x1875064559636992:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201526.520158:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2341:x1875064559636992:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25168us (25569us total) trans 30064771356 rc 0/0 00000100:00100000:3.0:1788201526.520178:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 355 00002000:00100000:3.0:1788201526.520192:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (327155712->328204287) req@ffff9624c1cc5180 x1875064559636992/t30064771356(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:647/0 lens 488/448 e 0 to 0 dl 1788201537 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201526.520205:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5180 with x1875064559636992 ext(327155712->328204287) 00002000:00010000:3.0:1788201526.520213:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5180 00000100:00100000:2.0:1788201526.585825:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201526.585903:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201526.588969:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559637120 00000100:00100000:0.0:1788201526.588991:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559637120 00002000:00100000:0.0:1788201526.589797:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (177270784->178257919) req@ffff9624c1cc6a00 x1875064559637120/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:647/0 lens 488/0 e 0 to 0 dl 1788201537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201526.589811:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6a00 with x1875064559637120 ext(177270784->178257919) 00002000:00010000:0.0:1788201526.589819:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6a00 00000100:00100000:0.0:1788201526.589863:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559637248 00000100:00100000:0.0:1788201526.589868:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559637248 00002000:00100000:0.0:1788201526.589923:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (328204288->328511487) req@ffff9624b9f69f80 x1875064559637248/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:647/0 lens 488/0 e 0 to 0 dl 1788201537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201526.589930:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69f80 with x1875064559637248 ext(328204288->328511487) 00002000:00010000:0.0:1788201526.589933:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69f80 00000100:00100000:0.0:1788201526.589969:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 356 00000100:00100000:0.0:1788201526.589980:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+55:2342:x1875064559637120:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201526.591482:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 357 00000100:00100000:2.0:1788201526.591509:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559637248:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201526.612519:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2342:x1875064559637248:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20996us (26595us total) trans 30064771357 rc 0/0 00000100:00100000:2.0:1788201526.612542:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 357 00002000:00100000:2.0:1788201526.612562:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (328204288->328511487) req@ffff9624b9f69f80 x1875064559637248/t30064771357(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:647/0 lens 488/448 e 0 to 0 dl 1788201537 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201526.612576:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69f80 with x1875064559637248 ext(328204288->328511487) 00002000:00010000:2.0:1788201526.612585:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69f80 00000100:00100000:1.0:1788201526.614271:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2342:x1875064559637120:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24279us (29046us total) trans 30064771358 rc 0/0 00000100:00100000:1.0:1788201526.614286:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 356 00002000:00100000:1.0:1788201526.614300:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (177270784->178257919) req@ffff9624c1cc6a00 x1875064559637120/t30064771358(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:647/0 lens 488/448 e 0 to 0 dl 1788201537 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201526.614312:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6a00 with x1875064559637120 ext(177270784->178257919) 00002000:00010000:1.0:1788201526.614319:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6a00 00000100:00100000:2.0:1788201526.821690:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201526.821816:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559637376 00000100:00100000:1.0:1788201526.821829:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559637376 00002000:00100000:1.0:1788201526.821908:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (329252864->330301439) req@ffff9624b9f68a80 x1875064559637376/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:647/0 lens 488/0 e 0 to 0 dl 1788201537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201526.821924:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68a80 with x1875064559637376 ext(329252864->330301439) 00002000:00010000:1.0:1788201526.821932:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68a80 00000100:00100000:1.0:1788201526.821978:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 358 00000100:00100000:1.0:1788201526.821992:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559637376:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201526.858051:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2343:x1875064559637376:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36042us (36358us total) trans 30064771359 rc 0/0 00000100:00100000:0.0:1788201526.858070:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 358 00002000:00100000:0.0:1788201526.858086:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (329252864->330301439) req@ffff9624b9f68a80 x1875064559637376/t30064771359(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:647/0 lens 488/448 e 0 to 0 dl 1788201537 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201526.858099:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68a80 with x1875064559637376 ext(329252864->330301439) 00002000:00010000:0.0:1788201526.858106:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68a80 00000001:00080000:3.0:1788201527.016587:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771353 is committed 00000001:00080000:3.0:1788201527.016648:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771358 is committed 00000100:00100000:0.0:1788201527.046011:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201527.046153:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559637504 00000100:00100000:2.0:1788201527.046166:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559637504 00002000:00100000:2.0:1788201527.046296:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (330301440->331350015) req@ffff962485aad880 x1875064559637504/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:648/0 lens 488/0 e 0 to 0 dl 1788201538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201527.046310:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aad880 with x1875064559637504 ext(330301440->331350015) 00002000:00010000:2.0:1788201527.046317:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aad880 00000100:00100000:2.0:1788201527.046392:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 359 00000100:00100000:2.0:1788201527.046404:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559637504:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201527.048710:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201527.060969:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559637504:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14551us (14959us total) trans 30064771360 rc 0/0 00000100:00100000:0.0:1788201527.060990:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 359 00002000:00100000:0.0:1788201527.061006:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (330301440->331350015) req@ffff962485aad880 x1875064559637504/t30064771360(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:648/0 lens 488/448 e 0 to 0 dl 1788201538 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201527.061019:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aad880 with x1875064559637504 ext(330301440->331350015) 00002000:00010000:0.0:1788201527.061026:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aad880 00010000:00010000:1.0:1788201527.094942:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201527.246825:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201527.247115:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559637632 00000100:00100000:3.0:1788201527.247127:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559637632 00002000:00100000:3.0:1788201527.247191:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (331350016->332398591) req@ffff9624b9f6b800 x1875064559637632/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:648/0 lens 488/0 e 0 to 0 dl 1788201538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201527.247228:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6b800 with x1875064559637632 ext(331350016->332398591) 00002000:00010000:3.0:1788201527.247235:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6b800 00000100:00100000:3.0:1788201527.247266:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 360 00000100:00100000:3.0:1788201527.247277:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559637632:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201527.309875:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559637632:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 62569us (63035us total) trans 30064771361 rc 0/0 00000100:00100000:0.0:1788201527.309912:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 360 00002000:00100000:0.0:1788201527.309931:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (331350016->332398591) req@ffff9624b9f6b800 x1875064559637632/t30064771361(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:648/0 lens 488/448 e 0 to 0 dl 1788201538 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201527.309943:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6b800 with x1875064559637632 ext(331350016->332398591) 00002000:00010000:0.0:1788201527.309952:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6b800 00000100:00100000:2.0:1788201527.488502:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201527.488694:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559637760 00000100:00100000:1.0:1788201527.488707:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559637760 00002000:00100000:1.0:1788201527.488772:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (332398592->333447167) req@ffff962492cbaa00 x1875064559637760/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:648/0 lens 488/0 e 0 to 0 dl 1788201538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201527.488786:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbaa00 with x1875064559637760 ext(332398592->333447167) 00002000:00010000:1.0:1788201527.488793:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbaa00 00000100:00100000:1.0:1788201527.488828:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 361 00000100:00100000:1.0:1788201527.488869:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559637760:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201527.538597:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559637760:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 49722us (50093us total) trans 30064771362 rc 0/0 00000100:00100000:1.0:1788201527.538617:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 361 00002000:00100000:1.0:1788201527.538632:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (332398592->333447167) req@ffff962492cbaa00 x1875064559637760/t30064771362(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:648/0 lens 488/448 e 0 to 0 dl 1788201538 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201527.538645:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbaa00 with x1875064559637760 ext(332398592->333447167) 00002000:00010000:1.0:1788201527.538653:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbaa00 00000100:00100000:3.0:1788201527.642874:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201527.643028:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559637888 00000100:00100000:0.0:1788201527.643043:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559637888 00002000:00100000:0.0:1788201527.643115:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (333447168->334495743) req@ffff9624c1e72a00 x1875064559637888/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:648/0 lens 488/0 e 0 to 0 dl 1788201538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201527.643130:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72a00 with x1875064559637888 ext(333447168->334495743) 00002000:00010000:0.0:1788201527.643137:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72a00 00000100:00100000:0.0:1788201527.643177:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 362 00000100:00100000:0.0:1788201527.643189:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559637888:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201527.661506:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559637888:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18305us (18641us total) trans 30064771363 rc 0/0 00000100:00100000:0.0:1788201527.661523:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 362 00002000:00100000:0.0:1788201527.661537:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (333447168->334495743) req@ffff9624c1e72a00 x1875064559637888/t30064771363(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:648/0 lens 488/448 e 0 to 0 dl 1788201538 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201527.661550:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72a00 with x1875064559637888 ext(333447168->334495743) 00002000:00010000:0.0:1788201527.661558:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72a00 00000100:00100000:2.0:1788201527.891076:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201527.891264:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559638016 00000100:00100000:3.0:1788201527.891277:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559638016 00002000:00100000:3.0:1788201527.891373:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (334495744->335544319) req@ffff962492cb9c00 x1875064559638016/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:648/0 lens 488/0 e 0 to 0 dl 1788201538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201527.891386:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb9c00 with x1875064559638016 ext(334495744->335544319) 00002000:00010000:3.0:1788201527.891393:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb9c00 00000100:00100000:3.0:1788201527.891434:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 363 00000100:00100000:3.0:1788201527.891445:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559638016:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201527.927869:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559638016:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36396us (36780us total) trans 30064771364 rc 0/0 00000100:00100000:0.0:1788201527.927912:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 363 00002000:00100000:0.0:1788201527.927931:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (334495744->335544319) req@ffff962492cb9c00 x1875064559638016/t30064771364(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:648/0 lens 488/448 e 0 to 0 dl 1788201538 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201527.927943:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb9c00 with x1875064559638016 ext(334495744->335544319) 00002000:00010000:0.0:1788201527.927951:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb9c00 00000100:00100000:2.0:1788201528.114958:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201528.115012:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201528.115062:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201528.115382:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559638272 00000100:00100000:1.0:1788201528.115395:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559638272 00000100:00100000:0.0:1788201528.115482:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559638400 00000100:00100000:0.0:1788201528.115487:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559638400 00000100:00100000:1.0:1788201528.115487:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 367 00000100:00100000:1.0:1788201528.115499:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559638272:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201528.115518:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 226 00000100:00100000:0.0:1788201528.115525:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559638400:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201528.115615:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559638144 00000100:00100000:3.0:1788201528.115621:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559638144 00000100:00100000:3.0:1788201528.115660:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 526 00000100:00100000:3.0:1788201528.115669:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559638144:12345-192.168.201.56@tcp:400:kworker.0 00000100:00080000:2.0:1788201528.115687:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201528.115743:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559638400:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 218us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201528.115751:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 226 00000100:00100000:1.0:1788201528.125093:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559638272:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 9574us (10008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201528.125116:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 367 00000100:00100000:3.0:1788201528.133359:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559638144:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 17659us (18387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201528.133378:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 526 00010000:00010000:0.0:1788201528.133541:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201528.192638:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201528.192820:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559638528 00000100:00100000:3.0:1788201528.192833:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559638528 00002000:00100000:3.0:1788201528.192929:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (335544320->336592895) req@ffff962381955500 x1875064559638528/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:649/0 lens 488/0 e 0 to 0 dl 1788201539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201528.192963:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955500 with x1875064559638528 ext(335544320->336592895) 00002000:00010000:3.0:1788201528.192971:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955500 00000100:00100000:3.0:1788201528.193017:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 364 00000100:00100000:3.0:1788201528.193029:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559638528:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201528.209440:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559638528:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16395us (16799us total) trans 30064771365 rc 0/0 00000100:00100000:0.0:1788201528.209455:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 364 00002000:00100000:0.0:1788201528.209470:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (335544320->336592895) req@ffff962381955500 x1875064559638528/t30064771365(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:649/0 lens 488/448 e 0 to 0 dl 1788201539 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201528.209480:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955500 with x1875064559638528 ext(335544320->336592895) 00002000:00010000:0.0:1788201528.209488:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955500 00000100:00100000:2.0:1788201528.362290:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201528.362466:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559638656 00000100:00100000:1.0:1788201528.362481:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559638656 00002000:00100000:1.0:1788201528.362542:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (336592896->337641471) req@ffff962381a0f100 x1875064559638656/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:649/0 lens 488/0 e 0 to 0 dl 1788201539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201528.362557:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0f100 with x1875064559638656 ext(336592896->337641471) 00002000:00010000:1.0:1788201528.362564:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0f100 00000100:00100000:1.0:1788201528.362610:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 365 00000100:00100000:1.0:1788201528.362622:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559638656:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201528.383934:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559638656:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21297us (21647us total) trans 30064771366 rc 0/0 00000100:00100000:1.0:1788201528.383974:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 365 00002000:00100000:1.0:1788201528.383990:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (336592896->337641471) req@ffff962381a0f100 x1875064559638656/t30064771366(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:649/0 lens 488/448 e 0 to 0 dl 1788201539 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201528.384003:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0f100 with x1875064559638656 ext(336592896->337641471) 00002000:00010000:1.0:1788201528.384012:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0f100 00000100:00100000:2.0:1788201528.610686:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201528.610784:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559638784 00000100:00100000:0.0:1788201528.610795:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559638784 00002000:00100000:0.0:1788201528.611060:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (337641472->338690047) req@ffff962381a0ea00 x1875064559638784/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:649/0 lens 488/0 e 0 to 0 dl 1788201539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201528.611100:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0ea00 with x1875064559638784 ext(337641472->338690047) 00002000:00010000:0.0:1788201528.611109:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0ea00 00000100:00100000:0.0:1788201528.611156:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 366 00000100:00100000:0.0:1788201528.611169:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559638784:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201528.642095:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559638784:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30910us (31406us total) trans 30064771367 rc 0/0 00000100:00100000:0.0:1788201528.642114:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 366 00002000:00100000:0.0:1788201528.642132:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (337641472->338690047) req@ffff962381a0ea00 x1875064559638784/t30064771367(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:649/0 lens 488/448 e 0 to 0 dl 1788201539 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201528.642143:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0ea00 with x1875064559638784 ext(337641472->338690047) 00002000:00010000:0.0:1788201528.642151:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0ea00 00000100:00100000:3.0:1788201528.858221:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201528.858380:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559638912 00000100:00100000:0.0:1788201528.858393:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559638912 00002000:00100000:0.0:1788201528.858460:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (338690048->339738623) req@ffff9624c1e70700 x1875064559638912/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:649/0 lens 488/0 e 0 to 0 dl 1788201539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201528.858475:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70700 with x1875064559638912 ext(338690048->339738623) 00002000:00010000:0.0:1788201528.858482:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70700 00000100:00100000:0.0:1788201528.858525:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 367 00000100:00100000:0.0:1788201528.858537:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559638912:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201528.875943:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559638912:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17390us (17720us total) trans 30064771368 rc 0/0 00000100:00100000:1.0:1788201528.875962:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 367 00002000:00100000:1.0:1788201528.875978:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (338690048->339738623) req@ffff9624c1e70700 x1875064559638912/t30064771368(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:649/0 lens 488/448 e 0 to 0 dl 1788201539 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201528.875990:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70700 with x1875064559638912 ext(338690048->339738623) 00002000:00010000:1.0:1788201528.875998:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70700 00000100:00100000:0.0:1788201528.886730:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cc96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570139136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201528.886865:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201528.886974:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570139136 00000100:00100000:2.0:1788201528.887047:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570139136 00000100:00100000:2.0:1788201528.887132:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788201528.887144:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570139136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201528.887191:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788201528.887293:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201528.888301:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570139136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1152us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201528.888385:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00080000:0.0:1788201528.890095:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248cc96d80 x1875064570139136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201528.890157:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cc96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570139136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201529.130688:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201529.130989:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559639040 00000100:00100000:3.0:1788201529.131002:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559639040 00002000:00100000:3.0:1788201529.131093:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (339738624->340787199) req@ffff96248c9cf800 x1875064559639040/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:650/0 lens 488/0 e 0 to 0 dl 1788201540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201529.131106:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cf800 with x1875064559639040 ext(339738624->340787199) 00002000:00010000:3.0:1788201529.131113:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cf800 00000100:00100000:3.0:1788201529.131207:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 368 00000100:00100000:3.0:1788201529.131220:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559639040:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201529.131614:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201529.146413:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201529.168612:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559639040:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37377us (37925us total) trans 30064771369 rc 0/0 00000100:00100000:3.0:1788201529.168631:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 368 00002000:00100000:3.0:1788201529.168646:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (339738624->340787199) req@ffff96248c9cf800 x1875064559639040/t30064771369(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:650/0 lens 488/448 e 0 to 0 dl 1788201540 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201529.168658:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cf800 with x1875064559639040 ext(339738624->340787199) 00002000:00010000:3.0:1788201529.168666:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cf800 00000100:00100000:1.0:1788201529.330787:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201529.330922:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559639168 00000100:00100000:0.0:1788201529.330937:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559639168 00002000:00100000:0.0:1788201529.331020:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (340787200->341835775) req@ffff96248cc95c00 x1875064559639168/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:650/0 lens 488/0 e 0 to 0 dl 1788201540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201529.331034:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc95c00 with x1875064559639168 ext(340787200->341835775) 00002000:00010000:0.0:1788201529.331041:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc95c00 00000100:00100000:0.0:1788201529.331098:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 369 00000100:00100000:0.0:1788201529.331112:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559639168:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201529.345779:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559639168:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14655us (14991us total) trans 30064771370 rc 0/0 00000100:00100000:0.0:1788201529.345797:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 369 00002000:00100000:0.0:1788201529.345814:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (340787200->341835775) req@ffff96248cc95c00 x1875064559639168/t30064771370(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:650/0 lens 488/448 e 0 to 0 dl 1788201540 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201529.345838:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc95c00 with x1875064559639168 ext(340787200->341835775) 00002000:00010000:0.0:1788201529.345846:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc95c00 00000100:00100000:3.0:1788201529.399120:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570139520:0@lo:400:kworker.0 00000100:00100000:3.0:1788201529.399271:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201529.399394:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201529.399401:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570139392:0@lo:400:kworker.0 00000100:00100000:3.0:1788201529.399432:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201529.399464:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570139904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201529.399488:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201529.399527:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570139392 00000100:00100000:3.0:1788201529.399535:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570139392 00000100:00100000:3.0:1788201529.399599:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570139904 00000100:00100000:3.0:1788201529.399603:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570139904 00000100:00100000:3.0:1788201529.399890:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788201529.399899:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570139392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201529.399967:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570139392:12345-0@lo:400:kworker.0 Request processed in 68us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201529.399975:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788201529.400000:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788201529.400007:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570139904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201529.400039:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570139904:12345-0@lo:400:kworker.0 Request processed in 33us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201529.400044:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788201529.400065:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570139264:0@lo:400:kworker.0 00000100:00100000:3.0:1788201529.400101:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201529.400124:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570139776:0@lo:400:kworker.0 00000100:00100000:0.0:1788201529.400482:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570139520 00000100:00100000:0.0:1788201529.400488:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570139520 00000100:00100000:0.0:1788201529.400529:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788201529.400537:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570139520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201529.400575:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570139520:12345-0@lo:400:kworker.0 Request processed in 40us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201529.400581:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788201529.400868:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570139392:0@lo:400:kworker.0 00000100:00100000:0.0:1788201529.400882:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570139904:0@lo:400:kworker.0 00000100:00100000:0.0:1788201529.400892:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570139520:0@lo:400:kworker.0 00000100:00100000:2.0:1788201529.401052:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570139264 00000100:00100000:2.0:1788201529.401058:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570139264 00000100:00100000:2.0:1788201529.401095:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1788201529.401102:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570139264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201529.401155:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570139264:12345-0@lo:400:kworker.0 Request processed in 53us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201529.401162:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00080000:2.0:1788201529.401197:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201529.401204:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201529.401218:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570139648:0@lo:400:kworker.0 00000100:00100000:2.0:1788201529.401263:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201529.401307:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570139648 00000100:00100000:2.0:1788201529.401311:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570139648 00000100:00100000:2.0:1788201529.401362:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788201529.401368:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570139648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201529.401413:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570139648:12345-0@lo:400:kworker.0 Request processed in 45us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201529.401419:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00080000:2.0:1788201529.401435:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201529.402948:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201529.403013:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570139264:0@lo:400:kworker.0 00000100:00100000:2.0:1788201529.403200:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570139648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201529.407380:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570139776 00000100:00100000:0.0:1788201529.407402:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570139776 00000100:00100000:0.0:1788201529.407489:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788201529.407502:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570139776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201529.407657:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570139776:12345-0@lo:400:kworker.0 Request processed in 157us (4713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201529.407666:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00080000:3.0:1788201529.409635:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248cd05880 x1875064570139776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201529.409657:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570139776:0@lo:400:kworker.0 00000100:00100000:2.0:1788201529.522235:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201529.525634:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559639296 00000100:00100000:0.0:1788201529.525656:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559639296 00002000:00100000:0.0:1788201529.525740:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (341835776->342884351) req@ffff96248c9cfb80 x1875064559639296/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:650/0 lens 488/0 e 0 to 0 dl 1788201540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201529.525754:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cfb80 with x1875064559639296 ext(341835776->342884351) 00002000:00010000:0.0:1788201529.525762:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cfb80 00000100:00100000:0.0:1788201529.525814:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 370 00000100:00100000:0.0:1788201529.525858:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559639296:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201529.539062:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559639296:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13219us (16823us total) trans 30064771371 rc 0/0 00000100:00100000:0.0:1788201529.539082:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 370 00002000:00100000:0.0:1788201529.539101:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (341835776->342884351) req@ffff96248c9cfb80 x1875064559639296/t30064771371(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:650/0 lens 488/448 e 0 to 0 dl 1788201540 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201529.539113:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cfb80 with x1875064559639296 ext(341835776->342884351) 00002000:00010000:0.0:1788201529.539152:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cfb80 00000100:00100000:1.0:1788201529.668032:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201529.668445:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559639424 00000100:00100000:0.0:1788201529.668458:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559639424 00002000:00100000:0.0:1788201529.668530:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (342884352->343932927) req@ffff96248cc97100 x1875064559639424/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:650/0 lens 488/0 e 0 to 0 dl 1788201540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201529.668545:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97100 with x1875064559639424 ext(342884352->343932927) 00002000:00010000:0.0:1788201529.668552:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97100 00000100:00100000:0.0:1788201529.668594:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 371 00000100:00100000:0.0:1788201529.668605:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559639424:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201529.696230:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559639424:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27598us (28184us total) trans 30064771372 rc 0/0 00000100:00100000:0.0:1788201529.696252:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 371 00002000:00100000:0.0:1788201529.696270:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (342884352->343932927) req@ffff96248cc97100 x1875064559639424/t30064771372(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:650/0 lens 488/448 e 0 to 0 dl 1788201540 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201529.696282:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97100 with x1875064559639424 ext(342884352->343932927) 00002000:00010000:0.0:1788201529.696290:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97100 00000100:00100000:1.0:1788201529.942014:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201529.942428:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559639552 00000100:00100000:3.0:1788201529.942442:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559639552 00002000:00100000:3.0:1788201529.942511:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (343932928->344981503) req@ffff96248cc94a80 x1875064559639552/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:650/0 lens 488/0 e 0 to 0 dl 1788201540 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201529.942523:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc94a80 with x1875064559639552 ext(343932928->344981503) 00002000:00010000:3.0:1788201529.942530:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc94a80 00000100:00100000:3.0:1788201529.942567:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 372 00000100:00100000:3.0:1788201529.942579:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559639552:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201529.961758:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559639552:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19164us (19743us total) trans 30064771373 rc 0/0 00000100:00100000:3.0:1788201529.961772:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 372 00002000:00100000:3.0:1788201529.961784:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (343932928->344981503) req@ffff96248cc94a80 x1875064559639552/t30064771373(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:650/0 lens 488/448 e 0 to 0 dl 1788201540 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201529.961793:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc94a80 with x1875064559639552 ext(343932928->344981503) 00002000:00010000:3.0:1788201529.961800:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc94a80 00010000:00010000:1.0:1788201530.166867:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201530.183069:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201530.183217:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559639680 00000100:00100000:1.0:1788201530.183229:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559639680 00002000:00100000:1.0:1788201530.183315:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (344981504->346030079) req@ffff9624c1e50000 x1875064559639680/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:651/0 lens 488/0 e 0 to 0 dl 1788201541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201530.183329:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e50000 with x1875064559639680 ext(344981504->346030079) 00002000:00010000:1.0:1788201530.183335:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e50000 00000100:00100000:1.0:1788201530.183409:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 373 00000100:00100000:1.0:1788201530.183452:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559639680:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201530.229585:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559639680:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 46117us (46526us total) trans 30064771374 rc 0/0 00000100:00100000:0.0:1788201530.229605:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 373 00002000:00100000:0.0:1788201530.229623:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (344981504->346030079) req@ffff9624c1e50000 x1875064559639680/t30064771374(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:651/0 lens 488/448 e 0 to 0 dl 1788201541 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201530.229635:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e50000 with x1875064559639680 ext(344981504->346030079) 00002000:00010000:0.0:1788201530.229644:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e50000 00000100:00100000:1.0:1788201530.391615:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201530.391847:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559639808 00000100:00100000:0.0:1788201530.391877:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559639808 00002000:00100000:0.0:1788201530.391938:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (346030080->347078655) req@ffff96248cc97b80 x1875064559639808/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:651/0 lens 488/0 e 0 to 0 dl 1788201541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201530.391951:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97b80 with x1875064559639808 ext(346030080->347078655) 00002000:00010000:0.0:1788201530.391958:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97b80 00000100:00100000:0.0:1788201530.391996:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 374 00000100:00100000:0.0:1788201530.392007:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559639808:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201530.409552:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559639808:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17528us (17947us total) trans 30064771375 rc 0/0 00000100:00100000:0.0:1788201530.409570:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 374 00002000:00100000:0.0:1788201530.409585:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (346030080->347078655) req@ffff96248cc97b80 x1875064559639808/t30064771375(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:651/0 lens 488/448 e 0 to 0 dl 1788201541 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201530.409598:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97b80 with x1875064559639808 ext(346030080->347078655) 00002000:00010000:0.0:1788201530.409606:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97b80 00000100:00100000:1.0:1788201530.621326:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201530.621507:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559639936 00000100:00100000:0.0:1788201530.621519:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559639936 00002000:00100000:0.0:1788201530.621586:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (347078656->348127231) req@ffff96248cc96d80 x1875064559639936/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:651/0 lens 488/0 e 0 to 0 dl 1788201541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201530.621599:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc96d80 with x1875064559639936 ext(347078656->348127231) 00002000:00010000:0.0:1788201530.621605:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc96d80 00000100:00100000:0.0:1788201530.621648:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 375 00000100:00100000:0.0:1788201530.621661:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559639936:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201530.633138:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559639936:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11464us (11812us total) trans 30064771376 rc 0/0 00000100:00100000:1.0:1788201530.633155:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 375 00002000:00100000:1.0:1788201530.633171:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (347078656->348127231) req@ffff96248cc96d80 x1875064559639936/t30064771376(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:651/0 lens 488/448 e 0 to 0 dl 1788201541 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201530.633183:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc96d80 with x1875064559639936 ext(347078656->348127231) 00002000:00010000:1.0:1788201530.633191:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc96d80 00000100:00100000:2.0:1788201530.830220:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201530.830834:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559640064 00000100:00100000:3.0:1788201530.830849:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559640064 00002000:00100000:3.0:1788201530.830930:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (348127232->349175807) req@ffff9623812a7b80 x1875064559640064/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:651/0 lens 488/0 e 0 to 0 dl 1788201541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201530.830943:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a7b80 with x1875064559640064 ext(348127232->349175807) 00002000:00010000:3.0:1788201530.830973:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a7b80 00000100:00100000:3.0:1788201530.831018:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 376 00000100:00100000:3.0:1788201530.831029:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559640064:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201530.845022:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559640064:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13850us (14674us total) trans 30064771377 rc 0/0 00000100:00100000:3.0:1788201530.845042:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 376 00002000:00100000:3.0:1788201530.845060:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (348127232->349175807) req@ffff9623812a7b80 x1875064559640064/t30064771377(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:651/0 lens 488/448 e 0 to 0 dl 1788201541 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201530.845073:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a7b80 with x1875064559640064 ext(348127232->349175807) 00002000:00010000:3.0:1788201530.845081:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a7b80 00000100:00100000:0.0:1788201530.998319:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201530.998484:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559640192 00000100:00100000:1.0:1788201530.998497:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559640192 00002000:00100000:1.0:1788201530.998566:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (349175808->350224383) req@ffff9624bfd9ad80 x1875064559640192/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:651/0 lens 488/0 e 0 to 0 dl 1788201541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201530.998663:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ad80 with x1875064559640192 ext(349175808->350224383) 00002000:00010000:1.0:1788201530.998672:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ad80 00000100:00100000:1.0:1788201530.998791:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 377 00000100:00100000:1.0:1788201530.998813:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559640192:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201531.021000:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559640192:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22173us (22681us total) trans 30064771378 rc 0/0 00000100:00100000:2.0:1788201531.021018:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 377 00002000:00100000:2.0:1788201531.021033:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (349175808->350224383) req@ffff9624bfd9ad80 x1875064559640192/t30064771378(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:651/0 lens 488/448 e 0 to 0 dl 1788201541 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201531.021046:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ad80 with x1875064559640192 ext(349175808->350224383) 00002000:00010000:2.0:1788201531.021055:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ad80 00000100:00100000:1.0:1788201531.159768:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201531.162445:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559640320 00000100:00100000:0.0:1788201531.162486:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559640320 00002000:00100000:0.0:1788201531.162681:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (350224384->351272959) req@ffff96248cc95500 x1875064559640320/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:652/0 lens 488/0 e 0 to 0 dl 1788201542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201531.162695:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc95500 with x1875064559640320 ext(350224384->351272959) 00002000:00010000:0.0:1788201531.162702:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc95500 00000100:00100000:0.0:1788201531.162743:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 378 00000100:00100000:0.0:1788201531.162759:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559640320:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:3.0:1788201531.190676:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201531.193994:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201531.195079:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559640320:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32312us (35311us total) trans 30064771379 rc 0/0 00000100:00100000:0.0:1788201531.195097:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 378 00002000:00100000:0.0:1788201531.195113:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (350224384->351272959) req@ffff96248cc95500 x1875064559640320/t30064771379(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:652/0 lens 488/448 e 0 to 0 dl 1788201542 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201531.195125:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc95500 with x1875064559640320 ext(350224384->351272959) 00002000:00010000:0.0:1788201531.195133:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc95500 00000100:00100000:3.0:1788201531.324868:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201531.325172:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559640448 00000100:00100000:0.0:1788201531.325185:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559640448 00002000:00100000:0.0:1788201531.325248:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (351272960->352321535) req@ffff9624ba85aa00 x1875064559640448/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:652/0 lens 488/0 e 0 to 0 dl 1788201542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201531.325262:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85aa00 with x1875064559640448 ext(351272960->352321535) 00002000:00010000:0.0:1788201531.325270:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85aa00 00000100:00100000:0.0:1788201531.325311:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 379 00000100:00100000:0.0:1788201531.325322:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2341:x1875064559640448:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201531.345720:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2341:x1875064559640448:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20377us (20847us total) trans 30064771380 rc 0/0 00000100:00100000:1.0:1788201531.345741:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 379 00002000:00100000:1.0:1788201531.345760:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (351272960->352321535) req@ffff9624ba85aa00 x1875064559640448/t30064771380(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:652/0 lens 488/448 e 0 to 0 dl 1788201542 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201531.345812:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85aa00 with x1875064559640448 ext(351272960->352321535) 00002000:00010000:1.0:1788201531.345819:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85aa00 00000100:00100000:3.0:1788201531.452312:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201531.452359:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623812a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570140032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201531.452496:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201531.452804:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570140032 00000100:00100000:0.0:1788201531.452814:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570140032 00000100:00100000:0.0:1788201531.452914:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788201531.452926:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570140032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201531.452959:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 409796608 pending 37486592 free 3530555392 avail 3528458240 00000100:00100000:0.0:1788201531.453026:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570140032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201531.453034:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788201531.453094:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623812a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570140032:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201531.453106:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201531.468610:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201531.468864:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559640576 00000100:00100000:0.0:1788201531.468877:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559640576 00002000:00100000:0.0:1788201531.468941:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (352321536->353370111) req@ffff9624b9dead80 x1875064559640576/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:652/0 lens 488/0 e 0 to 0 dl 1788201542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201531.468954:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9dead80 with x1875064559640576 ext(352321536->353370111) 00002000:00010000:0.0:1788201531.468961:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9dead80 00000100:00100000:0.0:1788201531.469008:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 380 00000100:00100000:0.0:1788201531.469020:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559640576:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201531.490995:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559640576:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21956us (22382us total) trans 30064771381 rc 0/0 00000100:00100000:1.0:1788201531.491017:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 380 00002000:00100000:1.0:1788201531.491035:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (352321536->353370111) req@ffff9624b9dead80 x1875064559640576/t30064771381(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:652/0 lens 488/448 e 0 to 0 dl 1788201542 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201531.491047:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9dead80 with x1875064559640576 ext(352321536->353370111) 00002000:00010000:1.0:1788201531.491054:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9dead80 00000100:00100000:3.0:1788201531.602025:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201531.602162:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559640704 00000100:00100000:2.0:1788201531.602176:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559640704 00002000:00100000:2.0:1788201531.602245:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (353370112->354418687) req@ffff9624b9de8380 x1875064559640704/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:652/0 lens 488/0 e 0 to 0 dl 1788201542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201531.602259:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de8380 with x1875064559640704 ext(353370112->354418687) 00002000:00010000:2.0:1788201531.602265:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de8380 00000100:00100000:2.0:1788201531.602317:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 381 00000100:00100000:2.0:1788201531.602328:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559640704:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201531.620217:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559640704:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17873us (18192us total) trans 30064771382 rc 0/0 00000100:00100000:1.0:1788201531.620236:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 381 00002000:00100000:1.0:1788201531.620252:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (353370112->354418687) req@ffff9624b9de8380 x1875064559640704/t30064771382(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:652/0 lens 488/448 e 0 to 0 dl 1788201542 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201531.620645:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de8380 with x1875064559640704 ext(353370112->354418687) 00002000:00010000:1.0:1788201531.620655:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de8380 00000100:00100000:3.0:1788201531.713075:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201531.713196:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559640832 00000100:00100000:2.0:1788201531.713210:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559640832 00002000:00100000:2.0:1788201531.713286:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (354418688->355467263) req@ffff9624b9dea300 x1875064559640832/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:652/0 lens 488/0 e 0 to 0 dl 1788201542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201531.713298:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9dea300 with x1875064559640832 ext(354418688->355467263) 00002000:00010000:2.0:1788201531.713305:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9dea300 00000100:00100000:2.0:1788201531.713430:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 382 00000100:00100000:2.0:1788201531.713441:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2342:x1875064559640832:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201531.728951:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559640832:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15495us (15876us total) trans 30064771383 rc 0/0 00000100:00100000:2.0:1788201531.728969:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 382 00002000:00100000:2.0:1788201531.728984:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (354418688->355467263) req@ffff9624b9dea300 x1875064559640832/t30064771383(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:652/0 lens 488/448 e 0 to 0 dl 1788201542 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201531.728996:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9dea300 with x1875064559640832 ext(354418688->355467263) 00002000:00010000:2.0:1788201531.729003:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9dea300 00000100:00100000:0.0:1788201531.866634:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201531.866849:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559640960 00000100:00100000:1.0:1788201531.866861:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559640960 00002000:00100000:1.0:1788201531.866931:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (355467264->356515839) req@ffff9624bfd99c00 x1875064559640960/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:652/0 lens 488/0 e 0 to 0 dl 1788201542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201531.866948:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99c00 with x1875064559640960 ext(355467264->356515839) 00002000:00010000:1.0:1788201531.866955:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99c00 00000100:00100000:1.0:1788201531.866997:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 383 00000100:00100000:1.0:1788201531.867029:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2341:x1875064559640960:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201531.886905:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2341:x1875064559640960:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19860us (20269us total) trans 30064771384 rc 0/0 00000100:00100000:1.0:1788201531.886923:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 383 00002000:00100000:1.0:1788201531.886938:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (355467264->356515839) req@ffff9624bfd99c00 x1875064559640960/t30064771384(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:652/0 lens 488/448 e 0 to 0 dl 1788201542 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201531.886950:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99c00 with x1875064559640960 ext(355467264->356515839) 00002000:00010000:1.0:1788201531.886967:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99c00 00000100:00100000:2.0:1788201532.069237:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201532.069318:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559641088 00000100:00100000:3.0:1788201532.069329:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559641088 00002000:00100000:3.0:1788201532.069402:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (356515840->357564415) req@ffff9623812a4380 x1875064559641088/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:653/0 lens 488/0 e 0 to 0 dl 1788201543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201532.069414:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a4380 with x1875064559641088 ext(356515840->357564415) 00002000:00010000:3.0:1788201532.069420:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a4380 00000100:00100000:3.0:1788201532.069454:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 384 00000100:00100000:3.0:1788201532.069464:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2342:x1875064559641088:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201532.078950:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2342:x1875064559641088:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9476us (9711us total) trans 30064771385 rc 0/0 00000100:00100000:3.0:1788201532.078964:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 384 00002000:00100000:3.0:1788201532.078977:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (356515840->357564415) req@ffff9623812a4380 x1875064559641088/t30064771385(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:653/0 lens 488/448 e 0 to 0 dl 1788201543 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201532.078987:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a4380 with x1875064559641088 ext(356515840->357564415) 00002000:00010000:3.0:1788201532.078993:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a4380 00000001:00080000:3.0:1788201532.097615:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771379 is committed 00000001:00080000:3.0:1788201532.097984:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771384 is committed 00010000:00010000:1.0:1788201532.218910:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201532.244382:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201532.246715:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559641216 00000100:00100000:2.0:1788201532.246730:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559641216 00002000:00100000:2.0:1788201532.246971:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (357564416->358612991) req@ffff96248cd05880 x1875064559641216/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:653/0 lens 488/0 e 0 to 0 dl 1788201543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201532.246983:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05880 with x1875064559641216 ext(357564416->358612991) 00002000:00010000:2.0:1788201532.246989:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05880 00000100:00100000:2.0:1788201532.247029:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 385 00000100:00100000:2.0:1788201532.247040:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559641216:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201532.284587:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559641216:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37538us (40236us total) trans 30064771386 rc 0/0 00000100:00100000:1.0:1788201532.284602:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 385 00002000:00100000:1.0:1788201532.284616:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (357564416->358612991) req@ffff96248cd05880 x1875064559641216/t30064771386(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:653/0 lens 488/448 e 0 to 0 dl 1788201543 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201532.284627:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05880 with x1875064559641216 ext(357564416->358612991) 00002000:00010000:1.0:1788201532.284634:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05880 00000100:00100000:2.0:1788201532.424061:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201532.424322:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559641344 00000100:00100000:0.0:1788201532.424333:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559641344 00002000:00100000:0.0:1788201532.424434:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (358612992->359661567) req@ffff9623812a4700 x1875064559641344/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:653/0 lens 488/0 e 0 to 0 dl 1788201543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201532.424450:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a4700 with x1875064559641344 ext(358612992->359661567) 00002000:00010000:0.0:1788201532.424457:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a4700 00000100:00100000:0.0:1788201532.424500:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 386 00000100:00100000:0.0:1788201532.424511:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559641344:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201532.450247:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559641344:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25720us (26183us total) trans 30064771387 rc 0/0 00000100:00100000:1.0:1788201532.450267:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 386 00002000:00100000:1.0:1788201532.450284:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (358612992->359661567) req@ffff9623812a4700 x1875064559641344/t30064771387(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:653/0 lens 488/448 e 0 to 0 dl 1788201543 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201532.450298:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a4700 with x1875064559641344 ext(358612992->359661567) 00002000:00010000:1.0:1788201532.450306:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a4700 00000100:00100000:0.0:1788201532.647933:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201532.649619:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559641472 00000100:00100000:1.0:1788201532.649638:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559641472 00002000:00100000:1.0:1788201532.649719:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (359661568->360710143) req@ffff96248cd04000 x1875064559641472/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:653/0 lens 488/0 e 0 to 0 dl 1788201543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201532.649733:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd04000 with x1875064559641472 ext(359661568->360710143) 00002000:00010000:1.0:1788201532.649740:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd04000 00000100:00100000:1.0:1788201532.649800:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 387 00000100:00100000:1.0:1788201532.649813:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559641472:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201532.673152:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559641472:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23324us (25216us total) trans 30064771388 rc 0/0 00000100:00100000:1.0:1788201532.673180:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 387 00002000:00100000:1.0:1788201532.673197:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (359661568->360710143) req@ffff96248cd04000 x1875064559641472/t30064771388(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:653/0 lens 488/448 e 0 to 0 dl 1788201543 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201532.673210:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd04000 with x1875064559641472 ext(359661568->360710143) 00002000:00010000:1.0:1788201532.673218:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd04000 00000100:00100000:3.0:1788201532.835908:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201532.836146:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559641600 00000100:00100000:0.0:1788201532.836157:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559641600 00002000:00100000:0.0:1788201532.836212:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (360710144->361758719) req@ffff96248c87c000 x1875064559641600/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:653/0 lens 488/0 e 0 to 0 dl 1788201543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201532.836222:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c87c000 with x1875064559641600 ext(360710144->361758719) 00002000:00010000:0.0:1788201532.836228:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c87c000 00000100:00100000:0.0:1788201532.836307:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 388 00000100:00100000:0.0:1788201532.836319:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2341:x1875064559641600:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201532.847730:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559641600:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11395us (11821us total) trans 30064771389 rc 0/0 00000100:00100000:3.0:1788201532.847748:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 388 00002000:00100000:3.0:1788201532.847773:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (360710144->361758719) req@ffff96248c87c000 x1875064559641600/t30064771389(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:653/0 lens 488/448 e 0 to 0 dl 1788201543 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201532.847787:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c87c000 with x1875064559641600 ext(360710144->361758719) 00002000:00010000:3.0:1788201532.847795:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c87c000 00000100:00100000:2.0:1788201533.040557:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201533.040635:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559641728 00000100:00100000:1.0:1788201533.040648:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559641728 00002000:00100000:1.0:1788201533.040798:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (361758720->362807295) req@ffff9624bb8ba300 x1875064559641728/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:654/0 lens 488/0 e 0 to 0 dl 1788201544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201533.040811:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8ba300 with x1875064559641728 ext(361758720->362807295) 00002000:00010000:1.0:1788201533.040818:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8ba300 00000100:00100000:1.0:1788201533.040859:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 389 00000100:00100000:1.0:1788201533.040871:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559641728:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201533.049032:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201533.066825:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559641728:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25940us (26262us total) trans 30064771390 rc 0/0 00000100:00100000:2.0:1788201533.066842:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 389 00002000:00100000:2.0:1788201533.066857:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (361758720->362807295) req@ffff9624bb8ba300 x1875064559641728/t30064771390(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:654/0 lens 488/448 e 0 to 0 dl 1788201544 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201533.066869:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8ba300 with x1875064559641728 ext(361758720->362807295) 00002000:00010000:2.0:1788201533.066876:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8ba300 00000100:00100000:1.0:1788201533.237554:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201533.237629:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201533.237674:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201533.237796:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559641856 00000100:00100000:3.0:1788201533.237809:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559641856 00000100:00100000:3.0:1788201533.237882:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 528 00000100:00100000:3.0:1788201533.237894:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559641856:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201533.237999:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559641856:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 107us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201533.238015:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 528 00000100:00100000:2.0:1788201533.238919:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559641984 00000100:00100000:2.0:1788201533.238928:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559641984 00000100:00100000:2.0:1788201533.239007:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 371 00000100:00100000:2.0:1788201533.239016:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559641984:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201533.239079:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559641984:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 65us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201533.239086:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 371 00000100:00080000:3.0:1788201533.240013:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788201533.240073:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201533.240210:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559642112 00000100:00100000:0.0:1788201533.240217:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559642112 00000100:00100000:0.0:1788201533.240275:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 229 00000100:00100000:0.0:1788201533.240284:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559642112:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201533.240334:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559642112:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 52us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201533.240367:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 229 00000100:00100000:1.0:1788201533.267643:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201533.267877:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559642240 00000100:00100000:0.0:1788201533.267890:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559642240 00002000:00100000:0.0:1788201533.267973:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (362807296->363855871) req@ffff9624ba43fb80 x1875064559642240/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:654/0 lens 488/0 e 0 to 0 dl 1788201544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201533.267986:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43fb80 with x1875064559642240 ext(362807296->363855871) 00002000:00010000:0.0:1788201533.267993:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43fb80 00000100:00100000:0.0:1788201533.268047:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 390 00000100:00100000:0.0:1788201533.268060:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559642240:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201533.290630:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559642240:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22554us (22986us total) trans 30064771391 rc 0/0 00000100:00100000:2.0:1788201533.290649:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 390 00002000:00100000:2.0:1788201533.290665:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (362807296->363855871) req@ffff9624ba43fb80 x1875064559642240/t30064771391(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:654/0 lens 488/448 e 0 to 0 dl 1788201544 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201533.290677:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43fb80 with x1875064559642240 ext(362807296->363855871) 00002000:00010000:2.0:1788201533.290695:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43fb80 00000100:00100000:0.0:1788201533.478830:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201533.479101:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559642368 00000100:00100000:1.0:1788201533.479113:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559642368 00002000:00100000:1.0:1788201533.479175:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (363855872->364904447) req@ffff96248cd07480 x1875064559642368/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:654/0 lens 488/0 e 0 to 0 dl 1788201544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201533.479190:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07480 with x1875064559642368 ext(363855872->364904447) 00002000:00010000:1.0:1788201533.479197:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07480 00000100:00100000:1.0:1788201533.479240:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 391 00000100:00100000:1.0:1788201533.479252:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559642368:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201533.495403:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559642368:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16135us (16572us total) trans 30064771392 rc 0/0 00000100:00100000:1.0:1788201533.495421:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 391 00002000:00100000:1.0:1788201533.495436:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (363855872->364904447) req@ffff96248cd07480 x1875064559642368/t30064771392(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:654/0 lens 488/448 e 0 to 0 dl 1788201544 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201533.495449:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07480 with x1875064559642368 ext(363855872->364904447) 00002000:00010000:1.0:1788201533.495457:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07480 00000100:00100000:3.0:1788201533.727470:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201533.727656:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559642496 00000100:00100000:0.0:1788201533.727668:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559642496 00002000:00100000:0.0:1788201533.727736:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (364904448->365953023) req@ffff9624b9d60700 x1875064559642496/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:654/0 lens 488/0 e 0 to 0 dl 1788201544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201533.727763:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d60700 with x1875064559642496 ext(364904448->365953023) 00002000:00010000:0.0:1788201533.727770:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d60700 00000100:00100000:0.0:1788201533.727812:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 392 00000100:00100000:0.0:1788201533.727825:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559642496:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201533.771888:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559642496:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 44049us (44416us total) trans 30064771393 rc 0/0 00000100:00100000:0.0:1788201533.771907:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 392 00002000:00100000:0.0:1788201533.771924:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (364904448->365953023) req@ffff9624b9d60700 x1875064559642496/t30064771393(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:654/0 lens 488/448 e 0 to 0 dl 1788201544 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201533.771937:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d60700 with x1875064559642496 ext(364904448->365953023) 00002000:00010000:0.0:1788201533.771945:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d60700 00000100:00100000:3.0:1788201533.934489:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201533.934785:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559642624 00000100:00100000:2.0:1788201533.934798:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559642624 00002000:00100000:2.0:1788201533.934864:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (365953024->367001599) req@ffff96248cd57100 x1875064559642624/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:654/0 lens 488/0 e 0 to 0 dl 1788201544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201533.934879:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd57100 with x1875064559642624 ext(365953024->367001599) 00002000:00010000:2.0:1788201533.934885:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd57100 00000100:00100000:2.0:1788201533.934920:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 393 00000100:00100000:2.0:1788201533.934943:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559642624:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201533.951576:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559642624:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16621us (17086us total) trans 30064771394 rc 0/0 00000100:00100000:2.0:1788201533.951592:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 393 00002000:00100000:2.0:1788201533.951607:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (365953024->367001599) req@ffff96248cd57100 x1875064559642624/t30064771394(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:654/0 lens 488/448 e 0 to 0 dl 1788201544 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201533.951619:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd57100 with x1875064559642624 ext(365953024->367001599) 00002000:00010000:2.0:1788201533.951626:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd57100 00000100:00100000:0.0:1788201534.006920:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201534.006952:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570140160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201534.007061:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201534.007245:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570140160 00000100:00100000:1.0:1788201534.007254:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570140160 00000100:00100000:1.0:1788201534.007339:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788201534.007373:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788201534.007380:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570140160:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201534.007388:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788201534.007432:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201534.007491:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570140160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201534.007519:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:0.0:1788201534.007629:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788201534.007682:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba43ce00 x1875064570140160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201534.007704:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570140160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201534.096043:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201534.096196:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559642752 00000100:00100000:0.0:1788201534.096207:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559642752 00002000:00100000:0.0:1788201534.096281:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (367001600->368050175) req@ffff96248cd54700 x1875064559642752/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:655/0 lens 488/0 e 0 to 0 dl 1788201545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201534.096293:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd54700 with x1875064559642752 ext(367001600->368050175) 00002000:00010000:0.0:1788201534.096299:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd54700 00000100:00100000:0.0:1788201534.096414:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 394 00000100:00100000:0.0:1788201534.096426:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559642752:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201534.123081:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559642752:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26637us (27035us total) trans 30064771395 rc 0/0 00000100:00100000:0.0:1788201534.123101:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 394 00002000:00100000:0.0:1788201534.123121:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (367001600->368050175) req@ffff96248cd54700 x1875064559642752/t30064771395(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:655/0 lens 488/448 e 0 to 0 dl 1788201545 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201534.123133:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd54700 with x1875064559642752 ext(367001600->368050175) 00002000:00010000:0.0:1788201534.123141:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd54700 00010000:00010000:3.0:1788201534.263471:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201534.274681:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201534.276422:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559642880 00000100:00100000:1.0:1788201534.276440:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559642880 00002000:00100000:1.0:1788201534.276523:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (368050176->369098751) req@ffff9624c1e55880 x1875064559642880/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:655/0 lens 488/0 e 0 to 0 dl 1788201545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201534.276538:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55880 with x1875064559642880 ext(368050176->369098751) 00002000:00010000:1.0:1788201534.276546:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55880 00000100:00100000:1.0:1788201534.276591:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 395 00000100:00100000:1.0:1788201534.276604:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559642880:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201534.302912:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559642880:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26293us (28228us total) trans 30064771396 rc 0/0 00000100:00100000:1.0:1788201534.302930:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 395 00002000:00100000:1.0:1788201534.302944:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (368050176->369098751) req@ffff9624c1e55880 x1875064559642880/t30064771396(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:655/0 lens 488/448 e 0 to 0 dl 1788201545 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201534.302956:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55880 with x1875064559642880 ext(368050176->369098751) 00002000:00010000:1.0:1788201534.302965:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55880 00000100:00100000:2.0:1788201534.441063:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201534.441170:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559643008 00000100:00100000:3.0:1788201534.441182:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559643008 00002000:00100000:3.0:1788201534.441252:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (369098752->370147327) req@ffff9624c1e54700 x1875064559643008/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:655/0 lens 488/0 e 0 to 0 dl 1788201545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201534.441266:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54700 with x1875064559643008 ext(369098752->370147327) 00002000:00010000:3.0:1788201534.441272:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54700 00000100:00100000:3.0:1788201534.441311:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 396 00000100:00100000:3.0:1788201534.441322:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2341:x1875064559643008:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201534.477869:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559643008:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36399us (36672us total) trans 30064771397 rc 0/0 00000100:00100000:1.0:1788201534.477889:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 396 00002000:00100000:1.0:1788201534.477906:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (369098752->370147327) req@ffff9624c1e54700 x1875064559643008/t30064771397(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:655/0 lens 488/448 e 0 to 0 dl 1788201545 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201534.477919:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54700 with x1875064559643008 ext(369098752->370147327) 00002000:00010000:1.0:1788201534.477927:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54700 00000100:00100000:3.0:1788201534.519392:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570140416:0@lo:400:kworker.0 00000100:00100000:3.0:1788201534.519507:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201534.521420:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570140544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201534.522895:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570140416 00000100:00100000:1.0:1788201534.522917:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570140416 00000100:00100000:1.0:1788201534.523007:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788201534.523020:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570140416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201534.524991:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570140672:0@lo:400:kworker.0 00000100:00100000:0.0:1788201534.528478:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201534.529967:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570140544 00000100:00100000:0.0:1788201534.529984:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570140544 00000100:00100000:0.0:1788201534.530057:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788201534.530069:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570140544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201534.530167:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570140544:12345-0@lo:400:kworker.0 Request processed in 100us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201534.530175:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:0.0:1788201534.530197:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201534.530234:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570140544:0@lo:400:kworker.0 00000100:00100000:0.0:1788201534.530319:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570140288:0@lo:400:kworker.0 00000100:00100000:0.0:1788201534.530396:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201534.530431:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570140800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201534.530466:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201534.532978:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570140288 00000100:00100000:3.0:1788201534.532994:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570140288 00000100:00100000:3.0:1788201534.533076:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1788201534.533087:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570140288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201534.533223:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570140288:12345-0@lo:400:kworker.0 Request processed in 137us (2826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201534.533232:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1788201534.533307:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570140288:0@lo:400:kworker.0 00000100:00100000:3.0:1788201534.533371:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570140800 00000100:00100000:3.0:1788201534.533376:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570140800 00000100:00100000:3.0:1788201534.533421:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788201534.533429:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570140800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201534.533469:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570140800:12345-0@lo:400:kworker.0 Request processed in 41us (3002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201534.533476:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00080000:3.0:1788201534.533492:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201534.533526:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570140800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201534.537155:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570140416:12345-0@lo:400:kworker.0 Request processed in 14122us (17632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201534.537176:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788201534.537278:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570140416:0@lo:400:kworker.0 00000100:00100000:2.0:1788201534.543901:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201534.544093:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570140672 00000100:00100000:0.0:1788201534.544105:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570140672 00000100:00100000:0.0:1788201534.544245:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788201534.544261:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570140672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201534.544377:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570140672:12345-0@lo:400:kworker.0 Request processed in 119us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201534.544385:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788201534.544489:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570140672:0@lo:400:kworker.0 00000100:00080000:3.0:1788201534.546032:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201534.615879:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201534.615994:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559643136 00000100:00100000:2.0:1788201534.616010:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559643136 00002000:00100000:2.0:1788201534.616311:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (370147328->371195903) req@ffff962381a1bb80 x1875064559643136/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:655/0 lens 488/0 e 0 to 0 dl 1788201545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201534.616324:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a1bb80 with x1875064559643136 ext(370147328->371195903) 00002000:00010000:2.0:1788201534.617319:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a1bb80 00000100:00100000:2.0:1788201534.617472:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 397 00000100:00100000:2.0:1788201534.617488:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559643136:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201534.638506:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559643136:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21007us (22620us total) trans 30064771398 rc 0/0 00000100:00100000:1.0:1788201534.638523:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 397 00002000:00100000:1.0:1788201534.638539:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (370147328->371195903) req@ffff962381a1bb80 x1875064559643136/t30064771398(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:655/0 lens 488/448 e 0 to 0 dl 1788201545 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201534.638549:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a1bb80 with x1875064559643136 ext(370147328->371195903) 00002000:00010000:1.0:1788201534.638556:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a1bb80 00000100:00100000:2.0:1788201534.777917:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201534.778259:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559643264 00000100:00100000:0.0:1788201534.778270:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559643264 00002000:00100000:0.0:1788201534.778319:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (371195904->372244479) req@ffff96248e361880 x1875064559643264/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:655/0 lens 488/0 e 0 to 0 dl 1788201545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201534.778328:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361880 with x1875064559643264 ext(371195904->372244479) 00002000:00010000:0.0:1788201534.778332:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361880 00000100:00100000:0.0:1788201534.778417:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 398 00000100:00100000:0.0:1788201534.778425:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559643264:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201534.796648:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559643264:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18214us (18728us total) trans 30064771399 rc 0/0 00000100:00100000:0.0:1788201534.796659:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 398 00002000:00100000:0.0:1788201534.796671:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (371195904->372244479) req@ffff96248e361880 x1875064559643264/t30064771399(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:655/0 lens 488/448 e 0 to 0 dl 1788201545 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201534.796679:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361880 with x1875064559643264 ext(371195904->372244479) 00002000:00010000:0.0:1788201534.796684:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361880 00000100:00100000:3.0:1788201534.892917:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201534.893035:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559643392 00000100:00100000:1.0:1788201534.893046:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559643392 00002000:00100000:1.0:1788201534.893098:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (372244480->373293055) req@ffff962381a18380 x1875064559643392/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:655/0 lens 488/0 e 0 to 0 dl 1788201545 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201534.893110:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a18380 with x1875064559643392 ext(372244480->373293055) 00002000:00010000:1.0:1788201534.893115:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a18380 00000100:00100000:1.0:1788201534.893156:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 399 00000100:00100000:1.0:1788201534.893166:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559643392:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201534.903896:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559643392:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10722us (10979us total) trans 30064771400 rc 0/0 00000100:00100000:1.0:1788201534.903909:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 399 00002000:00100000:1.0:1788201534.903922:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (372244480->373293055) req@ffff962381a18380 x1875064559643392/t30064771400(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:655/0 lens 488/448 e 0 to 0 dl 1788201545 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201534.903930:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a18380 with x1875064559643392 ext(372244480->373293055) 00002000:00010000:1.0:1788201534.903936:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a18380 00000100:00100000:0.0:1788201535.059453:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201535.061214:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559643520 00000100:00100000:1.0:1788201535.061228:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559643520 00002000:00100000:1.0:1788201535.061308:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (373293056->374341631) req@ffff9624904a0000 x1875064559643520/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:656/0 lens 488/0 e 0 to 0 dl 1788201546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201535.061320:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a0000 with x1875064559643520 ext(373293056->374341631) 00002000:00010000:1.0:1788201535.061326:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a0000 00000100:00100000:1.0:1788201535.061387:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 400 00000100:00100000:1.0:1788201535.061399:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559643520:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201535.061859:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201535.074500:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559643520:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13091us (15045us total) trans 30064771401 rc 0/0 00000100:00100000:1.0:1788201535.074517:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 400 00002000:00100000:1.0:1788201535.074529:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (373293056->374341631) req@ffff9624904a0000 x1875064559643520/t30064771401(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:656/0 lens 488/448 e 0 to 0 dl 1788201546 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201535.074540:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a0000 with x1875064559643520 ext(373293056->374341631) 00002000:00010000:1.0:1788201535.074545:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a0000 00000100:00100000:2.0:1788201535.251530:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201535.252159:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559643648 00000100:00100000:1.0:1788201535.252184:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559643648 00002000:00100000:1.0:1788201535.252249:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (374341632->375390207) req@ffff96248e362a00 x1875064559643648/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:656/0 lens 488/0 e 0 to 0 dl 1788201546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201535.252259:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e362a00 with x1875064559643648 ext(374341632->375390207) 00002000:00010000:1.0:1788201535.252265:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e362a00 00000100:00100000:1.0:1788201535.252303:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 401 00000100:00100000:1.0:1788201535.252314:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559643648:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201535.268868:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559643648:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16535us (17327us total) trans 30064771402 rc 0/0 00000100:00100000:1.0:1788201535.268896:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 401 00002000:00100000:1.0:1788201535.268915:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (374341632->375390207) req@ffff96248e362a00 x1875064559643648/t30064771402(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:656/0 lens 488/448 e 0 to 0 dl 1788201546 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201535.268927:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e362a00 with x1875064559643648 ext(374341632->375390207) 00002000:00010000:1.0:1788201535.268934:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e362a00 00010000:00010000:1.0:1788201535.286615:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201535.408042:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201535.408181:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559643776 00000100:00100000:2.0:1788201535.408207:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559643776 00002000:00100000:2.0:1788201535.408273:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (375390208->376438783) req@ffff9624904a3800 x1875064559643776/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:656/0 lens 488/0 e 0 to 0 dl 1788201546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201535.408284:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a3800 with x1875064559643776 ext(375390208->376438783) 00002000:00010000:2.0:1788201535.408290:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a3800 00000100:00100000:2.0:1788201535.408332:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 402 00000100:00100000:2.0:1788201535.408371:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559643776:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201535.420271:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559643776:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11912us (12226us total) trans 30064771403 rc 0/0 00000100:00100000:0.0:1788201535.420306:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 402 00002000:00100000:0.0:1788201535.420322:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (375390208->376438783) req@ffff9624904a3800 x1875064559643776/t30064771403(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:656/0 lens 488/448 e 0 to 0 dl 1788201546 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201535.420335:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a3800 with x1875064559643776 ext(375390208->376438783) 00002000:00010000:0.0:1788201535.420369:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a3800 00000100:00100000:2.0:1788201535.565529:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201535.565699:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559643904 00000100:00100000:0.0:1788201535.565713:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559643904 00002000:00100000:0.0:1788201535.565791:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (376438784->377487359) req@ffff96248e361180 x1875064559643904/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:656/0 lens 488/0 e 0 to 0 dl 1788201546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201535.565806:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361180 with x1875064559643904 ext(376438784->377487359) 00002000:00010000:0.0:1788201535.565813:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361180 00000100:00100000:0.0:1788201535.565852:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 403 00000100:00100000:0.0:1788201535.565864:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2342:x1875064559643904:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201535.586697:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2342:x1875064559643904:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20818us (21177us total) trans 30064771404 rc 0/0 00000100:00100000:0.0:1788201535.586714:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 403 00002000:00100000:0.0:1788201535.586742:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (376438784->377487359) req@ffff96248e361180 x1875064559643904/t30064771404(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:656/0 lens 488/448 e 0 to 0 dl 1788201546 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201535.586755:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361180 with x1875064559643904 ext(376438784->377487359) 00002000:00010000:0.0:1788201535.586764:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361180 00000100:00100000:2.0:1788201535.773018:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201535.773501:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559644032 00000100:00100000:1.0:1788201535.773516:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559644032 00002000:00100000:1.0:1788201535.773587:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (377487360->378535935) req@ffff96248e360700 x1875064559644032/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:656/0 lens 488/0 e 0 to 0 dl 1788201546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201535.773601:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360700 with x1875064559644032 ext(377487360->378535935) 00002000:00010000:1.0:1788201535.773608:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360700 00000100:00100000:1.0:1788201535.773650:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 404 00000100:00100000:1.0:1788201535.773663:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559644032:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201535.794476:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559644032:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20793us (21452us total) trans 30064771405 rc 0/0 00000100:00100000:1.0:1788201535.794514:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 404 00002000:00100000:1.0:1788201535.794534:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (377487360->378535935) req@ffff96248e360700 x1875064559644032/t30064771405(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:656/0 lens 488/448 e 0 to 0 dl 1788201546 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201535.794547:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360700 with x1875064559644032 ext(377487360->378535935) 00002000:00010000:1.0:1788201535.794555:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360700 00000100:00100000:3.0:1788201535.993820:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201535.994878:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559644160 00000100:00100000:1.0:1788201535.994893:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559644160 00002000:00100000:1.0:1788201535.994971:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (378535936->379584511) req@ffff962381a1b480 x1875064559644160/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:656/0 lens 488/0 e 0 to 0 dl 1788201546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201535.994985:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a1b480 with x1875064559644160 ext(378535936->379584511) 00002000:00010000:1.0:1788201535.994992:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a1b480 00000100:00100000:0.0:1788201535.995193:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 405 00000100:00100000:0.0:1788201535.995207:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559644160:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201536.014667:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559644160:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19447us (20847us total) trans 30064771406 rc 0/0 00000100:00100000:2.0:1788201536.014685:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 405 00002000:00100000:2.0:1788201536.014700:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (378535936->379584511) req@ffff962381a1b480 x1875064559644160/t30064771406(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:656/0 lens 488/448 e 0 to 0 dl 1788201546 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201536.014721:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a1b480 with x1875064559644160 ext(378535936->379584511) 00002000:00010000:2.0:1788201536.014730:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a1b480 00000100:00100000:2.0:1788201536.176602:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201536.176821:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559644288 00000100:00100000:0.0:1788201536.176833:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559644288 00002000:00100000:0.0:1788201536.176896:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (379584512->380633087) req@ffff96248e362300 x1875064559644288/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:657/0 lens 488/0 e 0 to 0 dl 1788201547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201536.176910:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e362300 with x1875064559644288 ext(379584512->380633087) 00002000:00010000:0.0:1788201536.176916:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e362300 00000100:00100000:0.0:1788201536.176954:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 406 00000100:00100000:0.0:1788201536.176966:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559644288:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201536.209992:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559644288:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33009us (33387us total) trans 30064771407 rc 0/0 00000100:00100000:0.0:1788201536.210012:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 406 00002000:00100000:0.0:1788201536.210028:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (379584512->380633087) req@ffff96248e362300 x1875064559644288/t30064771407(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:657/0 lens 488/448 e 0 to 0 dl 1788201547 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201536.210041:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e362300 with x1875064559644288 ext(379584512->380633087) 00002000:00010000:0.0:1788201536.210050:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e362300 00010000:00010000:1.0:1788201536.310888:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201536.386739:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201536.387148:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559644416 00000100:00100000:1.0:1788201536.387161:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559644416 00002000:00100000:1.0:1788201536.387245:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (380633088->381681663) req@ffff962381a1a680 x1875064559644416/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:657/0 lens 488/0 e 0 to 0 dl 1788201547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201536.387257:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a1a680 with x1875064559644416 ext(380633088->381681663) 00002000:00010000:1.0:1788201536.387263:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a1a680 00000100:00100000:1.0:1788201536.387309:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 407 00000100:00100000:1.0:1788201536.387319:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559644416:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201536.421162:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559644416:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33826us (34420us total) trans 30064771408 rc 0/0 00000100:00100000:1.0:1788201536.421635:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 407 00002000:00100000:1.0:1788201536.421664:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (380633088->381681663) req@ffff962381a1a680 x1875064559644416/t30064771408(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:657/0 lens 488/448 e 0 to 0 dl 1788201547 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201536.421677:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a1a680 with x1875064559644416 ext(380633088->381681663) 00002000:00010000:1.0:1788201536.421684:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a1a680 00000100:00100000:1.0:1788201536.567089:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248e361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570140928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201536.567208:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201536.567561:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570140928 00000100:00100000:3.0:1788201536.567572:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570140928 00000100:00100000:3.0:1788201536.567656:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788201536.567669:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570140928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201536.567711:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 460914688 pending 40894464 free 3503292416 avail 3501195264 00000100:00100000:3.0:1788201536.567768:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570140928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201536.567800:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788201536.567996:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248e361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570140928:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201536.568022:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201536.621948:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201536.623386:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559644544 00000100:00100000:1.0:1788201536.623401:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559644544 00002000:00100000:1.0:1788201536.623472:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (381681664->382730239) req@ffff96248e360380 x1875064559644544/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:657/0 lens 488/0 e 0 to 0 dl 1788201547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201536.623486:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360380 with x1875064559644544 ext(381681664->382730239) 00002000:00010000:1.0:1788201536.623492:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360380 00000100:00100000:1.0:1788201536.623536:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 408 00000100:00100000:1.0:1788201536.623548:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559644544:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201536.657465:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559644544:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33898us (35512us total) trans 30064771409 rc 0/0 00000100:00100000:1.0:1788201536.657486:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 408 00002000:00100000:1.0:1788201536.657506:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (381681664->382730239) req@ffff96248e360380 x1875064559644544/t30064771409(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:657/0 lens 488/448 e 0 to 0 dl 1788201547 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201536.657520:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360380 with x1875064559644544 ext(381681664->382730239) 00002000:00010000:1.0:1788201536.657539:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360380 00000100:00100000:0.0:1788201536.778636:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201536.778826:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559644672 00000100:00100000:2.0:1788201536.778839:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559644672 00002000:00100000:2.0:1788201536.778917:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (382730240->383778815) req@ffff9624b9d20700 x1875064559644672/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:657/0 lens 488/0 e 0 to 0 dl 1788201547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201536.778932:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d20700 with x1875064559644672 ext(382730240->383778815) 00002000:00010000:2.0:1788201536.778939:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d20700 00000100:00100000:2.0:1788201536.778979:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 409 00000100:00100000:2.0:1788201536.778991:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559644672:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201536.803542:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2344:x1875064559644672:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24535us (24906us total) trans 30064771410 rc 0/0 00000100:00100000:1.0:1788201536.803560:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 409 00002000:00100000:1.0:1788201536.803576:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (382730240->383778815) req@ffff9624b9d20700 x1875064559644672/t30064771410(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:657/0 lens 488/448 e 0 to 0 dl 1788201547 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201536.803589:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d20700 with x1875064559644672 ext(382730240->383778815) 00002000:00010000:1.0:1788201536.803598:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d20700 00000100:00100000:3.0:1788201536.992836:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201536.992974:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559644800 00000100:00100000:0.0:1788201536.992986:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559644800 00002000:00100000:0.0:1788201536.993048:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (383778816->384827391) req@ffff962490589500 x1875064559644800/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:657/0 lens 488/0 e 0 to 0 dl 1788201547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201536.993062:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962490589500 with x1875064559644800 ext(383778816->384827391) 00002000:00010000:0.0:1788201536.993068:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962490589500 00000100:00100000:0.0:1788201536.993113:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 410 00000100:00100000:0.0:1788201536.993124:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559644800:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201537.011179:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2343:x1875064559644800:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18039us (18341us total) trans 30064771411 rc 0/0 00000100:00100000:3.0:1788201537.011197:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 410 00002000:00100000:3.0:1788201537.011211:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (383778816->384827391) req@ffff962490589500 x1875064559644800/t30064771411(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:657/0 lens 488/448 e 0 to 0 dl 1788201547 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201537.011224:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962490589500 with x1875064559644800 ext(383778816->384827391) 00002000:00010000:3.0:1788201537.011232:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962490589500 00000001:00080000:3.0:1788201537.230787:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771407 is committed 00000001:00080000:3.0:1788201537.230848:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771410 is committed 00000001:00080000:3.0:1788201537.230947:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771411 is committed 00010000:00010000:3.0:1788201537.335271:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201537.344855:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201537.344986:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559644928 00000100:00100000:1.0:1788201537.344997:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559644928 00002000:00100000:1.0:1788201537.345084:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (384827392->385875967) req@ffff96248e361f80 x1875064559644928/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:658/0 lens 488/0 e 0 to 0 dl 1788201548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201537.345227:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361f80 with x1875064559644928 ext(384827392->385875967) 00002000:00010000:1.0:1788201537.345236:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361f80 00000100:00100000:1.0:1788201537.345317:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 411 00000100:00100000:1.0:1788201537.345330:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559644928:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201537.346334:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201537.362914:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559644928:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17569us (18057us total) trans 30064771412 rc 0/0 00000100:00100000:1.0:1788201537.362933:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 411 00002000:00100000:1.0:1788201537.362950:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (384827392->385875967) req@ffff96248e361f80 x1875064559644928/t30064771412(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:658/0 lens 488/448 e 0 to 0 dl 1788201548 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201537.362962:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361f80 with x1875064559644928 ext(384827392->385875967) 00002000:00010000:1.0:1788201537.362971:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361f80 00000100:00100000:2.0:1788201537.481540:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201537.482135:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559645056 00000100:00100000:1.0:1788201537.482151:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559645056 00002000:00100000:1.0:1788201537.482245:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (385875968->386924543) req@ffff96248e363480 x1875064559645056/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:658/0 lens 488/0 e 0 to 0 dl 1788201548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201537.482259:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363480 with x1875064559645056 ext(385875968->386924543) 00002000:00010000:1.0:1788201537.482266:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363480 00000100:00100000:1.0:1788201537.482316:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 412 00000100:00100000:1.0:1788201537.482327:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559645056:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201537.502774:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559645056:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20433us (21231us total) trans 30064771413 rc 0/0 00000100:00100000:1.0:1788201537.502790:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 412 00002000:00100000:1.0:1788201537.502806:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (385875968->386924543) req@ffff96248e363480 x1875064559645056/t30064771413(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:658/0 lens 488/448 e 0 to 0 dl 1788201548 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201537.502818:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363480 with x1875064559645056 ext(385875968->386924543) 00002000:00010000:1.0:1788201537.502825:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363480 00000100:00100000:2.0:1788201537.731657:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201537.731786:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559645184 00000100:00100000:1.0:1788201537.731797:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559645184 00002000:00100000:1.0:1788201537.731861:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (386924544->387973119) req@ffff96248e363800 x1875064559645184/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:658/0 lens 488/0 e 0 to 0 dl 1788201548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201537.731875:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363800 with x1875064559645184 ext(386924544->387973119) 00002000:00010000:1.0:1788201537.731881:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363800 00000100:00100000:1.0:1788201537.731924:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 413 00000100:00100000:1.0:1788201537.731937:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559645184:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201537.751451:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559645184:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19499us (19792us total) trans 30064771414 rc 0/0 00000100:00100000:1.0:1788201537.751488:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 413 00002000:00100000:1.0:1788201537.751504:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (386924544->387973119) req@ffff96248e363800 x1875064559645184/t30064771414(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:658/0 lens 488/448 e 0 to 0 dl 1788201548 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201537.751515:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363800 with x1875064559645184 ext(386924544->387973119) 00002000:00010000:1.0:1788201537.751523:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363800 00000100:00100000:3.0:1788201537.868194:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201537.868402:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559645312 00000100:00100000:0.0:1788201537.868414:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559645312 00002000:00100000:0.0:1788201537.868471:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (387973120->389021695) req@ffff962492c26680 x1875064559645312/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:658/0 lens 488/0 e 0 to 0 dl 1788201548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201537.868481:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c26680 with x1875064559645312 ext(387973120->389021695) 00002000:00010000:0.0:1788201537.868486:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c26680 00000100:00100000:0.0:1788201537.868506:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 414 00000100:00100000:0.0:1788201537.868514:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559645312:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201537.894546:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559645312:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26012us (26349us total) trans 30064771415 rc 0/0 00000100:00100000:0.0:1788201537.894565:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 414 00002000:00100000:0.0:1788201537.894581:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (387973120->389021695) req@ffff962492c26680 x1875064559645312/t30064771415(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:658/0 lens 488/448 e 0 to 0 dl 1788201548 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201537.894594:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c26680 with x1875064559645312 ext(387973120->389021695) 00002000:00010000:0.0:1788201537.894602:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c26680 00000100:00100000:3.0:1788201538.014587:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201538.014775:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559645440 00000100:00100000:2.0:1788201538.014786:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559645440 00002000:00100000:2.0:1788201538.014851:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (389021696->390070271) req@ffff962492c25f80 x1875064559645440/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/0 e 0 to 0 dl 1788201549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201538.014864:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c25f80 with x1875064559645440 ext(389021696->390070271) 00002000:00010000:2.0:1788201538.014872:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c25f80 00000100:00100000:2.0:1788201538.014913:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 415 00000100:00100000:2.0:1788201538.014924:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559645440:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201538.028732:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559645440:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13793us (14143us total) trans 30064771416 rc 0/0 00000100:00100000:2.0:1788201538.028748:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 415 00002000:00100000:2.0:1788201538.028761:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (389021696->390070271) req@ffff962492c25f80 x1875064559645440/t30064771416(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/448 e 0 to 0 dl 1788201549 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201538.028793:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c25f80 with x1875064559645440 ext(389021696->390070271) 00002000:00010000:2.0:1788201538.028800:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c25f80 00000100:00100000:1.0:1788201538.093993:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201538.098357:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559645568 00000100:00100000:3.0:1788201538.098377:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559645568 00002000:00100000:3.0:1788201538.098453:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (390070272->391118847) req@ffff9624ba471c00 x1875064559645568/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/0 e 0 to 0 dl 1788201549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201538.098477:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba471c00 with x1875064559645568 ext(390070272->391118847) 00002000:00010000:3.0:1788201538.098483:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba471c00 00000100:00100000:3.0:1788201538.098517:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 416 00000100:00100000:3.0:1788201538.098527:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559645568:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201538.115731:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559645568:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17187us (21738us total) trans 30064771417 rc 0/0 00000100:00100000:3.0:1788201538.115767:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 416 00002000:00100000:3.0:1788201538.115785:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (390070272->391118847) req@ffff9624ba471c00 x1875064559645568/t30064771417(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/448 e 0 to 0 dl 1788201549 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201538.115796:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba471c00 with x1875064559645568 ext(390070272->391118847) 00002000:00010000:3.0:1788201538.115804:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba471c00 00000100:00100000:0.0:1788201538.190807:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201538.191013:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559645696 00000100:00100000:1.0:1788201538.191025:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559645696 00002000:00100000:1.0:1788201538.191094:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (391118848->392167423) req@ffff9624b9d20e00 x1875064559645696/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/0 e 0 to 0 dl 1788201549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201538.191108:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d20e00 with x1875064559645696 ext(391118848->392167423) 00002000:00010000:1.0:1788201538.191115:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d20e00 00000100:00100000:1.0:1788201538.191155:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 417 00000100:00100000:1.0:1788201538.191176:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559645696:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201538.211460:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559645696:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20269us (20651us total) trans 30064771418 rc 0/0 00000100:00100000:1.0:1788201538.211476:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 417 00002000:00100000:1.0:1788201538.211492:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (391118848->392167423) req@ffff9624b9d20e00 x1875064559645696/t30064771418(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/448 e 0 to 0 dl 1788201549 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201538.211504:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d20e00 with x1875064559645696 ext(391118848->392167423) 00002000:00010000:1.0:1788201538.211511:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d20e00 00000100:00100000:3.0:1788201538.294825:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201538.295176:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559645824 00000100:00100000:0.0:1788201538.295187:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559645824 00002000:00100000:0.0:1788201538.295256:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (392167424->393215999) req@ffff9623939cd880 x1875064559645824/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/0 e 0 to 0 dl 1788201549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201538.295270:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cd880 with x1875064559645824 ext(392167424->393215999) 00002000:00010000:0.0:1788201538.295277:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cd880 00000100:00100000:0.0:1788201538.295315:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 418 00000100:00100000:0.0:1788201538.295327:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559645824:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201538.311316:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559645824:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15929us (16445us total) trans 30064771419 rc 0/0 00000100:00100000:2.0:1788201538.311330:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 418 00002000:00100000:2.0:1788201538.311363:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (392167424->393215999) req@ffff9623939cd880 x1875064559645824/t30064771419(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/448 e 0 to 0 dl 1788201549 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201538.311372:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cd880 with x1875064559645824 ext(392167424->393215999) 00002000:00010000:2.0:1788201538.311379:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cd880 00000100:00100000:2.0:1788201538.353845:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201538.353978:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201538.355948:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559645952 00000100:00100000:1.0:1788201538.355966:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559645952 00000100:00100000:1.0:1788201538.356082:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 530 00000100:00100000:1.0:1788201538.356095:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559645952:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201538.356216:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559645952:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 124us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201538.356223:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 530 00000100:00100000:0.0:1788201538.357553:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559646080 00000100:00100000:0.0:1788201538.357564:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559646080 00010000:00010000:1.0:1788201538.361132:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201538.361379:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 375 00000100:00100000:2.0:1788201538.361391:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559646080:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201538.361579:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559646080:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 189us (7750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.361585:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 375 00000100:00080000:3.0:1788201538.366089:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201538.383727:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201538.383847:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559646208 00000100:00100000:1.0:1788201538.383860:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559646208 00002000:00100000:1.0:1788201538.383922:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (393216000->394264575) req@ffff96248e360e00 x1875064559646208/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/0 e 0 to 0 dl 1788201549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201538.383936:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360e00 with x1875064559646208 ext(393216000->394264575) 00002000:00010000:1.0:1788201538.383943:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360e00 00000100:00100000:1.0:1788201538.383983:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 419 00000100:00100000:1.0:1788201538.383994:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559646208:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201538.409546:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559646208:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25534us (25813us total) trans 30064771420 rc 0/0 00000100:00100000:3.0:1788201538.409566:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 419 00002000:00100000:3.0:1788201538.409585:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (393216000->394264575) req@ffff96248e360e00 x1875064559646208/t30064771420(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/448 e 0 to 0 dl 1788201549 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201538.409597:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360e00 with x1875064559646208 ext(393216000->394264575) 00002000:00010000:3.0:1788201538.409603:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360e00 00000100:00100000:1.0:1788201538.494701:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201538.497332:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559646336 00000100:00100000:3.0:1788201538.497366:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559646336 00002000:00100000:3.0:1788201538.497524:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (394264576->395313151) req@ffff9624c1e5b480 x1875064559646336/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/0 e 0 to 0 dl 1788201549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201538.497538:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5b480 with x1875064559646336 ext(394264576->395313151) 00002000:00010000:3.0:1788201538.497545:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5b480 00000100:00100000:3.0:1788201538.497679:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 420 00000100:00100000:3.0:1788201538.497691:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559646336:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201538.519491:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559646336:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21783us (24788us total) trans 30064771421 rc 0/0 00000100:00100000:3.0:1788201538.519522:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 420 00002000:00100000:3.0:1788201538.519539:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (394264576->395313151) req@ffff9624c1e5b480 x1875064559646336/t30064771421(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/448 e 0 to 0 dl 1788201549 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201538.519550:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5b480 with x1875064559646336 ext(394264576->395313151) 00002000:00010000:3.0:1788201538.519570:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5b480 00000100:00100000:1.0:1788201538.605825:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201538.612798:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559646464 00000100:00100000:2.0:1788201538.612822:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559646464 00002000:00100000:2.0:1788201538.612908:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (395313152->396361727) req@ffff9624c1e59f80 x1875064559646464/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/0 e 0 to 0 dl 1788201549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201538.612921:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e59f80 with x1875064559646464 ext(395313152->396361727) 00002000:00010000:2.0:1788201538.612929:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e59f80 00000100:00100000:2.0:1788201538.612986:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 421 00000100:00100000:2.0:1788201538.612997:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559646464:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201538.713894:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559646464:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 100881us (108069us total) trans 30064771422 rc 0/0 00000100:00100000:2.0:1788201538.713911:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 421 00002000:00100000:2.0:1788201538.713926:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (395313152->396361727) req@ffff9624c1e59f80 x1875064559646464/t30064771422(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/448 e 0 to 0 dl 1788201549 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201538.713938:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e59f80 with x1875064559646464 ext(395313152->396361727) 00002000:00010000:2.0:1788201538.713946:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e59f80 00000100:00100000:0.0:1788201538.857642:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201538.865899:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559646592 00000100:00100000:2.0:1788201538.865922:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559646592 00002000:00100000:2.0:1788201538.866011:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (396361728->397410303) req@ffff9624c1e02d80 x1875064559646592/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/0 e 0 to 0 dl 1788201549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201538.866196:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02d80 with x1875064559646592 ext(396361728->397410303) 00002000:00010000:2.0:1788201538.866205:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02d80 00000100:00100000:2.0:1788201538.866327:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 422 00000100:00100000:2.0:1788201538.866339:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559646592:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201538.886480:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559646592:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20129us (28836us total) trans 30064771423 rc 0/0 00000100:00100000:0.0:1788201538.886497:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 422 00002000:00100000:0.0:1788201538.886512:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (396361728->397410303) req@ffff9624c1e02d80 x1875064559646592/t30064771423(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:659/0 lens 488/448 e 0 to 0 dl 1788201549 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201538.886524:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02d80 with x1875064559646592 ext(396361728->397410303) 00002000:00010000:0.0:1788201538.886532:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02d80 00000100:00100000:1.0:1788201539.026224:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201539.026391:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559646720 00000100:00100000:0.0:1788201539.026402:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559646720 00002000:00100000:0.0:1788201539.026593:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (397410304->398458879) req@ffff9624c1e58a80 x1875064559646720/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/0 e 0 to 0 dl 1788201550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201539.026608:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e58a80 with x1875064559646720 ext(397410304->398458879) 00002000:00010000:0.0:1788201539.026615:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e58a80 00000100:00100000:0.0:1788201539.026654:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 423 00000100:00100000:0.0:1788201539.026674:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559646720:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201539.027788:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201539.047465:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559646720:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20777us (21240us total) trans 30064771424 rc 0/0 00000100:00100000:2.0:1788201539.047481:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 423 00002000:00100000:2.0:1788201539.047496:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (397410304->398458879) req@ffff9624c1e58a80 x1875064559646720/t30064771424(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/448 e 0 to 0 dl 1788201550 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201539.047509:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e58a80 with x1875064559646720 ext(397410304->398458879) 00002000:00010000:2.0:1788201539.047535:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e58a80 00000100:00100000:0.0:1788201539.126952:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570141056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201539.127052:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201539.127246:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570141056 00000100:00100000:1.0:1788201539.127255:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570141056 00000100:00100000:1.0:1788201539.127324:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788201539.127334:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570141056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201539.127398:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201539.127594:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570141056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 262us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201539.127602:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:3.0:1788201539.128543:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201539.131670:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e59180 x1875064570141056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201539.131705:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570141056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201539.234674:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201539.234777:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559646848 00000100:00100000:3.0:1788201539.234795:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559646848 00002000:00100000:3.0:1788201539.234870:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (398458880->399507455) req@ffff9624c1e5aa00 x1875064559646848/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/0 e 0 to 0 dl 1788201550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201539.234884:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5aa00 with x1875064559646848 ext(398458880->399507455) 00002000:00010000:3.0:1788201539.234890:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5aa00 00000100:00100000:3.0:1788201539.234935:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 424 00000100:00100000:3.0:1788201539.234946:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559646848:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201539.256648:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559646848:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21685us (21979us total) trans 30064771425 rc 0/0 00000100:00100000:3.0:1788201539.256681:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 424 00002000:00100000:3.0:1788201539.256701:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (398458880->399507455) req@ffff9624c1e5aa00 x1875064559646848/t30064771425(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/448 e 0 to 0 dl 1788201550 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201539.256712:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5aa00 with x1875064559646848 ext(398458880->399507455) 00002000:00010000:3.0:1788201539.256720:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5aa00 00010000:00010000:1.0:1788201539.382954:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201539.450110:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201539.450224:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559646976 00000100:00100000:2.0:1788201539.450238:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559646976 00002000:00100000:2.0:1788201539.450296:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (399507456->400556031) req@ffff9624c1e59180 x1875064559646976/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/0 e 0 to 0 dl 1788201550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201539.450308:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e59180 with x1875064559646976 ext(399507456->400556031) 00002000:00010000:2.0:1788201539.450313:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e59180 00000100:00100000:2.0:1788201539.450385:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 425 00000100:00100000:2.0:1788201539.450396:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559646976:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201539.462408:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559646976:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12002us (12297us total) trans 30064771426 rc 0/0 00000100:00100000:2.0:1788201539.462422:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 425 00002000:00100000:2.0:1788201539.462435:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (399507456->400556031) req@ffff9624c1e59180 x1875064559646976/t30064771426(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/448 e 0 to 0 dl 1788201550 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201539.462447:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e59180 with x1875064559646976 ext(399507456->400556031) 00002000:00010000:2.0:1788201539.462453:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e59180 00000100:00100000:0.0:1788201539.609136:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201539.609704:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559647104 00000100:00100000:2.0:1788201539.609718:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559647104 00002000:00100000:2.0:1788201539.610402:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (400556032->401604607) req@ffff9624c1e03100 x1875064559647104/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/0 e 0 to 0 dl 1788201550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201539.610416:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e03100 with x1875064559647104 ext(400556032->401604607) 00002000:00010000:2.0:1788201539.610422:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e03100 00000100:00100000:2.0:1788201539.610463:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 426 00000100:00100000:2.0:1788201539.610474:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559647104:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201539.629635:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559647104:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19145us (20492us total) trans 30064771427 rc 0/0 00000100:00100000:2.0:1788201539.629664:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 426 00002000:00100000:2.0:1788201539.629681:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (400556032->401604607) req@ffff9624c1e03100 x1875064559647104/t30064771427(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/448 e 0 to 0 dl 1788201550 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201539.629694:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e03100 with x1875064559647104 ext(400556032->401604607) 00002000:00010000:2.0:1788201539.629701:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e03100 00000100:00100000:2.0:1788201539.641381:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570141184:0@lo:400:kworker.0 00000100:00100000:2.0:1788201539.641483:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201539.641558:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570141696:0@lo:400:kworker.0 00000100:00100000:2.0:1788201539.641593:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201539.641616:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201539.641622:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570141312:0@lo:400:kworker.0 00000100:00100000:2.0:1788201539.641661:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201539.641695:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570141184 00000100:00100000:2.0:1788201539.641704:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570141184 00000100:00100000:2.0:1788201539.641760:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1788201539.641770:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570141184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201539.641832:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570141184:12345-0@lo:400:kworker.0 Request processed in 62us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201539.641840:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1788201539.641882:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570141696 00000100:00100000:2.0:1788201539.641886:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570141696 00000100:00100000:2.0:1788201539.641926:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570141312 00000100:00100000:2.0:1788201539.641929:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570141312 00000100:00100000:2.0:1788201539.641962:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788201539.641968:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570141696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201539.642002:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570141696:12345-0@lo:400:kworker.0 Request processed in 34us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201539.642009:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788201539.642021:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788201539.642028:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570141312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201539.642057:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570141312:12345-0@lo:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201539.642063:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00080000:2.0:1788201539.642080:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201539.642127:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570141312:0@lo:400:kworker.0 00000100:00100000:2.0:1788201539.642140:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570141696:0@lo:400:kworker.0 00000100:00100000:2.0:1788201539.642148:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570141184:0@lo:400:kworker.0 00000100:00100000:3.0:1788201539.644141:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570141440:0@lo:400:kworker.0 00000100:00100000:3.0:1788201539.644243:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201539.644291:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201539.644299:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570141568:0@lo:400:kworker.0 00000100:00100000:3.0:1788201539.644328:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201539.644762:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570141440 00000100:00100000:1.0:1788201539.644772:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570141440 00000100:00100000:1.0:1788201539.644843:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788201539.644855:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570141440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201539.644927:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570141440:12345-0@lo:400:kworker.0 Request processed in 73us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201539.644934:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788201539.644979:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570141440:0@lo:400:kworker.0 00000100:00100000:2.0:1788201539.645219:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570141568 00000100:00100000:2.0:1788201539.645224:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570141568 00000100:00100000:2.0:1788201539.645271:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788201539.645280:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570141568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201539.645335:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570141568:12345-0@lo:400:kworker.0 Request processed in 56us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201539.645365:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:3.0:1788201539.645675:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201539.645681:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201539.645744:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570141568:0@lo:400:kworker.0 00000100:00100000:0.0:1788201539.702962:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201539.703457:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559647232 00000100:00100000:2.0:1788201539.703470:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559647232 00002000:00100000:2.0:1788201539.703536:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (401604608->402653183) req@ffff9624c1e00a80 x1875064559647232/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/0 e 0 to 0 dl 1788201550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201539.703745:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00a80 with x1875064559647232 ext(401604608->402653183) 00002000:00010000:2.0:1788201539.703753:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00a80 00000100:00100000:2.0:1788201539.703798:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 427 00000100:00100000:2.0:1788201539.703809:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559647232:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201539.723995:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559647232:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20173us (21033us total) trans 30064771428 rc 0/0 00000100:00100000:2.0:1788201539.724012:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 427 00002000:00100000:2.0:1788201539.724027:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (401604608->402653183) req@ffff9624c1e00a80 x1875064559647232/t30064771428(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/448 e 0 to 0 dl 1788201550 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201539.724040:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00a80 with x1875064559647232 ext(401604608->402653183) 00002000:00010000:2.0:1788201539.724047:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00a80 00000100:00100000:2.0:1788201539.817189:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201539.817576:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559647360 00000100:00100000:3.0:1788201539.817589:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559647360 00002000:00100000:3.0:1788201539.817733:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (402653184->403701759) req@ffff96248e361c00 x1875064559647360/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/0 e 0 to 0 dl 1788201550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201539.817746:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361c00 with x1875064559647360 ext(402653184->403701759) 00002000:00010000:3.0:1788201539.817753:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361c00 00000100:00100000:3.0:1788201539.817833:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 428 00000100:00100000:3.0:1788201539.817847:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559647360:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201539.835908:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559647360:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18047us (18722us total) trans 30064771429 rc 0/0 00000100:00100000:1.0:1788201539.835926:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 428 00002000:00100000:1.0:1788201539.835943:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (402653184->403701759) req@ffff96248e361c00 x1875064559647360/t30064771429(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/448 e 0 to 0 dl 1788201550 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201539.835956:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361c00 with x1875064559647360 ext(402653184->403701759) 00002000:00010000:1.0:1788201539.835963:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361c00 00000100:00100000:2.0:1788201539.944852:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201539.953127:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559647488 00000100:00100000:1.0:1788201539.953151:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559647488 00002000:00100000:1.0:1788201539.953546:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (403701760->404750335) req@ffff96248e363100 x1875064559647488/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/0 e 0 to 0 dl 1788201550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201539.953561:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363100 with x1875064559647488 ext(403701760->404750335) 00002000:00010000:1.0:1788201539.953705:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363100 00000100:00100000:1.0:1788201539.953869:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 429 00000100:00100000:1.0:1788201539.953882:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559647488:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201539.975482:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559647488:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21587us (30628us total) trans 30064771430 rc 0/0 00000100:00100000:2.0:1788201539.975499:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 429 00002000:00100000:2.0:1788201539.975515:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (403701760->404750335) req@ffff96248e363100 x1875064559647488/t30064771430(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:660/0 lens 488/448 e 0 to 0 dl 1788201550 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201539.975528:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363100 with x1875064559647488 ext(403701760->404750335) 00002000:00010000:2.0:1788201539.975536:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363100 00000100:00100000:0.0:1788201540.095193:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201540.095321:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559647616 00000100:00100000:2.0:1788201540.095334:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559647616 00002000:00100000:2.0:1788201540.095459:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (404750336->405798911) req@ffff9624c1e03b80 x1875064559647616/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:661/0 lens 488/0 e 0 to 0 dl 1788201551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201540.095472:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e03b80 with x1875064559647616 ext(404750336->405798911) 00002000:00010000:2.0:1788201540.095479:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e03b80 00000100:00100000:2.0:1788201540.095519:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 430 00000100:00100000:2.0:1788201540.095529:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2342:x1875064559647616:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201540.121513:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2342:x1875064559647616:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25968us (26322us total) trans 30064771431 rc 0/0 00000100:00100000:2.0:1788201540.121531:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 430 00002000:00100000:2.0:1788201540.121548:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (404750336->405798911) req@ffff9624c1e03b80 x1875064559647616/t30064771431(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:661/0 lens 488/448 e 0 to 0 dl 1788201551 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201540.121561:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e03b80 with x1875064559647616 ext(404750336->405798911) 00002000:00010000:2.0:1788201540.121569:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e03b80 00000100:00100000:3.0:1788201540.290694:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201540.290875:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559647744 00000100:00100000:2.0:1788201540.290887:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559647744 00002000:00100000:2.0:1788201540.290964:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (405798912->406847487) req@ffff9623939cc700 x1875064559647744/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:661/0 lens 488/0 e 0 to 0 dl 1788201551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201540.290976:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cc700 with x1875064559647744 ext(405798912->406847487) 00002000:00010000:2.0:1788201540.290983:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cc700 00000100:00100000:2.0:1788201540.291024:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 431 00000100:00100000:2.0:1788201540.291035:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559647744:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201540.313292:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559647744:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22242us (22597us total) trans 30064771432 rc 0/0 00000100:00100000:2.0:1788201540.313330:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 431 00002000:00100000:2.0:1788201540.313366:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (405798912->406847487) req@ffff9623939cc700 x1875064559647744/t30064771432(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:661/0 lens 488/448 e 0 to 0 dl 1788201551 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201540.313378:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cc700 with x1875064559647744 ext(405798912->406847487) 00002000:00010000:2.0:1788201540.313385:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cc700 00010000:00010000:3.0:1788201540.407068:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201540.477333:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201540.477702:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559647872 00000100:00100000:1.0:1788201540.477715:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559647872 00002000:00100000:1.0:1788201540.477779:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (406847488->407896063) req@ffff9623939ce300 x1875064559647872/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:661/0 lens 488/0 e 0 to 0 dl 1788201551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201540.477792:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939ce300 with x1875064559647872 ext(406847488->407896063) 00002000:00010000:1.0:1788201540.477799:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939ce300 00000100:00100000:1.0:1788201540.477841:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 432 00000100:00100000:1.0:1788201540.477853:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559647872:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201540.539759:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559647872:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 61887us (62424us total) trans 30064771433 rc 0/0 00000100:00100000:1.0:1788201540.539780:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 432 00002000:00100000:1.0:1788201540.539799:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (406847488->407896063) req@ffff9623939ce300 x1875064559647872/t30064771433(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:661/0 lens 488/448 e 0 to 0 dl 1788201551 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201540.539812:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939ce300 with x1875064559647872 ext(406847488->407896063) 00002000:00010000:1.0:1788201540.539820:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939ce300 00000100:00100000:3.0:1788201540.613280:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201540.613596:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559648000 00000100:00100000:1.0:1788201540.613608:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559648000 00002000:00100000:1.0:1788201540.613686:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (407896064->408944639) req@ffff9623939cd500 x1875064559648000/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:661/0 lens 488/0 e 0 to 0 dl 1788201551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201540.613699:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cd500 with x1875064559648000 ext(407896064->408944639) 00002000:00010000:1.0:1788201540.613705:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cd500 00000100:00100000:1.0:1788201540.613738:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 433 00000100:00100000:1.0:1788201540.613769:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2341:x1875064559648000:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201540.692824:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2341:x1875064559648000:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 79040us (79543us total) trans 30064771434 rc 0/0 00000100:00100000:1.0:1788201540.692843:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 433 00002000:00100000:1.0:1788201540.692860:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (407896064->408944639) req@ffff9623939cd500 x1875064559648000/t30064771434(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:661/0 lens 488/448 e 0 to 0 dl 1788201551 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201540.692872:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cd500 with x1875064559648000 ext(407896064->408944639) 00002000:00010000:1.0:1788201540.692880:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cd500 00000100:00100000:2.0:1788201540.772724:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201540.774119:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559648128 00000100:00100000:0.0:1788201540.774243:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559648128 00002000:00100000:0.0:1788201540.774319:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (408944640->409993215) req@ffff96248e360a80 x1875064559648128/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:661/0 lens 488/0 e 0 to 0 dl 1788201551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201540.774330:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360a80 with x1875064559648128 ext(408944640->409993215) 00002000:00010000:0.0:1788201540.774336:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360a80 00000100:00100000:0.0:1788201540.775083:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 434 00000100:00100000:0.0:1788201540.775100:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2341:x1875064559648128:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201540.808369:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2341:x1875064559648128:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33239us (35627us total) trans 30064771435 rc 0/0 00000100:00100000:1.0:1788201540.808388:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 434 00002000:00100000:1.0:1788201540.808404:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (408944640->409993215) req@ffff96248e360a80 x1875064559648128/t30064771435(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:661/0 lens 488/448 e 0 to 0 dl 1788201551 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201540.808418:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360a80 with x1875064559648128 ext(408944640->409993215) 00002000:00010000:1.0:1788201540.808613:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360a80 00000100:00100000:2.0:1788201540.924445:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201540.924664:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559648256 00000100:00100000:0.0:1788201540.924676:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559648256 00002000:00100000:0.0:1788201540.924746:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (409993216->411041791) req@ffff96248e363b80 x1875064559648256/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:661/0 lens 488/0 e 0 to 0 dl 1788201551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201540.924759:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363b80 with x1875064559648256 ext(409993216->411041791) 00002000:00010000:0.0:1788201540.924766:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363b80 00000100:00100000:0.0:1788201540.924811:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 435 00000100:00100000:0.0:1788201540.924822:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559648256:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201540.956612:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559648256:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31773us (32165us total) trans 30064771436 rc 0/0 00000100:00100000:1.0:1788201540.956640:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 435 00002000:00100000:1.0:1788201540.956654:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (409993216->411041791) req@ffff96248e363b80 x1875064559648256/t30064771436(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:661/0 lens 488/448 e 0 to 0 dl 1788201551 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201540.956667:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363b80 with x1875064559648256 ext(409993216->411041791) 00002000:00010000:1.0:1788201540.956674:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363b80 00000100:00100000:0.0:1788201541.227317:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201541.228701:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559648384 00000100:00100000:1.0:1788201541.228735:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559648384 00002000:00100000:1.0:1788201541.228822:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (411041792->412090367) req@ffff9624c1e01880 x1875064559648384/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:662/0 lens 488/0 e 0 to 0 dl 1788201552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201541.228833:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e01880 with x1875064559648384 ext(411041792->412090367) 00002000:00010000:1.0:1788201541.228840:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e01880 00000100:00100000:1.0:1788201541.228880:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 436 00000100:00100000:1.0:1788201541.228892:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559648384:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201541.229255:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201541.268377:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2342:x1875064559648384:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39470us (41058us total) trans 30064771437 rc 0/0 00000100:00100000:1.0:1788201541.268396:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 436 00002000:00100000:1.0:1788201541.268424:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (411041792->412090367) req@ffff9624c1e01880 x1875064559648384/t30064771437(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:662/0 lens 488/448 e 0 to 0 dl 1788201552 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201541.268437:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e01880 with x1875064559648384 ext(411041792->412090367) 00002000:00010000:1.0:1788201541.268444:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e01880 00000100:00100000:2.0:1788201541.343739:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201541.343890:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559648512 00000100:00100000:1.0:1788201541.343901:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559648512 00002000:00100000:1.0:1788201541.343962:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (412090368->413138943) req@ffff96248e361500 x1875064559648512/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:662/0 lens 488/0 e 0 to 0 dl 1788201552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201541.343977:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361500 with x1875064559648512 ext(412090368->413138943) 00002000:00010000:1.0:1788201541.343983:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361500 00000100:00100000:1.0:1788201541.344026:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 437 00000100:00100000:1.0:1788201541.344038:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e361500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559648512:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201541.379378:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e361500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2343:x1875064559648512:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35324us (35638us total) trans 30064771438 rc 0/0 00000100:00100000:1.0:1788201541.379429:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 437 00002000:00100000:1.0:1788201541.379449:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (412090368->413138943) req@ffff96248e361500 x1875064559648512/t30064771438(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:662/0 lens 488/448 e 0 to 0 dl 1788201552 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201541.379461:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361500 with x1875064559648512 ext(412090368->413138943) 00002000:00010000:1.0:1788201541.379470:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361500 00010000:00010000:1.0:1788201541.430738:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201541.499225:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201541.499379:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559648640 00000100:00100000:0.0:1788201541.499389:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559648640 00002000:00100000:0.0:1788201541.499455:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (413138944->414187519) req@ffff9623939cc380 x1875064559648640/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:662/0 lens 488/0 e 0 to 0 dl 1788201552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201541.499499:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cc380 with x1875064559648640 ext(413138944->414187519) 00002000:00010000:0.0:1788201541.499765:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cc380 00000100:00100000:1.0:1788201541.499987:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 438 00000100:00100000:1.0:1788201541.500000:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2344:x1875064559648640:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201541.516421:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2344:x1875064559648640:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16401us (17182us total) trans 30064771439 rc 0/0 00000100:00100000:1.0:1788201541.516434:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 438 00002000:00100000:1.0:1788201541.516447:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (413138944->414187519) req@ffff9623939cc380 x1875064559648640/t30064771439(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:662/0 lens 488/448 e 0 to 0 dl 1788201552 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201541.516458:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cc380 with x1875064559648640 ext(413138944->414187519) 00002000:00010000:1.0:1788201541.516463:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cc380 00000100:00100000:3.0:1788201541.678455:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201541.678675:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559648768 00000100:00100000:0.0:1788201541.678686:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559648768 00002000:00100000:0.0:1788201541.678744:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (414187520->415236095) req@ffff9623939cdf80 x1875064559648768/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:662/0 lens 488/0 e 0 to 0 dl 1788201552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201541.678755:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cdf80 with x1875064559648768 ext(414187520->415236095) 00002000:00010000:0.0:1788201541.678761:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cdf80 00000100:00100000:0.0:1788201541.678797:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 439 00000100:00100000:0.0:1788201541.678807:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2343:x1875064559648768:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201541.686798:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570141824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201541.686876:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201541.687052:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570141824 00000100:00100000:2.0:1788201541.687061:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570141824 00000100:00100000:2.0:1788201541.687145:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788201541.687157:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570141824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201541.687182:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 523960320 pending 49414144 free 3474980864 avail 3472883712 00000100:00100000:2.0:1788201541.687238:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570141824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201541.687244:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:3.0:1788201541.687367:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201541.687479:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570141824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201541.707259:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2343:x1875064559648768:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28442us (28805us total) trans 30064771440 rc 0/0 00000100:00100000:0.0:1788201541.707274:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 439 00002000:00100000:0.0:1788201541.707288:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (414187520->415236095) req@ffff9623939cdf80 x1875064559648768/t30064771440(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:662/0 lens 488/448 e 0 to 0 dl 1788201552 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201541.707301:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cdf80 with x1875064559648768 ext(414187520->415236095) 00002000:00010000:0.0:1788201541.707308:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cdf80 00000100:00100000:2.0:1788201541.947678:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201541.947892:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559648896 00000100:00100000:1.0:1788201541.947904:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559648896 00002000:00100000:1.0:1788201541.947963:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (415236096->416284671) req@ffff962393a18a80 x1875064559648896/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:662/0 lens 488/0 e 0 to 0 dl 1788201552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201541.947974:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18a80 with x1875064559648896 ext(415236096->416284671) 00002000:00010000:1.0:1788201541.947980:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18a80 00000100:00100000:1.0:1788201541.948030:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 440 00000100:00100000:1.0:1788201541.948042:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2344:x1875064559648896:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201541.975455:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2344:x1875064559648896:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27403us (27778us total) trans 30064771441 rc 0/0 00000100:00100000:1.0:1788201541.975470:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 440 00002000:00100000:1.0:1788201541.975484:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (415236096->416284671) req@ffff962393a18a80 x1875064559648896/t30064771441(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:662/0 lens 488/448 e 0 to 0 dl 1788201552 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201541.975494:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18a80 with x1875064559648896 ext(415236096->416284671) 00002000:00010000:1.0:1788201541.975499:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18a80 00000100:00100000:2.0:1788201542.091760:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201542.091911:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559649024 00000100:00100000:1.0:1788201542.091921:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559649024 00002000:00100000:1.0:1788201542.091969:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (416284672->417333247) req@ffff962393a1bb80 x1875064559649024/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:663/0 lens 488/0 e 0 to 0 dl 1788201553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201542.091984:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1bb80 with x1875064559649024 ext(416284672->417333247) 00002000:00010000:1.0:1788201542.091990:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1bb80 00000100:00100000:1.0:1788201542.092023:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 441 00000100:00100000:1.0:1788201542.092033:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2344:x1875064559649024:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201542.108134:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2344:x1875064559649024:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16085us (16368us total) trans 30064771442 rc 0/0 00000100:00100000:1.0:1788201542.108150:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 441 00002000:00100000:1.0:1788201542.108166:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (416284672->417333247) req@ffff962393a1bb80 x1875064559649024/t30064771442(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:663/0 lens 488/448 e 0 to 0 dl 1788201553 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201542.108178:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1bb80 with x1875064559649024 ext(416284672->417333247) 00002000:00010000:1.0:1788201542.108202:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1bb80 00000100:00100000:2.0:1788201542.304546:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201542.306849:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559649152 00000100:00100000:3.0:1788201542.306871:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559649152 00002000:00100000:3.0:1788201542.306950:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (417333248->418381823) req@ffff962393a19880 x1875064559649152/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:663/0 lens 488/0 e 0 to 0 dl 1788201553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201542.306983:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a19880 with x1875064559649152 ext(417333248->418381823) 00002000:00010000:3.0:1788201542.306990:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a19880 00000100:00100000:3.0:1788201542.307045:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 442 00000100:00100000:3.0:1788201542.307058:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2344:x1875064559649152:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201542.317135:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+70:2344:x1875064559649152:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10062us (12586us total) trans 30064771443 rc 0/0 00000100:00100000:3.0:1788201542.317155:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 442 00002000:00100000:3.0:1788201542.317180:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (417333248->418381823) req@ffff962393a19880 x1875064559649152/t30064771443(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:663/0 lens 488/448 e 0 to 0 dl 1788201553 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201542.317191:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a19880 with x1875064559649152 ext(417333248->418381823) 00002000:00010000:3.0:1788201542.317198:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a19880 00000001:00080000:2.0:1788201542.388490:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771440 is committed 00000001:00080000:2.0:1788201542.388531:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771442 is committed 00010000:00010000:1.0:1788201542.456885:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201542.507051:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201542.507172:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559649280 00000100:00100000:0.0:1788201542.507189:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559649280 00002000:00100000:0.0:1788201542.507256:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (418381824->419430399) req@ffff9623939cf800 x1875064559649280/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:663/0 lens 488/0 e 0 to 0 dl 1788201553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201542.507268:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cf800 with x1875064559649280 ext(418381824->419430399) 00002000:00010000:0.0:1788201542.507274:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cf800 00000100:00100000:0.0:1788201542.507331:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 443 00000100:00100000:0.0:1788201542.507397:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559649280:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201542.536894:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559649280:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29537us (29850us total) trans 30064771444 rc 0/0 00000100:00100000:1.0:1788201542.536912:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 443 00002000:00100000:1.0:1788201542.536929:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (418381824->419430399) req@ffff9623939cf800 x1875064559649280/t30064771444(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:663/0 lens 488/448 e 0 to 0 dl 1788201553 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201542.536941:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cf800 with x1875064559649280 ext(418381824->419430399) 00002000:00010000:1.0:1788201542.536948:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cf800 00000100:00100000:3.0:1788201542.698200:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201542.706099:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559649408 00000100:00100000:2.0:1788201542.706126:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559649408 00002000:00100000:2.0:1788201542.706225:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (419430400->420478975) req@ffff9623939cc000 x1875064559649408/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:663/0 lens 488/0 e 0 to 0 dl 1788201553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201542.706266:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cc000 with x1875064559649408 ext(419430400->420478975) 00002000:00010000:2.0:1788201542.706273:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cc000 00000100:00100000:2.0:1788201542.706484:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 444 00000100:00100000:2.0:1788201542.706497:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559649408:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201542.745276:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559649408:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 38765us (47075us total) trans 30064771445 rc 0/0 00000100:00100000:2.0:1788201542.745297:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 444 00002000:00100000:2.0:1788201542.745313:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (419430400->420478975) req@ffff9623939cc000 x1875064559649408/t30064771445(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:663/0 lens 488/448 e 0 to 0 dl 1788201553 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201542.745325:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cc000 with x1875064559649408 ext(419430400->420478975) 00002000:00010000:2.0:1788201542.745332:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cc000 00000100:00100000:3.0:1788201542.895560:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201542.895685:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559649536 00000100:00100000:1.0:1788201542.895696:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559649536 00002000:00100000:1.0:1788201542.895756:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (420478976->421527551) req@ffff9623939cce00 x1875064559649536/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:663/0 lens 488/0 e 0 to 0 dl 1788201553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201542.895769:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cce00 with x1875064559649536 ext(420478976->421527551) 00002000:00010000:1.0:1788201542.895776:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cce00 00000100:00100000:1.0:1788201542.895817:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 445 00000100:00100000:1.0:1788201542.895828:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559649536:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201542.917697:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559649536:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21849us (22131us total) trans 30064771446 rc 0/0 00000100:00100000:1.0:1788201542.917718:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 445 00002000:00100000:1.0:1788201542.917736:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (420478976->421527551) req@ffff9623939cce00 x1875064559649536/t30064771446(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:663/0 lens 488/448 e 0 to 0 dl 1788201553 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201542.917748:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cce00 with x1875064559649536 ext(420478976->421527551) 00002000:00010000:1.0:1788201542.917756:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cce00 00000100:00100000:0.0:1788201543.126495:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201543.127566:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559649664 00000100:00100000:3.0:1788201543.127579:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559649664 00002000:00100000:3.0:1788201543.127679:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (421527552->422576127) req@ffff9624c1e02a00 x1875064559649664/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:664/0 lens 488/0 e 0 to 0 dl 1788201554 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201543.127693:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02a00 with x1875064559649664 ext(421527552->422576127) 00002000:00010000:3.0:1788201543.127700:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02a00 00000100:00100000:3.0:1788201543.127741:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 446 00000100:00100000:3.0:1788201543.127755:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559649664:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201543.128187:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201543.149770:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559649664:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22004us (23279us total) trans 30064771447 rc 0/0 00000100:00100000:1.0:1788201543.149788:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 446 00002000:00100000:1.0:1788201543.149803:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (421527552->422576127) req@ffff9624c1e02a00 x1875064559649664/t30064771447(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:664/0 lens 488/448 e 0 to 0 dl 1788201554 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201543.149814:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02a00 with x1875064559649664 ext(421527552->422576127) 00002000:00010000:1.0:1788201543.149822:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02a00 00000100:00100000:0.0:1788201543.312277:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201543.312538:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559649792 00000100:00100000:2.0:1788201543.312552:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559649792 00002000:00100000:2.0:1788201543.312652:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (422576128->423624703) req@ffff9624c1e01180 x1875064559649792/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:664/0 lens 488/0 e 0 to 0 dl 1788201554 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201543.312667:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e01180 with x1875064559649792 ext(422576128->423624703) 00002000:00010000:2.0:1788201543.312673:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e01180 00000100:00100000:2.0:1788201543.312715:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 447 00000100:00100000:2.0:1788201543.312728:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559649792:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201543.333658:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559649792:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20916us (21381us total) trans 30064771448 rc 0/0 00000100:00100000:2.0:1788201543.333703:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 447 00002000:00100000:2.0:1788201543.333719:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (422576128->423624703) req@ffff9624c1e01180 x1875064559649792/t30064771448(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:664/0 lens 488/448 e 0 to 0 dl 1788201554 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201543.333730:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e01180 with x1875064559649792 ext(422576128->423624703) 00002000:00010000:2.0:1788201543.333738:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e01180 00000100:00100000:0.0:1788201543.477719:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201543.477788:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201543.477898:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559650048 00000100:00100000:2.0:1788201543.477909:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559650048 00000100:00100000:2.0:1788201543.478009:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 379 00000100:00100000:2.0:1788201543.478023:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559650048:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201543.478130:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559650048:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 111us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201543.478138:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 379 00000100:00100000:3.0:1788201543.478524:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559649920 00000100:00100000:3.0:1788201543.478530:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559649920 00000100:00080000:0.0:1788201543.478638:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201543.480525:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 532 00000100:00100000:3.0:1788201543.480549:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559649920:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201543.480666:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559649920:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 126us (2878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201543.480673:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 532 00010000:00010000:3.0:1788201543.495739:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201543.592804:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201543.593085:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559650176 00000100:00100000:1.0:1788201543.593096:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559650176 00002000:00100000:1.0:1788201543.593164:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (423624704->424673279) req@ffff9624c1e02300 x1875064559650176/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:664/0 lens 488/0 e 0 to 0 dl 1788201554 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201543.593180:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02300 with x1875064559650176 ext(423624704->424673279) 00002000:00010000:1.0:1788201543.593187:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02300 00000100:00100000:1.0:1788201543.593230:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 448 00000100:00100000:1.0:1788201543.593240:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559650176:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201543.606803:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559650176:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13545us (13995us total) trans 30064771449 rc 0/0 00000100:00100000:1.0:1788201543.606822:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 448 00002000:00100000:1.0:1788201543.606839:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (423624704->424673279) req@ffff9624c1e02300 x1875064559650176/t30064771449(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:664/0 lens 488/448 e 0 to 0 dl 1788201554 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201543.606851:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02300 with x1875064559650176 ext(423624704->424673279) 00002000:00010000:1.0:1788201543.606859:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02300 00000100:00100000:0.0:1788201543.762003:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201543.762493:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559650304 00000100:00100000:1.0:1788201543.762505:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559650304 00002000:00100000:1.0:1788201543.762590:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (424673280->425721855) req@ffff9624c1e01500 x1875064559650304/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:664/0 lens 488/0 e 0 to 0 dl 1788201554 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201543.762603:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e01500 with x1875064559650304 ext(424673280->425721855) 00002000:00010000:1.0:1788201543.762610:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e01500 00000100:00100000:1.0:1788201543.762646:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 449 00000100:00100000:1.0:1788201543.762657:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559650304:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201543.784768:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559650304:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22092us (22763us total) trans 30064771450 rc 0/0 00000100:00100000:1.0:1788201543.784789:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 449 00002000:00100000:1.0:1788201543.784805:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (424673280->425721855) req@ffff9624c1e01500 x1875064559650304/t30064771450(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:664/0 lens 488/448 e 0 to 0 dl 1788201554 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201543.784818:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e01500 with x1875064559650304 ext(424673280->425721855) 00002000:00010000:1.0:1788201543.784825:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e01500 00000100:00100000:2.0:1788201543.971213:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201543.971314:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559650432 00000100:00100000:3.0:1788201543.971325:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559650432 00002000:00100000:3.0:1788201543.971418:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (425721856->426770431) req@ffff962393a1aa00 x1875064559650432/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:664/0 lens 488/0 e 0 to 0 dl 1788201554 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201543.971429:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1aa00 with x1875064559650432 ext(425721856->426770431) 00002000:00010000:3.0:1788201543.971436:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1aa00 00000100:00100000:3.0:1788201543.971481:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 450 00000100:00100000:3.0:1788201543.971492:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559650432:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201543.992220:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559650432:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20712us (21001us total) trans 30064771451 rc 0/0 00000100:00100000:1.0:1788201543.992237:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 450 00002000:00100000:1.0:1788201543.992254:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (425721856->426770431) req@ffff962393a1aa00 x1875064559650432/t30064771451(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:664/0 lens 488/448 e 0 to 0 dl 1788201554 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201543.992267:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1aa00 with x1875064559650432 ext(425721856->426770431) 00002000:00010000:1.0:1788201543.992275:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1aa00 00000100:00100000:0.0:1788201544.154299:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201544.157671:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559650560 00000100:00100000:2.0:1788201544.157693:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559650560 00002000:00100000:2.0:1788201544.157774:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (426770432->427819007) req@ffff9624c1e00380 x1875064559650560/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:665/0 lens 488/0 e 0 to 0 dl 1788201555 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201544.157788:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00380 with x1875064559650560 ext(426770432->427819007) 00002000:00010000:2.0:1788201544.157795:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00380 00000100:00100000:2.0:1788201544.157842:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 451 00000100:00100000:2.0:1788201544.157853:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559650560:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201544.182977:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559650560:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25106us (28673us total) trans 30064771452 rc 0/0 00000100:00100000:1.0:1788201544.182996:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 451 00002000:00100000:1.0:1788201544.183031:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (426770432->427819007) req@ffff9624c1e00380 x1875064559650560/t30064771452(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:665/0 lens 488/448 e 0 to 0 dl 1788201555 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201544.183043:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00380 with x1875064559650560 ext(426770432->427819007) 00002000:00010000:1.0:1788201544.183066:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00380 00000100:00100000:0.0:1788201544.247083:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201544.247119:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570141952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201544.247222:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201544.247388:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570141952 00000100:00100000:1.0:1788201544.247398:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570141952 00000100:00080000:2.0:1788201544.250579:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201544.251588:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788201544.251616:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570141952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201544.251673:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201544.251784:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570141952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (4561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201544.251792:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00010000:00080000:0.0:1788201544.253897:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9623939e2a00 x1875064570141952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201544.253930:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570141952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201544.332788:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201544.333215:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559650688 00000100:00100000:1.0:1788201544.333228:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559650688 00002000:00100000:1.0:1788201544.333297:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (427819008->428867583) req@ffff962393a19180 x1875064559650688/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:665/0 lens 488/0 e 0 to 0 dl 1788201555 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201544.333310:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a19180 with x1875064559650688 ext(427819008->428867583) 00002000:00010000:1.0:1788201544.333317:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a19180 00000100:00100000:3.0:1788201544.333630:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 452 00000100:00100000:3.0:1788201544.333647:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559650688:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201544.347213:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559650688:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13555us (14426us total) trans 30064771453 rc 0/0 00000100:00100000:3.0:1788201544.347231:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 452 00002000:00100000:3.0:1788201544.347246:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (427819008->428867583) req@ffff962393a19180 x1875064559650688/t30064771453(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:665/0 lens 488/448 e 0 to 0 dl 1788201555 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201544.347283:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a19180 with x1875064559650688 ext(427819008->428867583) 00002000:00010000:3.0:1788201544.347291:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a19180 00010000:00010000:1.0:1788201544.503759:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201544.530601:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201544.530758:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559650816 00000100:00100000:1.0:1788201544.530772:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559650816 00002000:00100000:1.0:1788201544.530841:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (428867584->429916159) req@ffff962393a18700 x1875064559650816/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:665/0 lens 488/0 e 0 to 0 dl 1788201555 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201544.530856:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18700 with x1875064559650816 ext(428867584->429916159) 00002000:00010000:1.0:1788201544.530863:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18700 00000100:00100000:1.0:1788201544.530906:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 453 00000100:00100000:1.0:1788201544.530925:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559650816:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201544.549842:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559650816:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18902us (19241us total) trans 30064771454 rc 0/0 00000100:00100000:1.0:1788201544.549861:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 453 00002000:00100000:1.0:1788201544.549876:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (428867584->429916159) req@ffff962393a18700 x1875064559650816/t30064771454(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:665/0 lens 488/448 e 0 to 0 dl 1788201555 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201544.549889:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18700 with x1875064559650816 ext(428867584->429916159) 00002000:00010000:1.0:1788201544.549897:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18700 00000100:00100000:0.0:1788201544.672494:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201544.672658:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559650944 00000100:00100000:2.0:1788201544.672670:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559650944 00002000:00100000:2.0:1788201544.672728:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (429916160->430964735) req@ffff9624c1e03480 x1875064559650944/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:665/0 lens 488/0 e 0 to 0 dl 1788201555 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201544.672740:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e03480 with x1875064559650944 ext(429916160->430964735) 00002000:00010000:2.0:1788201544.672747:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e03480 00000100:00100000:2.0:1788201544.672780:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 454 00000100:00100000:2.0:1788201544.672790:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559650944:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201544.700532:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559650944:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27727us (28036us total) trans 30064771455 rc 0/0 00000100:00100000:2.0:1788201544.700551:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 454 00002000:00100000:2.0:1788201544.700577:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (429916160->430964735) req@ffff9624c1e03480 x1875064559650944/t30064771455(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:665/0 lens 488/448 e 0 to 0 dl 1788201555 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201544.700589:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e03480 with x1875064559650944 ext(429916160->430964735) 00002000:00010000:2.0:1788201544.700596:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e03480 00000100:00100000:2.0:1788201544.764869:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570142464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.764939:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570142336:0@lo:400:kworker.0 00000100:00100000:2.0:1788201544.764968:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201544.764973:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201544.765601:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570142208:0@lo:400:kworker.0 00000100:00100000:3.0:1788201544.765994:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570142464 00000100:00100000:3.0:1788201544.766004:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570142464 00000100:00100000:3.0:1788201544.766074:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788201544.766087:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570142464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.767228:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570142336 00000100:00100000:1.0:1788201544.767237:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570142336 00000100:00100000:1.0:1788201544.767287:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788201544.767296:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570142336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.767385:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570142336:12345-0@lo:400:kworker.0 Request processed in 90us (2409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201544.767393:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788201544.767427:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570142080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.767482:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201544.767510:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570142592:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.767537:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201544.767582:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570142080 00000100:00100000:1.0:1788201544.767586:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570142080 00000100:00100000:1.0:1788201544.767613:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:1.0:1788201544.767619:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570142080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.767676:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570142080:12345-0@lo:400:kworker.0 Request processed in 57us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201544.767682:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:1.0:1788201544.767710:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570142592 00000100:00100000:1.0:1788201544.767715:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570142592 00000100:00100000:1.0:1788201544.767743:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788201544.767749:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570142592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.767780:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570142592:12345-0@lo:400:kworker.0 Request processed in 31us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201544.767787:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788201544.767833:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570142336:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.767856:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570142080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.767866:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570142592:0@lo:400:kworker.0 00000100:00080000:1.0:1788201544.767913:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201544.767919:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201544.770493:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201544.770937:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570142464:12345-0@lo:400:kworker.0 Request processed in 4850us (5965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201544.770953:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788201544.770990:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570142208 00000100:00100000:3.0:1788201544.770998:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570142208 00000100:00100000:3.0:1788201544.771049:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788201544.771059:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570142208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201544.771122:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570142208:12345-0@lo:400:kworker.0 Request processed in 65us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201544.771129:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788201544.771171:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570142208:0@lo:400:kworker.0 00000100:00100000:2.0:1788201544.771311:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570142464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201544.849978:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201544.850475:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559651072 00000100:00100000:2.0:1788201544.850488:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559651072 00002000:00100000:2.0:1788201544.850565:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (430964736->432013311) req@ffff9624c1e00000 x1875064559651072/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:665/0 lens 488/0 e 0 to 0 dl 1788201555 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201544.850578:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00000 with x1875064559651072 ext(430964736->432013311) 00002000:00010000:2.0:1788201544.850586:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00000 00000100:00100000:2.0:1788201544.850709:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 455 00000100:00100000:2.0:1788201544.850721:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559651072:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201544.867141:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559651072:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16405us (17162us total) trans 30064771456 rc 0/0 00000100:00100000:2.0:1788201544.867159:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 455 00002000:00100000:2.0:1788201544.867174:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (430964736->432013311) req@ffff9624c1e00000 x1875064559651072/t30064771456(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:665/0 lens 488/448 e 0 to 0 dl 1788201555 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201544.867249:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00000 with x1875064559651072 ext(430964736->432013311) 00002000:00010000:2.0:1788201544.867257:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00000 00000100:00100000:3.0:1788201545.020795:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201545.021058:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559651200 00000100:00100000:1.0:1788201545.021071:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559651200 00002000:00100000:1.0:1788201545.021169:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (432013312->433061887) req@ffff9623939ce680 x1875064559651200/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:666/0 lens 488/0 e 0 to 0 dl 1788201556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201545.021192:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939ce680 with x1875064559651200 ext(432013312->433061887) 00002000:00010000:1.0:1788201545.021200:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939ce680 00000100:00100000:1.0:1788201545.021308:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 456 00000100:00100000:1.0:1788201545.021321:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559651200:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201545.021566:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201545.045050:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559651200:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23714us (24254us total) trans 30064771457 rc 0/0 00000100:00100000:1.0:1788201545.045069:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 456 00002000:00100000:1.0:1788201545.045086:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (432013312->433061887) req@ffff9623939ce680 x1875064559651200/t30064771457(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:666/0 lens 488/448 e 0 to 0 dl 1788201556 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201545.045100:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939ce680 with x1875064559651200 ext(432013312->433061887) 00002000:00010000:1.0:1788201545.045109:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939ce680 00000100:00100000:3.0:1788201545.263007:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201545.264197:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559651328 00000100:00100000:1.0:1788201545.264217:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559651328 00002000:00100000:1.0:1788201545.264306:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (433061888->434110463) req@ffff9623939ced80 x1875064559651328/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:666/0 lens 488/0 e 0 to 0 dl 1788201556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201545.264319:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939ced80 with x1875064559651328 ext(433061888->434110463) 00002000:00010000:1.0:1788201545.264327:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939ced80 00000100:00100000:1.0:1788201545.264433:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 457 00000100:00100000:1.0:1788201545.264444:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559651328:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201545.297041:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559651328:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32581us (34037us total) trans 30064771458 rc 0/0 00000100:00100000:1.0:1788201545.297060:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 457 00002000:00100000:1.0:1788201545.297076:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (433061888->434110463) req@ffff9623939ced80 x1875064559651328/t30064771458(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:666/0 lens 488/448 e 0 to 0 dl 1788201556 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201545.297090:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939ced80 with x1875064559651328 ext(433061888->434110463) 00002000:00010000:1.0:1788201545.297099:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939ced80 00000100:00100000:3.0:1788201545.512905:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201545.513296:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559651456 00000100:00100000:0.0:1788201545.513307:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559651456 00002000:00100000:0.0:1788201545.513407:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (434110464->435159039) req@ffff9623939cdc00 x1875064559651456/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:666/0 lens 488/0 e 0 to 0 dl 1788201556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201545.513420:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cdc00 with x1875064559651456 ext(434110464->435159039) 00002000:00010000:0.0:1788201545.513448:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cdc00 00000100:00100000:0.0:1788201545.513492:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 458 00000100:00100000:0.0:1788201545.513502:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559651456:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:1.0:1788201545.526740:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201545.541697:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559651456:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28180us (28795us total) trans 30064771459 rc 0/0 00000100:00100000:0.0:1788201545.541712:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 458 00002000:00100000:0.0:1788201545.541725:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (434110464->435159039) req@ffff9623939cdc00 x1875064559651456/t30064771459(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:666/0 lens 488/448 e 0 to 0 dl 1788201556 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201545.541734:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cdc00 with x1875064559651456 ext(434110464->435159039) 00002000:00010000:0.0:1788201545.541741:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cdc00 00000100:00100000:1.0:1788201545.668128:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201545.668452:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559651584 00000100:00100000:2.0:1788201545.668466:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559651584 00002000:00100000:2.0:1788201545.668530:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (435159040->436207615) req@ffff9623939e2300 x1875064559651584/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:666/0 lens 488/0 e 0 to 0 dl 1788201556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201545.668572:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2300 with x1875064559651584 ext(435159040->436207615) 00002000:00010000:2.0:1788201545.668580:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2300 00000100:00100000:2.0:1788201545.668620:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 459 00000100:00100000:2.0:1788201545.668631:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559651584:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201545.685919:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559651584:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17219us (17739us total) trans 30064771460 rc 0/0 00000100:00100000:3.0:1788201545.685941:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 459 00002000:00100000:3.0:1788201545.685960:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (435159040->436207615) req@ffff9623939e2300 x1875064559651584/t30064771460(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:666/0 lens 488/448 e 0 to 0 dl 1788201556 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201545.685999:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2300 with x1875064559651584 ext(435159040->436207615) 00002000:00010000:3.0:1788201545.686006:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2300 00000100:00100000:0.0:1788201545.938953:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201545.946945:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559651712 00000100:00100000:1.0:1788201545.946967:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559651712 00002000:00100000:1.0:1788201545.947049:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (436207616->437256191) req@ffff9624c1e00e00 x1875064559651712/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:666/0 lens 488/0 e 0 to 0 dl 1788201556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201545.947063:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00e00 with x1875064559651712 ext(436207616->437256191) 00002000:00010000:1.0:1788201545.947070:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00e00 00000100:00100000:1.0:1788201545.947099:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 460 00000100:00100000:1.0:1788201545.947110:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559651712:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201545.987976:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559651712:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 40850us (49020us total) trans 30064771461 rc 0/0 00000100:00100000:3.0:1788201545.987996:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 460 00002000:00100000:3.0:1788201545.988013:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (436207616->437256191) req@ffff9624c1e00e00 x1875064559651712/t30064771461(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:666/0 lens 488/448 e 0 to 0 dl 1788201556 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201545.988025:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00e00 with x1875064559651712 ext(436207616->437256191) 00002000:00010000:3.0:1788201545.988033:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00e00 00000100:00100000:2.0:1788201546.140874:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201546.141228:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559651840 00000100:00100000:1.0:1788201546.141241:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559651840 00002000:00100000:1.0:1788201546.141308:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (437256192->438304767) req@ffff962393a19f80 x1875064559651840/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:667/0 lens 488/0 e 0 to 0 dl 1788201557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201546.141320:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a19f80 with x1875064559651840 ext(437256192->438304767) 00002000:00010000:1.0:1788201546.141327:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a19f80 00000100:00100000:1.0:1788201546.141427:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 461 00000100:00100000:1.0:1788201546.141439:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559651840:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201546.161993:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559651840:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20538us (21127us total) trans 30064771462 rc 0/0 00000100:00100000:3.0:1788201546.162011:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 461 00002000:00100000:3.0:1788201546.162028:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (437256192->438304767) req@ffff962393a19f80 x1875064559651840/t30064771462(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:667/0 lens 488/448 e 0 to 0 dl 1788201557 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201546.162040:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a19f80 with x1875064559651840 ext(437256192->438304767) 00002000:00010000:3.0:1788201546.162048:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a19f80 00000100:00100000:3.0:1788201546.399619:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201546.399699:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559651968 00000100:00100000:0.0:1788201546.399711:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559651968 00002000:00100000:0.0:1788201546.399972:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (438304768->439353343) req@ffff9623939cf100 x1875064559651968/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:667/0 lens 488/0 e 0 to 0 dl 1788201557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201546.399986:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cf100 with x1875064559651968 ext(438304768->439353343) 00002000:00010000:0.0:1788201546.399993:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cf100 00000100:00100000:0.0:1788201546.400099:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 462 00000100:00100000:0.0:1788201546.400110:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2341:x1875064559651968:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201546.430898:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2341:x1875064559651968:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30773us (31278us total) trans 30064771463 rc 0/0 00000100:00100000:2.0:1788201546.430915:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 462 00002000:00100000:2.0:1788201546.430931:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (438304768->439353343) req@ffff9623939cf100 x1875064559651968/t30064771463(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:667/0 lens 488/448 e 0 to 0 dl 1788201557 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201546.430970:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cf100 with x1875064559651968 ext(438304768->439353343) 00002000:00010000:2.0:1788201546.430978:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cf100 00010000:00010000:3.0:1788201546.550585:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201546.610668:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201546.610788:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559652096 00000100:00100000:3.0:1788201546.610801:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559652096 00002000:00100000:3.0:1788201546.610863:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (439353344->440401919) req@ffff9623939e1500 x1875064559652096/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:667/0 lens 488/0 e 0 to 0 dl 1788201557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201546.610875:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1500 with x1875064559652096 ext(439353344->440401919) 00002000:00010000:3.0:1788201546.610900:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1500 00000100:00100000:3.0:1788201546.610945:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 463 00000100:00100000:3.0:1788201546.610957:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2341:x1875064559652096:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201546.665917:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2341:x1875064559652096:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 54946us (55249us total) trans 30064771464 rc 0/0 00000100:00100000:2.0:1788201546.665935:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 463 00002000:00100000:2.0:1788201546.665951:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (439353344->440401919) req@ffff9623939e1500 x1875064559652096/t30064771464(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:667/0 lens 488/448 e 0 to 0 dl 1788201557 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201546.665964:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1500 with x1875064559652096 ext(439353344->440401919) 00002000:00010000:2.0:1788201546.665972:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1500 00000100:00100000:3.0:1788201546.810158:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201546.810193:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570142720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201546.810305:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201546.810533:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570142720 00000100:00100000:2.0:1788201546.810544:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570142720 00000100:00100000:2.0:1788201546.810630:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788201546.810641:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570142720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201546.810670:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 552927232 pending 37486592 free 3442475008 avail 3440377856 00000100:00100000:2.0:1788201546.810729:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570142720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201546.810737:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788201546.810796:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570142720:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788201546.810983:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201546.852313:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201546.852579:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559652224 00000100:00100000:2.0:1788201546.852593:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559652224 00002000:00100000:2.0:1788201546.852670:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (440401920->441450495) req@ffff9623939e0380 x1875064559652224/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:667/0 lens 488/0 e 0 to 0 dl 1788201557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201546.852684:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0380 with x1875064559652224 ext(440401920->441450495) 00002000:00010000:2.0:1788201546.852713:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0380 00000100:00100000:2.0:1788201546.852758:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 464 00000100:00100000:2.0:1788201546.852770:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559652224:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201546.903063:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2342:x1875064559652224:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 50279us (50753us total) trans 30064771465 rc 0/0 00000100:00100000:2.0:1788201546.903081:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 464 00002000:00100000:2.0:1788201546.903095:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (440401920->441450495) req@ffff9623939e0380 x1875064559652224/t30064771465(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:667/0 lens 488/448 e 0 to 0 dl 1788201557 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201546.903108:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0380 with x1875064559652224 ext(440401920->441450495) 00002000:00010000:2.0:1788201546.903116:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0380 00000100:00100000:3.0:1788201547.089027:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201547.089207:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559652352 00000100:00100000:1.0:1788201547.089219:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559652352 00002000:00100000:1.0:1788201547.089308:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (441450496->442499071) req@ffff9623939cfb80 x1875064559652352/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:668/0 lens 488/0 e 0 to 0 dl 1788201558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201547.089322:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cfb80 with x1875064559652352 ext(441450496->442499071) 00002000:00010000:1.0:1788201547.089329:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cfb80 00000100:00100000:1.0:1788201547.089427:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 465 00000100:00100000:1.0:1788201547.089440:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559652352:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201547.089871:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201547.107197:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559652352:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17741us (18171us total) trans 30064771466 rc 0/0 00000100:00100000:1.0:1788201547.107214:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 465 00002000:00100000:1.0:1788201547.107229:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (441450496->442499071) req@ffff9623939cfb80 x1875064559652352/t30064771466(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:668/0 lens 488/448 e 0 to 0 dl 1788201558 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201547.107242:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cfb80 with x1875064559652352 ext(441450496->442499071) 00002000:00010000:1.0:1788201547.107250:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cfb80 00000100:00100000:3.0:1788201547.240549:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201547.240602:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559652480 00000100:00100000:0.0:1788201547.240616:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559652480 00002000:00100000:0.0:1788201547.240683:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (442499072->443547647) req@ffff962393a1c380 x1875064559652480/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:668/0 lens 488/0 e 0 to 0 dl 1788201558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201547.240698:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1c380 with x1875064559652480 ext(442499072->443547647) 00002000:00010000:0.0:1788201547.240713:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1c380 00000100:00100000:0.0:1788201547.240760:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 466 00000100:00100000:0.0:1788201547.240770:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559652480:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201547.260448:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559652480:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19221us (19460us total) trans 30064771467 rc 0/0 00000100:00100000:2.0:1788201547.260464:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 466 00002000:00100000:2.0:1788201547.260481:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (442499072->443547647) req@ffff962393a1c380 x1875064559652480/t30064771467(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:668/0 lens 488/448 e 0 to 0 dl 1788201558 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201547.260611:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1c380 with x1875064559652480 ext(442499072->443547647) 00002000:00010000:2.0:1788201547.260622:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1c380 00000001:00080000:2.0:1788201547.447780:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771459 is committed 00000001:00080000:2.0:1788201547.447892:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771466 is committed 00000001:00080000:2.0:1788201547.448209:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771467 is committed 00000100:00100000:3.0:1788201547.455740:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201547.455877:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559652608 00000100:00100000:2.0:1788201547.455888:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559652608 00002000:00100000:2.0:1788201547.455951:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (443547648->444596223) req@ffff962393a1df80 x1875064559652608/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:668/0 lens 488/0 e 0 to 0 dl 1788201558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201547.455989:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1df80 with x1875064559652608 ext(443547648->444596223) 00002000:00010000:2.0:1788201547.456006:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1df80 00000100:00100000:2.0:1788201547.456048:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 467 00000100:00100000:2.0:1788201547.456061:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559652608:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201547.474276:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559652608:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18202us (18532us total) trans 30064771468 rc 0/0 00000100:00100000:2.0:1788201547.474334:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 467 00002000:00100000:2.0:1788201547.474376:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (443547648->444596223) req@ffff962393a1df80 x1875064559652608/t30064771468(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:668/0 lens 488/448 e 0 to 0 dl 1788201558 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201547.474389:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1df80 with x1875064559652608 ext(443547648->444596223) 00002000:00010000:2.0:1788201547.474396:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1df80 00010000:00010000:1.0:1788201547.574631:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201547.612843:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201547.612972:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559652736 00000100:00100000:2.0:1788201547.612985:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559652736 00002000:00100000:2.0:1788201547.613064:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (444596224->445644799) req@ffff9623939e1f80 x1875064559652736/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:668/0 lens 488/0 e 0 to 0 dl 1788201558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201547.613078:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1f80 with x1875064559652736 ext(444596224->445644799) 00002000:00010000:2.0:1788201547.613085:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1f80 00000100:00100000:2.0:1788201547.613131:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 468 00000100:00100000:2.0:1788201547.613143:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559652736:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201547.627424:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559652736:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14265us (14579us total) trans 30064771469 rc 0/0 00000100:00100000:2.0:1788201547.627443:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 468 00002000:00100000:2.0:1788201547.627479:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (444596224->445644799) req@ffff9623939e1f80 x1875064559652736/t30064771469(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:668/0 lens 488/448 e 0 to 0 dl 1788201558 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201547.627492:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1f80 with x1875064559652736 ext(444596224->445644799) 00002000:00010000:2.0:1788201547.627500:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1f80 00000100:00100000:1.0:1788201547.760873:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201547.762529:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559652864 00000100:00100000:3.0:1788201547.762546:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559652864 00002000:00100000:3.0:1788201547.762743:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (445644800->446693375) req@ffff9623939e3480 x1875064559652864/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:668/0 lens 488/0 e 0 to 0 dl 1788201558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201547.762756:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3480 with x1875064559652864 ext(445644800->446693375) 00002000:00010000:3.0:1788201547.762762:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3480 00000100:00100000:3.0:1788201547.762811:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 469 00000100:00100000:3.0:1788201547.762822:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559652864:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201547.796078:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559652864:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33241us (35203us total) trans 30064771470 rc 0/0 00000100:00100000:3.0:1788201547.796095:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 469 00002000:00100000:3.0:1788201547.796109:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (445644800->446693375) req@ffff9623939e3480 x1875064559652864/t30064771470(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:668/0 lens 488/448 e 0 to 0 dl 1788201558 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201547.796121:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3480 with x1875064559652864 ext(445644800->446693375) 00002000:00010000:3.0:1788201547.796148:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3480 00000100:00100000:2.0:1788201547.945655:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201547.947623:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559652992 00000100:00100000:0.0:1788201547.947643:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559652992 00002000:00100000:0.0:1788201547.947724:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (446693376->447741951) req@ffff962393a18000 x1875064559652992/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:668/0 lens 488/0 e 0 to 0 dl 1788201558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201547.947737:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18000 with x1875064559652992 ext(446693376->447741951) 00002000:00010000:0.0:1788201547.947744:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18000 00000100:00100000:0.0:1788201547.947796:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 470 00000100:00100000:0.0:1788201547.947808:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559652992:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201547.964229:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559652992:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16408us (18576us total) trans 30064771471 rc 0/0 00000100:00100000:2.0:1788201547.964241:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 470 00002000:00100000:2.0:1788201547.964255:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (446693376->447741951) req@ffff962393a18000 x1875064559652992/t30064771471(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:668/0 lens 488/448 e 0 to 0 dl 1788201558 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201547.964264:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18000 with x1875064559652992 ext(446693376->447741951) 00002000:00010000:2.0:1788201547.964270:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18000 00000100:00100000:1.0:1788201548.167069:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201548.172646:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559653120 00000100:00100000:2.0:1788201548.172668:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559653120 00002000:00100000:2.0:1788201548.172753:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (447741952->448790527) req@ffff9623939e3800 x1875064559653120/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:669/0 lens 488/0 e 0 to 0 dl 1788201559 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201548.172767:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3800 with x1875064559653120 ext(447741952->448790527) 00002000:00010000:2.0:1788201548.172774:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3800 00000100:00100000:2.0:1788201548.172827:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 471 00000100:00100000:2.0:1788201548.172839:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559653120:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201548.199317:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559653120:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26460us (32246us total) trans 30064771472 rc 0/0 00000100:00100000:2.0:1788201548.199335:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 471 00002000:00100000:2.0:1788201548.199384:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (447741952->448790527) req@ffff9623939e3800 x1875064559653120/t30064771472(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:669/0 lens 488/448 e 0 to 0 dl 1788201559 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201548.199417:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3800 with x1875064559653120 ext(447741952->448790527) 00002000:00010000:2.0:1788201548.199425:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3800 00000100:00100000:0.0:1788201548.340134:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201548.340276:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559653248 00000100:00100000:2.0:1788201548.340289:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559653248 00002000:00100000:2.0:1788201548.340397:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (448790528->449839103) req@ffff9624c1e02680 x1875064559653248/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:669/0 lens 488/0 e 0 to 0 dl 1788201559 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201548.340411:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02680 with x1875064559653248 ext(448790528->449839103) 00002000:00010000:2.0:1788201548.340430:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02680 00000100:00100000:0.0:1788201548.340629:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 472 00000100:00100000:0.0:1788201548.340644:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559653248:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201548.355152:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559653248:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14494us (15018us total) trans 30064771473 rc 0/0 00000100:00100000:2.0:1788201548.355172:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 472 00002000:00100000:2.0:1788201548.355189:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (448790528->449839103) req@ffff9624c1e02680 x1875064559653248/t30064771473(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:669/0 lens 488/448 e 0 to 0 dl 1788201559 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201548.355203:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02680 with x1875064559653248 ext(448790528->449839103) 00002000:00010000:2.0:1788201548.355211:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02680 00000100:00100000:0.0:1788201548.524734:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201548.524966:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559653376 00000100:00100000:3.0:1788201548.524979:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559653376 00002000:00100000:3.0:1788201548.525316:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (449839104->450887679) req@ffff962388ba2d80 x1875064559653376/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:669/0 lens 488/0 e 0 to 0 dl 1788201559 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201548.525329:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2d80 with x1875064559653376 ext(449839104->450887679) 00002000:00010000:3.0:1788201548.525335:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2d80 00000100:00100000:3.0:1788201548.525410:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 473 00000100:00100000:3.0:1788201548.525422:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559653376:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201548.543179:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559653376:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17743us (18444us total) trans 30064771474 rc 0/0 00000100:00100000:3.0:1788201548.543197:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 473 00002000:00100000:3.0:1788201548.543212:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (449839104->450887679) req@ffff962388ba2d80 x1875064559653376/t30064771474(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:669/0 lens 488/448 e 0 to 0 dl 1788201559 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201548.543225:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2d80 with x1875064559653376 ext(449839104->450887679) 00002000:00010000:3.0:1788201548.543232:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2d80 00010000:00010000:1.0:1788201548.600137:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201548.602445:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201548.602551:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201548.603111:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559653632 00000100:00100000:1.0:1788201548.603126:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559653632 00000100:00100000:1.0:1788201548.603226:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 383 00000100:00100000:1.0:1788201548.603238:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559653632:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201548.603371:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559653632:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 137us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201548.603378:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 383 00000100:00080000:2.0:1788201548.603774:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201548.611305:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559653504 00000100:00100000:3.0:1788201548.611322:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559653504 00000100:00100000:3.0:1788201548.611400:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 534 00000100:00100000:3.0:1788201548.611409:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559653504:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201548.611529:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559653504:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 119us (9100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201548.611537:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 534 00000100:00100000:0.0:1788201548.743029:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201548.745278:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559653760 00000100:00100000:1.0:1788201548.745296:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559653760 00002000:00100000:1.0:1788201548.745558:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (450887680->451936255) req@ffff962388ba3100 x1875064559653760/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:669/0 lens 488/0 e 0 to 0 dl 1788201559 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201548.745597:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3100 with x1875064559653760 ext(450887680->451936255) 00002000:00010000:1.0:1788201548.745605:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3100 00000100:00100000:1.0:1788201548.745647:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 474 00000100:00100000:1.0:1788201548.745658:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559653760:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201548.769116:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559653760:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23376us (26019us total) trans 30064771475 rc 0/0 00000100:00100000:1.0:1788201548.769137:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 474 00002000:00100000:1.0:1788201548.769155:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (450887680->451936255) req@ffff962388ba3100 x1875064559653760/t30064771475(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:669/0 lens 488/448 e 0 to 0 dl 1788201559 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201548.769168:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3100 with x1875064559653760 ext(450887680->451936255) 00002000:00010000:1.0:1788201548.769176:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3100 00000100:00100000:3.0:1788201548.909061:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201548.909270:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559653888 00000100:00100000:2.0:1788201548.909295:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559653888 00002000:00100000:2.0:1788201548.909404:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (451936256->452984831) req@ffff962393a1f480 x1875064559653888/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:669/0 lens 488/0 e 0 to 0 dl 1788201559 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201548.909419:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1f480 with x1875064559653888 ext(451936256->452984831) 00002000:00010000:2.0:1788201548.909426:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1f480 00000100:00100000:2.0:1788201548.909615:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 475 00000100:00100000:2.0:1788201548.909627:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559653888:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201548.931900:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559653888:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22256us (22839us total) trans 30064771476 rc 0/0 00000100:00100000:2.0:1788201548.931918:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 475 00002000:00100000:2.0:1788201548.931934:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (451936256->452984831) req@ffff962393a1f480 x1875064559653888/t30064771476(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:669/0 lens 488/448 e 0 to 0 dl 1788201559 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201548.931947:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1f480 with x1875064559653888 ext(451936256->452984831) 00002000:00010000:2.0:1788201548.931955:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1f480 00000100:00100000:0.0:1788201549.126015:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201549.126211:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559654016 00000100:00100000:2.0:1788201549.126223:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559654016 00002000:00100000:2.0:1788201549.126465:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (452984832->454033407) req@ffff962388ba0a80 x1875064559654016/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:670/0 lens 488/0 e 0 to 0 dl 1788201560 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201549.126480:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0a80 with x1875064559654016 ext(452984832->454033407) 00002000:00010000:2.0:1788201549.126496:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0a80 00000100:00100000:2.0:1788201549.126538:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 476 00000100:00100000:2.0:1788201549.126550:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559654016:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201549.128170:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201549.139337:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559654016:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12772us (13322us total) trans 30064771477 rc 0/0 00000100:00100000:2.0:1788201549.139369:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 476 00002000:00100000:2.0:1788201549.139385:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (452984832->454033407) req@ffff962388ba0a80 x1875064559654016/t30064771477(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:670/0 lens 488/448 e 0 to 0 dl 1788201560 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201549.139398:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0a80 with x1875064559654016 ext(452984832->454033407) 00002000:00010000:2.0:1788201549.139405:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0a80 00000100:00100000:0.0:1788201549.219064:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201549.219175:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559654144 00000100:00100000:3.0:1788201549.219189:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559654144 00002000:00100000:3.0:1788201549.219257:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (454033408->455081983) req@ffff962388ba3b80 x1875064559654144/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:670/0 lens 488/0 e 0 to 0 dl 1788201560 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201549.219448:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3b80 with x1875064559654144 ext(454033408->455081983) 00002000:00010000:3.0:1788201549.219456:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3b80 00000100:00100000:3.0:1788201549.221503:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 477 00000100:00100000:3.0:1788201549.221531:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559654144:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201549.229986:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559654144:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8452us (10923us total) trans 30064771478 rc 0/0 00000100:00100000:1.0:1788201549.230006:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 477 00002000:00100000:1.0:1788201549.230022:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (454033408->455081983) req@ffff962388ba3b80 x1875064559654144/t30064771478(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:670/0 lens 488/448 e 0 to 0 dl 1788201560 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201549.230035:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3b80 with x1875064559654144 ext(454033408->455081983) 00002000:00010000:1.0:1788201549.230044:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3b80 00000100:00100000:3.0:1788201549.365995:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201549.367183:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201549.367212:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962388ba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570142848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201549.367282:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201549.367513:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570142848 00000100:00100000:0.0:1788201549.367522:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570142848 00000100:00100000:0.0:1788201549.367596:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788201549.367607:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570142848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201549.367673:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201549.367729:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570142848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201549.367737:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00010000:00080000:0.0:1788201549.367781:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962388ba1880 x1875064570142848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201549.367801:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962388ba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570142848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201549.367972:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559654272 00000100:00100000:1.0:1788201549.367979:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559654272 00002000:00100000:1.0:1788201549.368018:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (455081984->456130559) req@ffff962393a1f800 x1875064559654272/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:670/0 lens 488/0 e 0 to 0 dl 1788201560 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201549.368043:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1f800 with x1875064559654272 ext(455081984->456130559) 00002000:00010000:1.0:1788201549.368051:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1f800 00000100:00100000:1.0:1788201549.368077:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 478 00000100:00100000:1.0:1788201549.368085:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559654272:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201549.368368:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201549.404921:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559654272:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36818us (38927us total) trans 30064771479 rc 0/0 00000100:00100000:1.0:1788201549.404939:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 478 00002000:00100000:1.0:1788201549.404956:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (455081984->456130559) req@ffff962393a1f800 x1875064559654272/t30064771479(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:670/0 lens 488/448 e 0 to 0 dl 1788201560 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201549.404969:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1f800 with x1875064559654272 ext(455081984->456130559) 00002000:00010000:1.0:1788201549.404978:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1f800 00000100:00100000:2.0:1788201549.569788:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201549.569940:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559654400 00000100:00100000:0.0:1788201549.569953:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559654400 00002000:00100000:0.0:1788201549.570021:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (456130560->457179135) req@ffff962393a18e00 x1875064559654400/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:670/0 lens 488/0 e 0 to 0 dl 1788201560 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201549.570034:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18e00 with x1875064559654400 ext(456130560->457179135) 00002000:00010000:0.0:1788201549.570041:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18e00 00000100:00100000:0.0:1788201549.570084:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 479 00000100:00100000:0.0:1788201549.570095:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559654400:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201549.586078:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559654400:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15967us (16289us total) trans 30064771480 rc 0/0 00000100:00100000:0.0:1788201549.586099:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 479 00002000:00100000:0.0:1788201549.586116:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (456130560->457179135) req@ffff962393a18e00 x1875064559654400/t30064771480(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:670/0 lens 488/448 e 0 to 0 dl 1788201560 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201549.586128:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18e00 with x1875064559654400 ext(456130560->457179135) 00002000:00010000:0.0:1788201549.586136:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18e00 00010000:00010000:3.0:1788201549.622994:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201549.794199:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201549.795221:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559654528 00000100:00100000:0.0:1788201549.795262:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559654528 00002000:00100000:0.0:1788201549.795333:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (457179136->458227711) req@ffff962393a1a680 x1875064559654528/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:670/0 lens 488/0 e 0 to 0 dl 1788201560 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201549.795379:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1a680 with x1875064559654528 ext(457179136->458227711) 00002000:00010000:0.0:1788201549.795386:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1a680 00000100:00100000:0.0:1788201549.795591:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 480 00000100:00100000:0.0:1788201549.795604:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559654528:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201549.823112:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559654528:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27491us (28910us total) trans 30064771481 rc 0/0 00000100:00100000:0.0:1788201549.823130:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 480 00002000:00100000:0.0:1788201549.823145:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (457179136->458227711) req@ffff962393a1a680 x1875064559654528/t30064771481(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:670/0 lens 488/448 e 0 to 0 dl 1788201560 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201549.823157:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1a680 with x1875064559654528 ext(457179136->458227711) 00002000:00010000:0.0:1788201549.823165:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1a680 00000100:00100000:3.0:1788201549.878784:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570142976:0@lo:400:kworker.0 00000100:00100000:3.0:1788201549.878894:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201549.879047:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570142976 00000100:00100000:1.0:1788201549.879058:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570142976 00000100:00100000:1.0:1788201549.879123:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1788201549.879133:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570142976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201549.880141:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570143104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201549.880190:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201549.894745:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570142976:12345-0@lo:400:kworker.0 Request processed in 15599us (15837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201549.894767:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:2.0:1788201549.896285:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570143360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201549.896392:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201549.896437:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201549.896457:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570143232:0@lo:400:kworker.0 00000100:00100000:2.0:1788201549.896502:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201549.896547:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570143104 00000100:00100000:2.0:1788201549.896555:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570143104 00000100:00100000:2.0:1788201549.896609:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570143360 00000100:00100000:2.0:1788201549.896613:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570143360 00000100:00100000:2.0:1788201549.896654:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788201549.896665:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570143104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201549.896724:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570143104:12345-0@lo:400:kworker.0 Request processed in 61us (16532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201549.896731:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788201549.896750:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788201549.896758:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570143360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201549.896790:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570143360:12345-0@lo:400:kworker.0 Request processed in 34us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201549.896797:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788201549.896847:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570143360:0@lo:400:kworker.0 00000100:00080000:2.0:1788201549.896873:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201549.896898:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570143104:0@lo:400:kworker.0 00000100:00100000:2.0:1788201549.896909:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201549.896915:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570143488:0@lo:400:kworker.0 00000100:00100000:2.0:1788201549.896939:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201549.897096:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570143488 00000100:00100000:2.0:1788201549.897100:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570143488 00000100:00100000:1.0:1788201549.897119:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570143232 00000100:00100000:1.0:1788201549.897123:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570143232 00000100:00100000:2.0:1788201549.897126:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788201549.897131:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570143488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201549.897158:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788201549.897166:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570143232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201549.897166:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570143488:12345-0@lo:400:kworker.0 Request processed in 34us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201549.897172:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00080000:2.0:1788201549.897187:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201549.897190:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201549.897204:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570143488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201549.897205:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570143232:12345-0@lo:400:kworker.0 Request processed in 41us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201549.897218:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788201549.897246:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570143232:0@lo:400:kworker.0 00000100:00100000:3.0:1788201549.903118:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570142976:0@lo:400:kworker.0 00000100:00100000:2.0:1788201549.982721:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201549.982813:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559654656 00000100:00100000:1.0:1788201549.982825:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559654656 00002000:00100000:1.0:1788201549.983020:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (458227712->459276287) req@ffff962393a1a300 x1875064559654656/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:670/0 lens 488/0 e 0 to 0 dl 1788201560 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201549.983098:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1a300 with x1875064559654656 ext(458227712->459276287) 00002000:00010000:1.0:1788201549.983107:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1a300 00000100:00100000:1.0:1788201549.983171:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 481 00000100:00100000:1.0:1788201549.983180:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559654656:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201550.000689:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559654656:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17490us (17967us total) trans 30064771482 rc 0/0 00000100:00100000:1.0:1788201550.000706:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 481 00002000:00100000:1.0:1788201550.000723:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (458227712->459276287) req@ffff962393a1a300 x1875064559654656/t30064771482(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:670/0 lens 488/448 e 0 to 0 dl 1788201560 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201550.000737:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1a300 with x1875064559654656 ext(458227712->459276287) 00002000:00010000:1.0:1788201550.000745:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1a300 00000100:00100000:3.0:1788201550.186747:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201550.188168:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559654784 00000100:00100000:1.0:1788201550.188186:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559654784 00002000:00100000:1.0:1788201550.188261:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (459276288->460324863) req@ffff962393a1ce00 x1875064559654784/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:671/0 lens 488/0 e 0 to 0 dl 1788201561 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201550.188275:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1ce00 with x1875064559654784 ext(459276288->460324863) 00002000:00010000:1.0:1788201550.188295:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1ce00 00000100:00100000:1.0:1788201550.188411:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 482 00000100:00100000:1.0:1788201550.188423:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559654784:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201550.209719:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559654784:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21280us (22970us total) trans 30064771483 rc 0/0 00000100:00100000:1.0:1788201550.209736:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 482 00002000:00100000:1.0:1788201550.209751:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (459276288->460324863) req@ffff962393a1ce00 x1875064559654784/t30064771483(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:671/0 lens 488/448 e 0 to 0 dl 1788201561 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201550.209761:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1ce00 with x1875064559654784 ext(459276288->460324863) 00002000:00010000:1.0:1788201550.209769:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1ce00 00000100:00100000:3.0:1788201550.455150:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201550.455727:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559654912 00000100:00100000:0.0:1788201550.455741:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559654912 00002000:00100000:0.0:1788201550.455815:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (460324864->461373439) req@ffff962393a1e680 x1875064559654912/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:671/0 lens 488/0 e 0 to 0 dl 1788201561 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201550.455829:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1e680 with x1875064559654912 ext(460324864->461373439) 00002000:00010000:0.0:1788201550.455838:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1e680 00000100:00100000:0.0:1788201550.455885:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 483 00000100:00100000:0.0:1788201550.455896:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559654912:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201550.483644:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2342:x1875064559654912:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27726us (28486us total) trans 30064771484 rc 0/0 00000100:00100000:0.0:1788201550.483664:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 483 00002000:00100000:0.0:1788201550.483681:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (460324864->461373439) req@ffff962393a1e680 x1875064559654912/t30064771484(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:671/0 lens 488/448 e 0 to 0 dl 1788201561 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201550.483705:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1e680 with x1875064559654912 ext(460324864->461373439) 00002000:00010000:0.0:1788201550.483713:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1e680 00010000:00010000:1.0:1788201550.651275:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201550.732692:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201550.732840:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559655040 00000100:00100000:0.0:1788201550.732853:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559655040 00002000:00100000:0.0:1788201550.732924:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (461373440->462422015) req@ffff962393a1ed80 x1875064559655040/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:671/0 lens 488/0 e 0 to 0 dl 1788201561 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201550.733060:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1ed80 with x1875064559655040 ext(461373440->462422015) 00002000:00010000:0.0:1788201550.733070:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1ed80 00000100:00100000:0.0:1788201550.733113:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 484 00000100:00100000:0.0:1788201550.733127:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559655040:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201550.757527:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2341:x1875064559655040:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24387us (24838us total) trans 30064771485 rc 0/0 00000100:00100000:0.0:1788201550.757545:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 484 00002000:00100000:0.0:1788201550.757560:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (461373440->462422015) req@ffff962393a1ed80 x1875064559655040/t30064771485(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:671/0 lens 488/448 e 0 to 0 dl 1788201561 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201550.757574:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1ed80 with x1875064559655040 ext(461373440->462422015) 00002000:00010000:0.0:1788201550.757582:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1ed80 00000100:00100000:3.0:1788201550.949631:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201550.950548:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559655168 00000100:00100000:0.0:1788201550.950578:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559655168 00002000:00100000:0.0:1788201550.950660:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (462422016->463470591) req@ffff962393a1dc00 x1875064559655168/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:671/0 lens 488/0 e 0 to 0 dl 1788201561 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201550.950675:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1dc00 with x1875064559655168 ext(462422016->463470591) 00002000:00010000:0.0:1788201550.950683:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1dc00 00000100:00100000:0.0:1788201550.950724:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 485 00000100:00100000:0.0:1788201550.950735:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559655168:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201550.978019:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559655168:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27267us (28385us total) trans 30064771486 rc 0/0 00000100:00100000:0.0:1788201550.978038:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 485 00002000:00100000:0.0:1788201550.978056:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (462422016->463470591) req@ffff962393a1dc00 x1875064559655168/t30064771486(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:671/0 lens 488/448 e 0 to 0 dl 1788201561 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201550.978069:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1dc00 with x1875064559655168 ext(462422016->463470591) 00002000:00010000:0.0:1788201550.978078:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1dc00 00000100:00100000:2.0:1788201551.120586:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201551.120757:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559655296 00000100:00100000:1.0:1788201551.120770:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559655296 00002000:00100000:1.0:1788201551.120863:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (463470592->464519167) req@ffff962393a1b480 x1875064559655296/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:672/0 lens 488/0 e 0 to 0 dl 1788201562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201551.120877:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1b480 with x1875064559655296 ext(463470592->464519167) 00002000:00010000:1.0:1788201551.120884:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1b480 00000100:00100000:1.0:1788201551.120926:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 486 00000100:00100000:1.0:1788201551.120946:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559655296:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201551.121724:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201551.134933:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559655296:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13974us (14348us total) trans 30064771487 rc 0/0 00000100:00100000:3.0:1788201551.134950:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 486 00002000:00100000:3.0:1788201551.134981:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (463470592->464519167) req@ffff962393a1b480 x1875064559655296/t30064771487(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:672/0 lens 488/448 e 0 to 0 dl 1788201562 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201551.134993:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1b480 with x1875064559655296 ext(463470592->464519167) 00002000:00010000:3.0:1788201551.135001:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1b480 00000100:00100000:1.0:1788201551.236855:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201551.237263:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559655424 00000100:00100000:2.0:1788201551.237276:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559655424 00002000:00100000:2.0:1788201551.237400:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (464519168->465567743) req@ffff9623939e0000 x1875064559655424/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:672/0 lens 488/0 e 0 to 0 dl 1788201562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201551.237414:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0000 with x1875064559655424 ext(464519168->465567743) 00002000:00010000:2.0:1788201551.237421:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0000 00000100:00100000:2.0:1788201551.237471:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 487 00000100:00100000:2.0:1788201551.237484:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559655424:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201551.261775:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559655424:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24272us (24922us total) trans 30064771488 rc 0/0 00000100:00100000:3.0:1788201551.261800:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 487 00002000:00100000:3.0:1788201551.261823:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (464519168->465567743) req@ffff9623939e0000 x1875064559655424/t30064771488(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:672/0 lens 488/448 e 0 to 0 dl 1788201562 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201551.261834:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0000 with x1875064559655424 ext(464519168->465567743) 00002000:00010000:3.0:1788201551.261843:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0000 00000100:00100000:2.0:1788201551.465697:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201551.465966:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559655552 00000100:00100000:0.0:1788201551.465978:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559655552 00002000:00100000:0.0:1788201551.466040:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (465567744->466616319) req@ffff962393a1ad80 x1875064559655552/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:672/0 lens 488/0 e 0 to 0 dl 1788201562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201551.466053:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1ad80 with x1875064559655552 ext(465567744->466616319) 00002000:00010000:0.0:1788201551.466060:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1ad80 00000100:00100000:0.0:1788201551.466106:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 488 00000100:00100000:0.0:1788201551.466116:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559655552:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201551.479178:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559655552:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13041us (13475us total) trans 30064771489 rc 0/0 00000100:00100000:2.0:1788201551.479198:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 488 00002000:00100000:2.0:1788201551.479215:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (465567744->466616319) req@ffff962393a1ad80 x1875064559655552/t30064771489(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:672/0 lens 488/448 e 0 to 0 dl 1788201562 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201551.479256:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1ad80 with x1875064559655552 ext(465567744->466616319) 00002000:00010000:2.0:1788201551.479265:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1ad80 00000100:00100000:1.0:1788201551.650075:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201551.659625:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559655680 00000100:00100000:0.0:1788201551.659641:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559655680 00002000:00100000:0.0:1788201551.659738:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (466616320->467664895) req@ffff9623939e0e00 x1875064559655680/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:672/0 lens 488/0 e 0 to 0 dl 1788201562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201551.659750:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0e00 with x1875064559655680 ext(466616320->467664895) 00002000:00010000:0.0:1788201551.659756:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0e00 00000100:00100000:0.0:1788201551.661508:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 489 00000100:00100000:0.0:1788201551.661526:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559655680:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:1.0:1788201551.675386:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201551.693183:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559655680:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31648us (43102us total) trans 30064771490 rc 0/0 00000100:00100000:2.0:1788201551.693201:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 489 00002000:00100000:2.0:1788201551.693217:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (466616320->467664895) req@ffff9623939e0e00 x1875064559655680/t30064771490(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:672/0 lens 488/448 e 0 to 0 dl 1788201562 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201551.693384:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0e00 with x1875064559655680 ext(466616320->467664895) 00002000:00010000:2.0:1788201551.693391:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0e00 00000100:00100000:1.0:1788201551.814210:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201551.819484:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559655808 00000100:00100000:3.0:1788201551.819508:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559655808 00002000:00100000:3.0:1788201551.819595:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (467664896->468713471) req@ffff9623939e2680 x1875064559655808/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:672/0 lens 488/0 e 0 to 0 dl 1788201562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201551.819609:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2680 with x1875064559655808 ext(467664896->468713471) 00002000:00010000:3.0:1788201551.819616:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2680 00000100:00100000:3.0:1788201551.819745:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 490 00000100:00100000:3.0:1788201551.819757:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559655808:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201551.855570:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559655808:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35796us (41356us total) trans 30064771491 rc 0/0 00000100:00100000:1.0:1788201551.855614:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 490 00002000:00100000:1.0:1788201551.855633:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (467664896->468713471) req@ffff9623939e2680 x1875064559655808/t30064771491(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:672/0 lens 488/448 e 0 to 0 dl 1788201562 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201551.855646:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2680 with x1875064559655808 ext(467664896->468713471) 00002000:00010000:1.0:1788201551.855654:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2680 00000100:00100000:3.0:1788201551.926994:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201551.927030:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570143616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201551.927130:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201551.927469:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570143616 00000100:00100000:1.0:1788201551.927479:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570143616 00000100:00100000:1.0:1788201551.927566:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788201551.927579:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570143616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201551.927611:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 569442304 pending 40894464 free 3416260608 avail 3414163456 00000100:00100000:1.0:1788201551.927680:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570143616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201551.927688:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788201551.927825:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570143616:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201551.928115:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201552.032513:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201552.033091:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559655936 00000100:00100000:2.0:1788201552.033104:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559655936 00002000:00100000:2.0:1788201552.033175:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (468713472->469762047) req@ffff962393a1ca80 x1875064559655936/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:673/0 lens 488/0 e 0 to 0 dl 1788201563 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201552.033189:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1ca80 with x1875064559655936 ext(468713472->469762047) 00002000:00010000:2.0:1788201552.033196:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1ca80 00000100:00100000:2.0:1788201552.033244:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 491 00000100:00100000:2.0:1788201552.033256:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2341:x1875064559655936:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201552.052953:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2341:x1875064559655936:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19500us (20261us total) trans 30064771492 rc 0/0 00000100:00100000:2.0:1788201552.052975:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 491 00002000:00100000:2.0:1788201552.052999:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (468713472->469762047) req@ffff962393a1ca80 x1875064559655936/t30064771492(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:673/0 lens 488/448 e 0 to 0 dl 1788201563 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201552.053037:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1ca80 with x1875064559655936 ext(468713472->469762047) 00002000:00010000:2.0:1788201552.053046:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1ca80 00000100:00100000:3.0:1788201552.290690:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201552.291196:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559656064 00000100:00100000:2.0:1788201552.291208:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559656064 00002000:00100000:2.0:1788201552.291288:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (469762048->470810623) req@ffff962393a1fb80 x1875064559656064/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:673/0 lens 488/0 e 0 to 0 dl 1788201563 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201552.291302:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1fb80 with x1875064559656064 ext(469762048->470810623) 00002000:00010000:2.0:1788201552.291309:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1fb80 00000100:00100000:2.0:1788201552.291390:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 492 00000100:00100000:2.0:1788201552.291404:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559656064:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201552.336099:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2344:x1875064559656064:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 44680us (45407us total) trans 30064771493 rc 0/0 00000100:00100000:2.0:1788201552.336118:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 492 00002000:00100000:2.0:1788201552.336134:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (469762048->470810623) req@ffff962393a1fb80 x1875064559656064/t30064771493(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:673/0 lens 488/448 e 0 to 0 dl 1788201563 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201552.336147:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1fb80 with x1875064559656064 ext(469762048->470810623) 00002000:00010000:2.0:1788201552.336156:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1fb80 00000100:00100000:3.0:1788201552.548305:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201552.548544:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559656192 00000100:00100000:1.0:1788201552.548556:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559656192 00002000:00100000:1.0:1788201552.548615:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (470810624->471859199) req@ffff962393a1d880 x1875064559656192/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:673/0 lens 488/0 e 0 to 0 dl 1788201563 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201552.548628:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1d880 with x1875064559656192 ext(470810624->471859199) 00002000:00010000:1.0:1788201552.548634:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1d880 00000100:00100000:1.0:1788201552.548675:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 493 00000100:00100000:1.0:1788201552.548685:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559656192:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201552.571289:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2343:x1875064559656192:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22584us (22977us total) trans 30064771494 rc 0/0 00000100:00100000:2.0:1788201552.571312:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 493 00002000:00100000:2.0:1788201552.571334:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (470810624->471859199) req@ffff962393a1d880 x1875064559656192/t30064771494(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:673/0 lens 488/448 e 0 to 0 dl 1788201563 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201552.571405:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1d880 with x1875064559656192 ext(470810624->471859199) 00002000:00010000:2.0:1788201552.571415:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1d880 00000001:00080000:3.0:1788201552.648272:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771486 is committed 00000001:00080000:3.0:1788201552.648323:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771491 is committed 00000001:00080000:3.0:1788201552.648397:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771493 is committed 00010000:00010000:3.0:1788201552.694995:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201552.734188:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201552.734399:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559656320 00000100:00100000:3.0:1788201552.734412:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559656320 00002000:00100000:3.0:1788201552.734486:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (471859200->472907775) req@ffff9624b9b97450 x1875064559656320/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:673/0 lens 488/0 e 0 to 0 dl 1788201563 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201552.734498:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9b97450 with x1875064559656320 ext(471859200->472907775) 00002000:00010000:3.0:1788201552.734504:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9b97450 00000100:00100000:3.0:1788201552.734542:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 494 00000100:00100000:3.0:1788201552.734553:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559656320:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201552.757596:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559656320:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23025us (23405us total) trans 30064771495 rc 0/0 00000100:00100000:0.0:1788201552.760637:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 494 00002000:00100000:0.0:1788201552.760663:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (471859200->472907775) req@ffff9624b9b97450 x1875064559656320/t30064771495(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:673/0 lens 488/448 e 0 to 0 dl 1788201563 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201552.760676:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9b97450 with x1875064559656320 ext(471859200->472907775) 00002000:00010000:0.0:1788201552.760684:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9b97450 00000100:00100000:3.0:1788201553.022664:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201553.022813:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559656448 00000100:00100000:2.0:1788201553.022826:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559656448 00002000:00100000:2.0:1788201553.022923:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (472907776->473956351) req@ffff962393a1ea00 x1875064559656448/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/0 e 0 to 0 dl 1788201564 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201553.022937:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1ea00 with x1875064559656448 ext(472907776->473956351) 00002000:00010000:2.0:1788201553.022944:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1ea00 00000100:00100000:2.0:1788201553.022990:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 495 00000100:00100000:2.0:1788201553.023004:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559656448:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201553.023456:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201553.046974:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559656448:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23959us (24312us total) trans 30064771496 rc 0/0 00000100:00100000:2.0:1788201553.046990:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 495 00002000:00100000:2.0:1788201553.047005:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (472907776->473956351) req@ffff962393a1ea00 x1875064559656448/t30064771496(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/448 e 0 to 0 dl 1788201564 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201553.047018:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1ea00 with x1875064559656448 ext(472907776->473956351) 00002000:00010000:2.0:1788201553.047026:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1ea00 00000100:00100000:1.0:1788201553.302965:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201553.303090:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559656576 00000100:00100000:2.0:1788201553.303102:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559656576 00002000:00100000:2.0:1788201553.303170:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (473956352->475004927) req@ffff9623939e2d80 x1875064559656576/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/0 e 0 to 0 dl 1788201564 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201553.303183:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2d80 with x1875064559656576 ext(473956352->475004927) 00002000:00010000:2.0:1788201553.303191:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2d80 00000100:00100000:2.0:1788201553.303248:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 496 00000100:00100000:2.0:1788201553.303259:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559656576:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201553.324820:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559656576:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21545us (21853us total) trans 30064771497 rc 0/0 00000100:00100000:2.0:1788201553.324837:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 496 00002000:00100000:2.0:1788201553.324854:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (473956352->475004927) req@ffff9623939e2d80 x1875064559656576/t30064771497(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/448 e 0 to 0 dl 1788201564 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201553.324867:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2d80 with x1875064559656576 ext(473956352->475004927) 00002000:00010000:2.0:1788201553.324875:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2d80 00000100:00100000:3.0:1788201553.406029:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201553.408825:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559656704 00000100:00100000:1.0:1788201553.408867:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559656704 00002000:00100000:1.0:1788201553.409001:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (475004928->476053503) req@ffff962393a1d180 x1875064559656704/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/0 e 0 to 0 dl 1788201564 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201553.409014:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1d180 with x1875064559656704 ext(475004928->476053503) 00002000:00010000:1.0:1788201553.409021:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1d180 00000100:00100000:1.0:1788201553.409114:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 497 00000100:00100000:1.0:1788201553.409126:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559656704:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201553.428789:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559656704:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19647us (23446us total) trans 30064771498 rc 0/0 00000100:00100000:1.0:1788201553.428809:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 497 00002000:00100000:1.0:1788201553.428826:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (475004928->476053503) req@ffff962393a1d180 x1875064559656704/t30064771498(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/448 e 0 to 0 dl 1788201564 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201553.428838:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1d180 with x1875064559656704 ext(475004928->476053503) 00002000:00010000:1.0:1788201553.428847:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1d180 00000100:00100000:3.0:1788201553.525631:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201553.525987:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559656832 00000100:00100000:0.0:1788201553.525999:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559656832 00002000:00100000:0.0:1788201553.526063:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (476053504->477102079) req@ffff962393a1c700 x1875064559656832/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/0 e 0 to 0 dl 1788201564 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201553.526076:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1c700 with x1875064559656832 ext(476053504->477102079) 00002000:00010000:0.0:1788201553.526083:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1c700 00000100:00100000:0.0:1788201553.526177:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 498 00000100:00100000:0.0:1788201553.526198:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559656832:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201553.544091:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559656832:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17884us (18455us total) trans 30064771499 rc 0/0 00000100:00100000:0.0:1788201553.544132:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 498 00002000:00100000:0.0:1788201553.544148:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (476053504->477102079) req@ffff962393a1c700 x1875064559656832/t30064771499(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/448 e 0 to 0 dl 1788201564 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201553.544161:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1c700 with x1875064559656832 ext(476053504->477102079) 00002000:00010000:0.0:1788201553.544168:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1c700 00000100:00100000:3.0:1788201553.632067:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201553.632376:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559656960 00000100:00100000:2.0:1788201553.632390:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559656960 00002000:00100000:2.0:1788201553.632476:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (477102080->478150655) req@ffff962393a1e300 x1875064559656960/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/0 e 0 to 0 dl 1788201564 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201553.632488:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1e300 with x1875064559656960 ext(477102080->478150655) 00002000:00010000:2.0:1788201553.632496:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1e300 00000100:00100000:2.0:1788201553.632539:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 499 00000100:00100000:2.0:1788201553.632551:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559656960:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201553.668465:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559656960:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35901us (36398us total) trans 30064771500 rc 0/0 00000100:00100000:2.0:1788201553.668484:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 499 00002000:00100000:2.0:1788201553.668500:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (477102080->478150655) req@ffff962393a1e300 x1875064559656960/t30064771500(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/448 e 0 to 0 dl 1788201564 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201553.668513:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1e300 with x1875064559656960 ext(477102080->478150655) 00002000:00010000:2.0:1788201553.668538:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1e300 00000100:00100000:3.0:1788201553.717592:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201553.717665:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201553.717763:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559657088 00000100:00100000:1.0:1788201553.717774:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559657088 00000100:00100000:1.0:1788201553.717842:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 536 00000100:00100000:1.0:1788201553.717852:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559657088:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201553.717950:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559657088:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 100us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201553.717958:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 536 00010000:00010000:1.0:1788201553.718663:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201553.718993:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559657216 00000100:00100000:2.0:1788201553.719003:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559657216 00000100:00100000:2.0:1788201553.719082:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 387 00000100:00100000:2.0:1788201553.719092:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559657216:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201553.719165:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559657216:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 76us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201553.719172:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 387 00000100:00080000:0.0:1788201553.719294:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201553.750796:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201553.751414:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559657344 00000100:00100000:2.0:1788201553.751427:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559657344 00002000:00100000:2.0:1788201553.751494:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (478150656->479199231) req@ffff962393a1c380 x1875064559657344/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/0 e 0 to 0 dl 1788201564 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201553.751508:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1c380 with x1875064559657344 ext(478150656->479199231) 00002000:00010000:2.0:1788201553.751516:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1c380 00000100:00100000:2.0:1788201553.751549:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 500 00000100:00100000:2.0:1788201553.751559:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559657344:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201553.833291:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559657344:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 81713us (82492us total) trans 30064771501 rc 0/0 00000100:00100000:2.0:1788201553.833311:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 500 00002000:00100000:2.0:1788201553.833327:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (478150656->479199231) req@ffff962393a1c380 x1875064559657344/t30064771501(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/448 e 0 to 0 dl 1788201564 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201553.833366:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1c380 with x1875064559657344 ext(478150656->479199231) 00002000:00010000:2.0:1788201553.833374:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1c380 00000100:00100000:1.0:1788201553.873922:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201553.874097:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559657472 00000100:00100000:2.0:1788201553.874129:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559657472 00002000:00100000:2.0:1788201553.874208:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (479199232->480247807) req@ffff9623939e1c00 x1875064559657472/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/0 e 0 to 0 dl 1788201564 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201553.874223:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1c00 with x1875064559657472 ext(479199232->480247807) 00002000:00010000:2.0:1788201553.874230:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1c00 00000100:00100000:2.0:1788201553.874478:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 501 00000100:00100000:2.0:1788201553.874491:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559657472:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201553.893874:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559657472:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19371us (19955us total) trans 30064771502 rc 0/0 00000100:00100000:2.0:1788201553.893891:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 501 00002000:00100000:2.0:1788201553.893906:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (479199232->480247807) req@ffff9623939e1c00 x1875064559657472/t30064771502(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/448 e 0 to 0 dl 1788201564 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201553.893919:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1c00 with x1875064559657472 ext(479199232->480247807) 00002000:00010000:2.0:1788201553.893926:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1c00 00000100:00100000:3.0:1788201553.985335:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201553.985747:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559657600 00000100:00100000:0.0:1788201553.985760:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559657600 00002000:00100000:0.0:1788201553.985825:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (480247808->481296383) req@ffff962393a1df80 x1875064559657600/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/0 e 0 to 0 dl 1788201564 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201553.985838:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1df80 with x1875064559657600 ext(480247808->481296383) 00002000:00010000:0.0:1788201553.985845:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1df80 00000100:00100000:0.0:1788201553.985895:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 502 00000100:00100000:0.0:1788201553.985907:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559657600:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201553.999476:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559657600:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13554us (14140us total) trans 30064771503 rc 0/0 00000100:00100000:0.0:1788201553.999492:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 502 00002000:00100000:0.0:1788201553.999509:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (480247808->481296383) req@ffff962393a1df80 x1875064559657600/t30064771503(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:674/0 lens 488/448 e 0 to 0 dl 1788201564 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201553.999521:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1df80 with x1875064559657600 ext(480247808->481296383) 00002000:00010000:0.0:1788201553.999529:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1df80 00000100:00100000:3.0:1788201554.100502:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201554.100641:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559657728 00000100:00100000:2.0:1788201554.100654:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559657728 00002000:00100000:2.0:1788201554.100719:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (481296384->482344959) req@ffff962393a1f480 x1875064559657728/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:675/0 lens 488/0 e 0 to 0 dl 1788201565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201554.100731:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1f480 with x1875064559657728 ext(481296384->482344959) 00002000:00010000:2.0:1788201554.100738:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1f480 00000100:00100000:2.0:1788201554.100783:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 503 00000100:00100000:2.0:1788201554.100795:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559657728:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201554.109160:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559657728:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8350us (8659us total) trans 30064771504 rc 0/0 00000100:00100000:2.0:1788201554.109198:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 503 00002000:00100000:2.0:1788201554.109214:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (481296384->482344959) req@ffff962393a1f480 x1875064559657728/t30064771504(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:675/0 lens 488/448 e 0 to 0 dl 1788201565 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201554.109227:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1f480 with x1875064559657728 ext(481296384->482344959) 00002000:00010000:2.0:1788201554.109236:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1f480 00000100:00100000:1.0:1788201554.235800:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201554.242664:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559657856 00000100:00100000:2.0:1788201554.242687:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559657856 00002000:00100000:2.0:1788201554.242770:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (482344960->483393535) req@ffff9623939e3100 x1875064559657856/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:675/0 lens 488/0 e 0 to 0 dl 1788201565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201554.242785:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3100 with x1875064559657856 ext(482344960->483393535) 00002000:00010000:2.0:1788201554.242792:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3100 00000100:00100000:2.0:1788201554.242903:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 504 00000100:00100000:2.0:1788201554.242915:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559657856:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201554.267322:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559657856:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24389us (31517us total) trans 30064771505 rc 0/0 00000100:00100000:2.0:1788201554.267373:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 504 00002000:00100000:2.0:1788201554.267389:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (482344960->483393535) req@ffff9623939e3100 x1875064559657856/t30064771505(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:675/0 lens 488/448 e 0 to 0 dl 1788201565 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201554.267413:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3100 with x1875064559657856 ext(482344960->483393535) 00002000:00010000:2.0:1788201554.267421:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3100 00000100:00100000:2.0:1788201554.379533:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201554.379715:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559657984 00000100:00100000:1.0:1788201554.379742:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559657984 00002000:00100000:1.0:1788201554.379812:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (483393536->484442111) req@ffff962393a18a80 x1875064559657984/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:675/0 lens 488/0 e 0 to 0 dl 1788201565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201554.379826:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18a80 with x1875064559657984 ext(483393536->484442111) 00002000:00010000:1.0:1788201554.379833:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18a80 00000100:00100000:1.0:1788201554.379883:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 505 00000100:00100000:1.0:1788201554.379896:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2341:x1875064559657984:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201554.393367:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559657984:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13429us (13806us total) trans 30064771506 rc 0/0 00000100:00100000:1.0:1788201554.393388:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 505 00002000:00100000:1.0:1788201554.396536:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (483393536->484442111) req@ffff962393a18a80 x1875064559657984/t30064771506(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:675/0 lens 488/448 e 0 to 0 dl 1788201565 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201554.396557:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18a80 with x1875064559657984 ext(483393536->484442111) 00002000:00010000:1.0:1788201554.396566:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18a80 00000100:00100000:3.0:1788201554.487737:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962388ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570143744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201554.487842:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201554.489376:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570143744 00000100:00100000:2.0:1788201554.489397:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570143744 00000100:00100000:2.0:1788201554.489504:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788201554.489517:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570143744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201554.489566:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201554.489642:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570143744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201554.489650:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00010000:00080000:3.0:1788201554.490301:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962388ba2d80 x1875064570143744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201554.490335:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962388ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570143744:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201554.490590:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201554.558833:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201554.558961:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559658112 00000100:00100000:0.0:1788201554.558988:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559658112 00002000:00100000:0.0:1788201554.559045:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (484442112->485490687) req@ffff962393a1ce00 x1875064559658112/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:675/0 lens 488/0 e 0 to 0 dl 1788201565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201554.559058:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1ce00 with x1875064559658112 ext(484442112->485490687) 00002000:00010000:0.0:1788201554.559064:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1ce00 00000100:00100000:0.0:1788201554.559101:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 506 00000100:00100000:0.0:1788201554.559111:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559658112:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201554.578582:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559658112:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19455us (19748us total) trans 30064771507 rc 0/0 00000100:00100000:1.0:1788201554.578600:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 506 00002000:00100000:1.0:1788201554.578616:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (484442112->485490687) req@ffff962393a1ce00 x1875064559658112/t30064771507(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:675/0 lens 488/448 e 0 to 0 dl 1788201565 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201554.578628:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1ce00 with x1875064559658112 ext(484442112->485490687) 00002000:00010000:1.0:1788201554.578636:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1ce00 00010000:00010000:1.0:1788201554.748521:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201554.816897:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201554.817053:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559658240 00000100:00100000:2.0:1788201554.817065:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559658240 00002000:00100000:2.0:1788201554.817135:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (485490688->486539263) req@ffff962393a1e680 x1875064559658240/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:675/0 lens 488/0 e 0 to 0 dl 1788201565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201554.817148:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1e680 with x1875064559658240 ext(485490688->486539263) 00002000:00010000:2.0:1788201554.817155:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1e680 00000100:00100000:2.0:1788201554.817208:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 507 00000100:00100000:2.0:1788201554.817220:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559658240:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201554.836337:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559658240:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19100us (19438us total) trans 30064771508 rc 0/0 00000100:00100000:0.0:1788201554.836376:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 507 00002000:00100000:0.0:1788201554.836409:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (485490688->486539263) req@ffff962393a1e680 x1875064559658240/t30064771508(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:675/0 lens 488/448 e 0 to 0 dl 1788201565 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201554.836422:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1e680 with x1875064559658240 ext(485490688->486539263) 00002000:00010000:0.0:1788201554.836430:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1e680 00000100:00100000:2.0:1788201554.966886:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201554.967067:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559658368 00000100:00100000:0.0:1788201554.967080:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559658368 00002000:00100000:0.0:1788201554.967146:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (486539264->487587839) req@ffff962393a1bb80 x1875064559658368/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:675/0 lens 488/0 e 0 to 0 dl 1788201565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201554.967159:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1bb80 with x1875064559658368 ext(486539264->487587839) 00002000:00010000:0.0:1788201554.967178:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1bb80 00000100:00100000:0.0:1788201554.967225:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 508 00000100:00100000:0.0:1788201554.967237:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559658368:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201554.987570:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559658368:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20315us (20690us total) trans 30064771509 rc 0/0 00000100:00100000:0.0:1788201554.990752:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 508 00002000:00100000:0.0:1788201554.990883:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (486539264->487587839) req@ffff962393a1bb80 x1875064559658368/t30064771509(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:675/0 lens 488/448 e 0 to 0 dl 1788201565 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201554.990897:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1bb80 with x1875064559658368 ext(486539264->487587839) 00002000:00010000:0.0:1788201554.990906:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1bb80 00000100:00100000:2.0:1788201555.008537:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570143872:0@lo:400:kworker.0 00000100:00100000:2.0:1788201555.008676:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201555.008824:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570143872 00000100:00100000:0.0:1788201555.008835:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570143872 00000100:00100000:0.0:1788201555.008977:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1788201555.008990:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570143872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201555.010429:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570144000:0@lo:400:kworker.0 00000100:00100000:3.0:1788201555.010493:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201555.010536:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201555.010542:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570144128:0@lo:400:kworker.0 00000100:00100000:3.0:1788201555.010572:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201555.010610:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570144000 00000100:00100000:3.0:1788201555.010617:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570144000 00000100:00100000:3.0:1788201555.010665:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788201555.010674:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570144000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201555.010723:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570144000:12345-0@lo:400:kworker.0 Request processed in 51us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201555.010731:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788201555.010761:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570144128 00000100:00100000:3.0:1788201555.010765:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570144128 00000100:00100000:3.0:1788201555.010820:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788201555.010827:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570144128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201555.010871:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570144128:12345-0@lo:400:kworker.0 Request processed in 34us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201555.010879:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:3.0:1788201555.010901:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201555.010940:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570144128:0@lo:400:kworker.0 00000100:00100000:3.0:1788201555.010952:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570144000:0@lo:400:kworker.0 00000100:00100000:3.0:1788201555.010999:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570144256:0@lo:400:kworker.0 00000100:00100000:3.0:1788201555.011027:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201555.011060:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570144256 00000100:00100000:3.0:1788201555.011064:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570144256 00000100:00100000:3.0:1788201555.011092:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788201555.011099:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570144256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201555.011134:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570144256:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201555.011141:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00080000:3.0:1788201555.011155:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201555.011189:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570144256:0@lo:400:kworker.0 00000100:00100000:0.0:1788201555.017526:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570143872:12345-0@lo:400:kworker.0 Request processed in 8522us (8833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201555.017548:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:2.0:1788201555.021361:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570143872:0@lo:400:kworker.0 00000100:00100000:3.0:1788201555.027115:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201555.030735:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201555.030778:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570144512:0@lo:400:kworker.0 00000100:00100000:2.0:1788201555.030889:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201555.031704:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570144512 00000100:00100000:1.0:1788201555.031715:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570144512 00000100:00100000:1.0:1788201555.031839:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788201555.031851:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570144512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201555.031938:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570144512:12345-0@lo:400:kworker.0 Request processed in 90us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201555.031946:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788201555.032002:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570144512:0@lo:400:kworker.0 00000100:00080000:2.0:1788201555.037712:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201555.038009:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570144384:0@lo:400:kworker.0 00000100:00100000:3.0:1788201555.038115:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201555.038364:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570144384 00000100:00100000:1.0:1788201555.038376:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570144384 00000100:00100000:1.0:1788201555.038457:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788201555.038469:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570144384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201555.038544:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570144384:12345-0@lo:400:kworker.0 Request processed in 78us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201555.038552:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00010000:00080000:3.0:1788201555.038727:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9623939e3480 x1875064570144384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201555.038744:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570144384:0@lo:400:kworker.0 00000100:00100000:2.0:1788201555.145880:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201555.146522:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559658496 00000100:00100000:1.0:1788201555.146535:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559658496 00002000:00100000:1.0:1788201555.146710:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (487587840->488636415) req@ffff962393a1aa00 x1875064559658496/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:676/0 lens 488/0 e 0 to 0 dl 1788201566 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201555.146723:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1aa00 with x1875064559658496 ext(487587840->488636415) 00002000:00010000:1.0:1788201555.146730:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1aa00 00000100:00100000:1.0:1788201555.146776:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 509 00000100:00100000:1.0:1788201555.146787:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559658496:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201555.147569:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201555.169811:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559658496:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23007us (23940us total) trans 30064771510 rc 0/0 00000100:00100000:1.0:1788201555.169829:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 509 00002000:00100000:1.0:1788201555.169845:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (487587840->488636415) req@ffff962393a1aa00 x1875064559658496/t30064771510(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:676/0 lens 488/448 e 0 to 0 dl 1788201566 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201555.169944:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1aa00 with x1875064559658496 ext(487587840->488636415) 00002000:00010000:1.0:1788201555.169953:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1aa00 00000100:00100000:2.0:1788201555.265080:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201555.266155:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559658624 00000100:00100000:1.0:1788201555.266171:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559658624 00002000:00100000:1.0:1788201555.266244:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (488636416->489684991) req@ffff962393a19180 x1875064559658624/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:676/0 lens 488/0 e 0 to 0 dl 1788201566 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201555.266258:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a19180 with x1875064559658624 ext(488636416->489684991) 00002000:00010000:1.0:1788201555.266265:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a19180 00000100:00100000:1.0:1788201555.266304:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 510 00000100:00100000:1.0:1788201555.266313:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559658624:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201555.279685:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559658624:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13343us (14592us total) trans 30064771511 rc 0/0 00000100:00100000:1.0:1788201555.279704:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 510 00002000:00100000:1.0:1788201555.279720:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (488636416->489684991) req@ffff962393a19180 x1875064559658624/t30064771511(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:676/0 lens 488/448 e 0 to 0 dl 1788201566 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201555.279733:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a19180 with x1875064559658624 ext(488636416->489684991) 00002000:00010000:1.0:1788201555.279740:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a19180 00000100:00100000:2.0:1788201555.394224:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201555.394414:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559658752 00000100:00100000:0.0:1788201555.394428:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559658752 00002000:00100000:0.0:1788201555.394498:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (489684992->490733567) req@ffff962393a18700 x1875064559658752/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:676/0 lens 488/0 e 0 to 0 dl 1788201566 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201555.394511:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18700 with x1875064559658752 ext(489684992->490733567) 00002000:00010000:0.0:1788201555.394517:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18700 00000100:00100000:0.0:1788201555.394559:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 511 00000100:00100000:0.0:1788201555.394571:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2341:x1875064559658752:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201555.418973:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2341:x1875064559658752:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24379us (24738us total) trans 30064771512 rc 0/0 00000100:00100000:0.0:1788201555.418997:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 511 00002000:00100000:0.0:1788201555.419064:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (489684992->490733567) req@ffff962393a18700 x1875064559658752/t30064771512(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:676/0 lens 488/448 e 0 to 0 dl 1788201566 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201555.419077:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18700 with x1875064559658752 ext(489684992->490733567) 00002000:00010000:0.0:1788201555.419085:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18700 00000100:00100000:2.0:1788201555.581031:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201555.581162:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559658880 00000100:00100000:0.0:1788201555.581175:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559658880 00002000:00100000:0.0:1788201555.581312:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (490733568->491782143) req@ffff962393a19f80 x1875064559658880/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:676/0 lens 488/0 e 0 to 0 dl 1788201566 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201555.581425:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a19f80 with x1875064559658880 ext(490733568->491782143) 00002000:00010000:0.0:1788201555.581432:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a19f80 00000100:00100000:0.0:1788201555.581528:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 512 00000100:00100000:0.0:1788201555.581540:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559658880:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201555.594247:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559658880:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12696us (13220us total) trans 30064771513 rc 0/0 00000100:00100000:0.0:1788201555.594264:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 512 00002000:00100000:0.0:1788201555.594277:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (490733568->491782143) req@ffff962393a19f80 x1875064559658880/t30064771513(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:676/0 lens 488/448 e 0 to 0 dl 1788201566 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201555.594288:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a19f80 with x1875064559658880 ext(490733568->491782143) 00002000:00010000:0.0:1788201555.594294:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a19f80 00000100:00100000:2.0:1788201555.764455:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201555.764558:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559659008 00000100:00100000:1.0:1788201555.764570:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559659008 00002000:00100000:1.0:1788201555.764629:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (491782144->492830719) req@ffff962393a18000 x1875064559659008/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:676/0 lens 488/0 e 0 to 0 dl 1788201566 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201555.764641:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18000 with x1875064559659008 ext(491782144->492830719) 00002000:00010000:1.0:1788201555.764647:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18000 00000100:00100000:1.0:1788201555.764708:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 513 00000100:00100000:1.0:1788201555.764718:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559659008:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:3.0:1788201555.766567:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201555.782617:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559659008:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17888us (18161us total) trans 30064771514 rc 0/0 00000100:00100000:3.0:1788201555.782633:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 513 00002000:00100000:3.0:1788201555.782647:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (491782144->492830719) req@ffff962393a18000 x1875064559659008/t30064771514(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:676/0 lens 488/448 e 0 to 0 dl 1788201566 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201555.782658:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18000 with x1875064559659008 ext(491782144->492830719) 00002000:00010000:3.0:1788201555.782678:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18000 00000100:00100000:2.0:1788201555.961672:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201555.961791:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559659136 00000100:00100000:1.0:1788201555.961804:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559659136 00002000:00100000:1.0:1788201555.961876:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (492830720->493879295) req@ffff962393a18e00 x1875064559659136/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:676/0 lens 488/0 e 0 to 0 dl 1788201566 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201555.961889:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18e00 with x1875064559659136 ext(492830720->493879295) 00002000:00010000:1.0:1788201555.961895:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18e00 00000100:00100000:1.0:1788201555.961952:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 514 00000100:00100000:1.0:1788201555.961964:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559659136:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201555.987073:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559659136:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25094us (25402us total) trans 30064771515 rc 0/0 00000100:00100000:1.0:1788201555.987093:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 514 00002000:00100000:1.0:1788201555.987110:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (492830720->493879295) req@ffff962393a18e00 x1875064559659136/t30064771515(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:676/0 lens 488/448 e 0 to 0 dl 1788201566 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201555.987122:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a18e00 with x1875064559659136 ext(492830720->493879295) 00002000:00010000:1.0:1788201555.987130:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a18e00 00000100:00100000:0.0:1788201556.154454:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201556.154643:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559659264 00000100:00100000:2.0:1788201556.154655:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559659264 00002000:00100000:2.0:1788201556.154719:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (493879296->494927871) req@ffff962388ba3100 x1875064559659264/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:677/0 lens 488/0 e 0 to 0 dl 1788201567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201556.154733:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3100 with x1875064559659264 ext(493879296->494927871) 00002000:00010000:2.0:1788201556.154741:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3100 00000100:00100000:2.0:1788201556.154781:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 515 00000100:00100000:2.0:1788201556.154793:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559659264:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201556.191662:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559659264:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36856us (37207us total) trans 30064771516 rc 0/0 00000100:00100000:3.0:1788201556.191678:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 515 00002000:00100000:3.0:1788201556.191692:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (493879296->494927871) req@ffff962388ba3100 x1875064559659264/t30064771516(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:677/0 lens 488/448 e 0 to 0 dl 1788201567 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201556.191705:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3100 with x1875064559659264 ext(493879296->494927871) 00002000:00010000:3.0:1788201556.191713:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3100 00000100:00100000:2.0:1788201556.339500:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201556.339834:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559659392 00000100:00100000:0.0:1788201556.339846:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559659392 00002000:00100000:0.0:1788201556.339909:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (494927872->495976447) req@ffff962393a1a680 x1875064559659392/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:677/0 lens 488/0 e 0 to 0 dl 1788201567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201556.339952:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1a680 with x1875064559659392 ext(494927872->495976447) 00002000:00010000:0.0:1788201556.339960:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1a680 00000100:00100000:0.0:1788201556.340001:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 516 00000100:00100000:0.0:1788201556.340011:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559659392:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201556.367484:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559659392:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27455us (27983us total) trans 30064771517 rc 0/0 00000100:00100000:0.0:1788201556.367501:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 516 00002000:00100000:0.0:1788201556.367520:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (494927872->495976447) req@ffff962393a1a680 x1875064559659392/t30064771517(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:677/0 lens 488/448 e 0 to 0 dl 1788201567 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201556.367534:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1a680 with x1875064559659392 ext(494927872->495976447) 00002000:00010000:0.0:1788201556.367541:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1a680 00000100:00100000:3.0:1788201556.525609:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201556.527778:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559659520 00000100:00100000:1.0:1788201556.527798:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559659520 00002000:00100000:1.0:1788201556.528070:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (495976448->497025023) req@ffff962393a1d880 x1875064559659520/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:677/0 lens 488/0 e 0 to 0 dl 1788201567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201556.528085:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1d880 with x1875064559659520 ext(495976448->497025023) 00002000:00010000:1.0:1788201556.528094:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1d880 00000100:00100000:1.0:1788201556.528598:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 517 00000100:00100000:1.0:1788201556.528633:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559659520:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201556.552417:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559659520:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23768us (26805us total) trans 30064771518 rc 0/0 00000100:00100000:1.0:1788201556.552440:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 517 00002000:00100000:1.0:1788201556.552458:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (495976448->497025023) req@ffff962393a1d880 x1875064559659520/t30064771518(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:677/0 lens 488/448 e 0 to 0 dl 1788201567 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201556.552471:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1d880 with x1875064559659520 ext(495976448->497025023) 00002000:00010000:1.0:1788201556.552636:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1d880 00000100:00100000:0.0:1788201556.701893:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201556.702020:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559659648 00000100:00100000:1.0:1788201556.702032:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559659648 00002000:00100000:1.0:1788201556.702101:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (497025024->498073599) req@ffff962388ba0a80 x1875064559659648/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:677/0 lens 488/0 e 0 to 0 dl 1788201567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201556.702115:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0a80 with x1875064559659648 ext(497025024->498073599) 00002000:00010000:1.0:1788201556.702122:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0a80 00000100:00100000:1.0:1788201556.702159:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 518 00000100:00100000:1.0:1788201556.702171:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559659648:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201556.721798:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2344:x1875064559659648:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19612us (19915us total) trans 30064771519 rc 0/0 00000100:00100000:1.0:1788201556.721816:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 518 00002000:00100000:1.0:1788201556.721833:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (497025024->498073599) req@ffff962388ba0a80 x1875064559659648/t30064771519(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:677/0 lens 488/448 e 0 to 0 dl 1788201567 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201556.721846:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0a80 with x1875064559659648 ext(497025024->498073599) 00002000:00010000:1.0:1788201556.721855:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0a80 00010000:00010000:1.0:1788201556.794075:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201556.893111:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201556.893461:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559659776 00000100:00100000:3.0:1788201556.893473:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559659776 00002000:00100000:3.0:1788201556.893541:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (498073600->499122175) req@ffff962393a1a300 x1875064559659776/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:677/0 lens 488/0 e 0 to 0 dl 1788201567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201556.893554:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1a300 with x1875064559659776 ext(498073600->499122175) 00002000:00010000:3.0:1788201556.893560:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1a300 00000100:00100000:3.0:1788201556.893607:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 519 00000100:00100000:3.0:1788201556.893618:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559659776:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201556.935110:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2343:x1875064559659776:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 41477us (42000us total) trans 30064771520 rc 0/0 00000100:00100000:3.0:1788201556.942426:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 519 00002000:00100000:3.0:1788201556.942466:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (498073600->499122175) req@ffff962393a1a300 x1875064559659776/t30064771520(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:677/0 lens 488/448 e 0 to 0 dl 1788201567 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201556.942480:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1a300 with x1875064559659776 ext(498073600->499122175) 00002000:00010000:3.0:1788201556.942489:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1a300 00000100:00100000:1.0:1788201557.047146:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570144640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201557.047254:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201557.047401:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570144640 00000100:00100000:3.0:1788201557.047411:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570144640 00000100:00100000:3.0:1788201557.047489:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788201557.047502:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570144640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201557.047546:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 573767680 pending 46006272 free 3388997632 avail 3386900480 00000100:00080000:0.0:1788201557.047675:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201557.053098:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570144640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5586us (5829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201557.053117:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788201557.062089:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570144640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201557.154158:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201557.154305:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559659904 00000100:00100000:2.0:1788201557.154318:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559659904 00002000:00100000:2.0:1788201557.154445:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (499122176->500170751) req@ffff962388ba3b80 x1875064559659904/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:678/0 lens 488/0 e 0 to 0 dl 1788201568 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201557.154458:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3b80 with x1875064559659904 ext(499122176->500170751) 00002000:00010000:2.0:1788201557.154464:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3b80 00000100:00100000:2.0:1788201557.154504:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 520 00000100:00100000:2.0:1788201557.154516:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2342:x1875064559659904:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201557.156505:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201557.169173:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2342:x1875064559659904:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14642us (15023us total) trans 30064771521 rc 0/0 00000100:00100000:2.0:1788201557.169192:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 520 00002000:00100000:2.0:1788201557.169228:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (499122176->500170751) req@ffff962388ba3b80 x1875064559659904/t30064771521(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:678/0 lens 488/448 e 0 to 0 dl 1788201568 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201557.169240:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3b80 with x1875064559659904 ext(499122176->500170751) 00002000:00010000:2.0:1788201557.169248:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3b80 00000100:00100000:0.0:1788201557.303086:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201557.303150:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201557.303211:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559660160 00000100:00100000:1.0:1788201557.303226:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559660160 00002000:00100000:1.0:1788201557.303289:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (500170752->501190655) req@ffff962388ba2a00 x1875064559660160/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:678/0 lens 488/0 e 0 to 0 dl 1788201568 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201557.303302:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2a00 with x1875064559660160 ext(500170752->501190655) 00002000:00010000:1.0:1788201557.303309:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2a00 00000100:00100000:1.0:1788201557.303383:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559660032 00000100:00100000:1.0:1788201557.303387:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559660032 00000100:00100000:3.0:1788201557.303400:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 521 00002000:00100000:1.0:1788201557.303403:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (328511488->329252863) req@ffff962388ba1180 x1875064559660032/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:678/0 lens 488/0 e 0 to 0 dl 1788201568 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201557.303414:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba1180 with x1875064559660032 ext(328511488->329252863) 00002000:00010000:1.0:1788201557.303417:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba1180 00000100:00100000:3.0:1788201557.303423:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+63:2343:x1875064559660160:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201557.303433:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 522 00000100:00100000:1.0:1788201557.303442:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+63:2343:x1875064559660032:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201557.323544:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2343:x1875064559660032:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20086us (20377us total) trans 30064771522 rc 0/0 00000100:00100000:1.0:1788201557.323565:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 522 00002000:00100000:1.0:1788201557.323579:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (328511488->329252863) req@ffff962388ba1180 x1875064559660032/t30064771522(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:678/0 lens 488/448 e 0 to 0 dl 1788201568 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201557.323592:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba1180 with x1875064559660032 ext(328511488->329252863) 00002000:00010000:1.0:1788201557.323612:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba1180 00000100:00100000:3.0:1788201557.331953:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2343:x1875064559660160:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28518us (28866us total) trans 30064771523 rc 0/0 00000100:00100000:3.0:1788201557.331975:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 521 00002000:00100000:3.0:1788201557.331995:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (500170752->501190655) req@ffff962388ba2a00 x1875064559660160/t30064771523(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:678/0 lens 488/448 e 0 to 0 dl 1788201568 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201557.332009:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2a00 with x1875064559660160 ext(500170752->501190655) 00002000:00010000:3.0:1788201557.332018:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2a00 00000100:00100000:0.0:1788201557.474958:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201557.477017:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559660288 00000100:00100000:1.0:1788201557.477038:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559660288 00002000:00100000:1.0:1788201557.477129:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (501219328->502267903) req@ffff962388ba0700 x1875064559660288/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:678/0 lens 488/0 e 0 to 0 dl 1788201568 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201557.477144:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0700 with x1875064559660288 ext(501219328->502267903) 00002000:00010000:1.0:1788201557.477152:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0700 00000100:00100000:1.0:1788201557.477215:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 523 00000100:00100000:1.0:1788201557.477226:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2344:x1875064559660288:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201557.509404:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2344:x1875064559660288:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32164us (34447us total) trans 30064771524 rc 0/0 00000100:00100000:0.0:1788201557.509422:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 523 00002000:00100000:0.0:1788201557.509436:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (501219328->502267903) req@ffff962388ba0700 x1875064559660288/t30064771524(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:678/0 lens 488/448 e 0 to 0 dl 1788201568 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201557.509472:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0700 with x1875064559660288 ext(501219328->502267903) 00002000:00010000:0.0:1788201557.509480:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0700 00000100:00100000:3.0:1788201557.745616:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201557.745727:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559660416 00000100:00100000:0.0:1788201557.745739:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559660416 00002000:00100000:0.0:1788201557.745807:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (502267904->503316479) req@ffff96248cd07b80 x1875064559660416/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:678/0 lens 488/0 e 0 to 0 dl 1788201568 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201557.745831:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07b80 with x1875064559660416 ext(502267904->503316479) 00002000:00010000:0.0:1788201557.745839:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07b80 00000100:00100000:0.0:1788201557.745875:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 524 00000100:00100000:0.0:1788201557.745887:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2341:x1875064559660416:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201557.762596:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+70:2341:x1875064559660416:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16625us (16912us total) trans 30064771525 rc 0/0 00000100:00100000:0.0:1788201557.762618:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 524 00002000:00100000:0.0:1788201557.762635:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (502267904->503316479) req@ffff96248cd07b80 x1875064559660416/t30064771525(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:678/0 lens 488/448 e 0 to 0 dl 1788201568 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201557.762648:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07b80 with x1875064559660416 ext(502267904->503316479) 00002000:00010000:0.0:1788201557.762655:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07b80 00000001:00080000:0.0:1788201557.774570:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771524 is committed 00010000:00010000:1.0:1788201557.818919:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201557.863984:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201557.864177:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559660544 00000100:00100000:2.0:1788201557.864189:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559660544 00002000:00100000:2.0:1788201557.864256:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (503316480->504365055) req@ffff962388ba2300 x1875064559660544/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:678/0 lens 488/0 e 0 to 0 dl 1788201568 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201557.864270:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2300 with x1875064559660544 ext(503316480->504365055) 00002000:00010000:2.0:1788201557.864277:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2300 00000100:00100000:2.0:1788201557.864314:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 525 00000100:00100000:2.0:1788201557.864325:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559660544:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201557.881314:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559660544:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16970us (17326us total) trans 30064771526 rc 0/0 00000100:00100000:2.0:1788201557.881368:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 525 00002000:00100000:2.0:1788201557.881386:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (503316480->504365055) req@ffff962388ba2300 x1875064559660544/t30064771526(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:678/0 lens 488/448 e 0 to 0 dl 1788201568 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201557.881400:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2300 with x1875064559660544 ext(503316480->504365055) 00002000:00010000:2.0:1788201557.881408:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2300 00000100:00100000:1.0:1788201558.052609:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201558.052742:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559660672 00000100:00100000:3.0:1788201558.052754:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559660672 00002000:00100000:3.0:1788201558.052834:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (504365056->505413631) req@ffff9623939e0000 x1875064559660672/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:679/0 lens 488/0 e 0 to 0 dl 1788201569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201558.052848:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0000 with x1875064559660672 ext(504365056->505413631) 00002000:00010000:3.0:1788201558.052856:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0000 00000100:00100000:3.0:1788201558.052897:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 526 00000100:00100000:3.0:1788201558.052927:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559660672:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201558.073930:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559660672:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20989us (21322us total) trans 30064771527 rc 0/0 00000100:00100000:3.0:1788201558.073947:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 526 00002000:00100000:3.0:1788201558.073963:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (504365056->505413631) req@ffff9623939e0000 x1875064559660672/t30064771527(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:679/0 lens 488/448 e 0 to 0 dl 1788201569 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201558.073974:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0000 with x1875064559660672 ext(504365056->505413631) 00002000:00010000:3.0:1788201558.073981:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0000 00000100:00100000:1.0:1788201558.277485:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201558.277605:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559660800 00000100:00100000:0.0:1788201558.277616:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559660800 00002000:00100000:0.0:1788201558.277669:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (505413632->506462207) req@ffff9623939e0e00 x1875064559660800/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:679/0 lens 488/0 e 0 to 0 dl 1788201569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201558.277702:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0e00 with x1875064559660800 ext(505413632->506462207) 00002000:00010000:0.0:1788201558.277718:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0e00 00000100:00100000:0.0:1788201558.277766:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 527 00000100:00100000:0.0:1788201558.277778:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559660800:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201558.291518:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559660800:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13724us (14031us total) trans 30064771528 rc 0/0 00000100:00100000:2.0:1788201558.291537:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 527 00002000:00100000:2.0:1788201558.291554:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (505413632->506462207) req@ffff9623939e0e00 x1875064559660800/t30064771528(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:679/0 lens 488/448 e 0 to 0 dl 1788201569 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201558.291590:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0e00 with x1875064559660800 ext(505413632->506462207) 00002000:00010000:2.0:1788201558.291599:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0e00 00000100:00100000:1.0:1788201558.438886:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201558.438999:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559660928 00000100:00100000:0.0:1788201558.439012:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559660928 00002000:00100000:0.0:1788201558.439075:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (506462208->507510783) req@ffff9623939e2680 x1875064559660928/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:679/0 lens 488/0 e 0 to 0 dl 1788201569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201558.439087:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2680 with x1875064559660928 ext(506462208->507510783) 00002000:00010000:0.0:1788201558.439093:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2680 00000100:00100000:0.0:1788201558.439140:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 528 00000100:00100000:0.0:1788201558.439151:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2341:x1875064559660928:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201558.455979:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559660928:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16810us (17091us total) trans 30064771529 rc 0/0 00000100:00100000:2.0:1788201558.455999:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 528 00002000:00100000:2.0:1788201558.456018:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (506462208->507510783) req@ffff9623939e2680 x1875064559660928/t30064771529(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:679/0 lens 488/448 e 0 to 0 dl 1788201569 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201558.456031:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2680 with x1875064559660928 ext(506462208->507510783) 00002000:00010000:2.0:1788201558.456040:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2680 00000100:00100000:1.0:1788201558.657806:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201558.660065:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559661056 00000100:00100000:2.0:1788201558.660086:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559661056 00002000:00100000:2.0:1788201558.660222:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (507510784->508559359) req@ffff9623939e2a00 x1875064559661056/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:679/0 lens 488/0 e 0 to 0 dl 1788201569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201558.660236:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2a00 with x1875064559661056 ext(507510784->508559359) 00002000:00010000:2.0:1788201558.660243:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2a00 00000100:00100000:2.0:1788201558.660523:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 529 00000100:00100000:2.0:1788201558.660537:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559661056:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201558.675063:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559661056:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14512us (17257us total) trans 30064771530 rc 0/0 00000100:00100000:0.0:1788201558.675080:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 529 00002000:00100000:0.0:1788201558.675096:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (507510784->508559359) req@ffff9623939e2a00 x1875064559661056/t30064771530(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:679/0 lens 488/448 e 0 to 0 dl 1788201569 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201558.675108:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2a00 with x1875064559661056 ext(507510784->508559359) 00002000:00010000:0.0:1788201558.675117:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2a00 00000100:00100000:1.0:1788201558.828518:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201558.828827:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559661184 00000100:00100000:3.0:1788201558.828839:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559661184 00002000:00100000:3.0:1788201558.828916:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (508559360->509607935) req@ffff9623939e0a80 x1875064559661184/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:679/0 lens 488/0 e 0 to 0 dl 1788201569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201558.828929:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0a80 with x1875064559661184 ext(508559360->509607935) 00002000:00010000:3.0:1788201558.828936:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0a80 00000100:00100000:3.0:1788201558.828976:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 530 00000100:00100000:3.0:1788201558.828988:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559661184:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201558.839614:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201558.839669:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:0.0:1788201558.839833:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201558.840170:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559661312 00000100:00100000:3.0:1788201558.840183:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559661312 00000100:00100000:3.0:1788201558.840254:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 538 00000100:00100000:3.0:1788201558.840267:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559661312:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201558.841115:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559661312:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 842us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.841128:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 538 00000100:00100000:3.0:1788201558.841188:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559661440 00000100:00100000:3.0:1788201558.841201:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559661440 00000100:00100000:3.0:1788201558.841253:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 391 00000100:00100000:3.0:1788201558.842010:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559661440:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201558.842087:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559661440:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 825us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.842097:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 391 00000100:00080000:0.0:1788201558.846083:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201558.847626:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559661184:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18624us (19110us total) trans 30064771531 rc 0/0 00000100:00100000:3.0:1788201558.847645:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 530 00002000:00100000:3.0:1788201558.847663:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (508559360->509607935) req@ffff9623939e0a80 x1875064559661184/t30064771531(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:679/0 lens 488/448 e 0 to 0 dl 1788201569 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201558.847677:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0a80 with x1875064559661184 ext(508559360->509607935) 00002000:00010000:3.0:1788201558.847685:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0a80 00000100:00100000:0.0:1788201559.033050:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201559.033184:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559661568 00000100:00100000:2.0:1788201559.033196:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559661568 00002000:00100000:2.0:1788201559.033280:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (509607936->510656511) req@ffff962388ba1500 x1875064559661568/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/0 e 0 to 0 dl 1788201570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201559.033333:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba1500 with x1875064559661568 ext(509607936->510656511) 00002000:00010000:2.0:1788201559.033384:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba1500 00000100:00100000:2.0:1788201559.033421:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 531 00000100:00100000:2.0:1788201559.033434:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559661568:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201559.034169:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201559.058811:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559661568:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25362us (25759us total) trans 30064771532 rc 0/0 00000100:00100000:3.0:1788201559.058832:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 531 00002000:00100000:3.0:1788201559.058847:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (509607936->510656511) req@ffff962388ba1500 x1875064559661568/t30064771532(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/448 e 0 to 0 dl 1788201570 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201559.058858:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba1500 with x1875064559661568 ext(509607936->510656511) 00002000:00010000:3.0:1788201559.058865:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba1500 00000100:00100000:2.0:1788201559.175234:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201559.175428:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559661696 00000100:00100000:0.0:1788201559.175440:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559661696 00002000:00100000:0.0:1788201559.175506:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (510656512->511705087) req@ffff962393a19500 x1875064559661696/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/0 e 0 to 0 dl 1788201570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201559.175520:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a19500 with x1875064559661696 ext(510656512->511705087) 00002000:00010000:0.0:1788201559.175527:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a19500 00000100:00100000:0.0:1788201559.175565:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 532 00000100:00100000:0.0:1788201559.175577:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559661696:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201559.206033:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559661696:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30441us (30799us total) trans 30064771533 rc 0/0 00000100:00100000:1.0:1788201559.206053:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 532 00002000:00100000:1.0:1788201559.206068:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (510656512->511705087) req@ffff962393a19500 x1875064559661696/t30064771533(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/448 e 0 to 0 dl 1788201570 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201559.206080:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a19500 with x1875064559661696 ext(510656512->511705087) 00002000:00010000:1.0:1788201559.206088:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a19500 00000100:00100000:2.0:1788201559.342768:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201559.343053:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559661824 00000100:00100000:1.0:1788201559.343066:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559661824 00002000:00100000:1.0:1788201559.343156:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (511705088->512753663) req@ffff962393a1b480 x1875064559661824/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/0 e 0 to 0 dl 1788201570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201559.343187:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1b480 with x1875064559661824 ext(511705088->512753663) 00002000:00010000:1.0:1788201559.343195:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1b480 00000100:00100000:1.0:1788201559.343237:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 533 00000100:00100000:1.0:1788201559.343258:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559661824:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201559.375120:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559661824:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31849us (32352us total) trans 30064771534 rc 0/0 00000100:00100000:1.0:1788201559.375140:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 533 00002000:00100000:1.0:1788201559.375156:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (511705088->512753663) req@ffff962393a1b480 x1875064559661824/t30064771534(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/448 e 0 to 0 dl 1788201570 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201559.375168:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1b480 with x1875064559661824 ext(511705088->512753663) 00002000:00010000:1.0:1788201559.375176:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1b480 00000100:00100000:0.0:1788201559.486597:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201559.486850:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559661952 00000100:00100000:3.0:1788201559.486862:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559661952 00002000:00100000:3.0:1788201559.486927:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (512753664->513802239) req@ffff962388ba0380 x1875064559661952/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/0 e 0 to 0 dl 1788201570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201559.486966:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0380 with x1875064559661952 ext(512753664->513802239) 00002000:00010000:3.0:1788201559.486973:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0380 00000100:00100000:3.0:1788201559.487014:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 534 00000100:00100000:3.0:1788201559.487026:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559661952:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201559.519093:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559661952:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32041us (32486us total) trans 30064771535 rc 0/0 00000100:00100000:3.0:1788201559.519116:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 534 00002000:00100000:3.0:1788201559.519133:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (512753664->513802239) req@ffff962388ba0380 x1875064559661952/t30064771535(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/448 e 0 to 0 dl 1788201570 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201559.519145:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0380 with x1875064559661952 ext(512753664->513802239) 00002000:00010000:3.0:1788201559.519153:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0380 00000100:00100000:3.0:1788201559.606741:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962388ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570144768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201559.606854:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201559.607684:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570144768 00000100:00100000:1.0:1788201559.607695:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570144768 00000100:00100000:1.0:1788201559.607792:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788201559.607805:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570144768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201559.607855:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201559.607931:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570144768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.607940:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:0.0:1788201559.608056:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788201559.608133:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962388ba1f80 x1875064570144768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201559.608153:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962388ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570144768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201559.651510:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201559.651600:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559662080 00000100:00100000:3.0:1788201559.651761:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559662080 00002000:00100000:3.0:1788201559.651884:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (513802240->514850815) req@ffff962388ba3480 x1875064559662080/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/0 e 0 to 0 dl 1788201570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201559.651905:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3480 with x1875064559662080 ext(513802240->514850815) 00002000:00010000:3.0:1788201559.651912:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3480 00000100:00100000:3.0:1788201559.652034:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 535 00000100:00100000:3.0:1788201559.652047:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559662080:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201559.667515:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2341:x1875064559662080:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15453us (16005us total) trans 30064771536 rc 0/0 00000100:00100000:3.0:1788201559.667532:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 535 00002000:00100000:3.0:1788201559.667546:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (513802240->514850815) req@ffff962388ba3480 x1875064559662080/t30064771536(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/448 e 0 to 0 dl 1788201570 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201559.667558:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3480 with x1875064559662080 ext(513802240->514850815) 00002000:00010000:3.0:1788201559.667565:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3480 00000100:00100000:1.0:1788201559.783247:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201559.785894:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559662208 00000100:00100000:0.0:1788201559.785919:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559662208 00002000:00100000:0.0:1788201559.786023:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (514850816->515899391) req@ffff9623939e1180 x1875064559662208/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/0 e 0 to 0 dl 1788201570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201559.786037:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1180 with x1875064559662208 ext(514850816->515899391) 00002000:00010000:0.0:1788201559.786044:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1180 00000100:00100000:0.0:1788201559.786101:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 536 00000100:00100000:0.0:1788201559.786114:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559662208:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201559.818935:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559662208:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32807us (35695us total) trans 30064771537 rc 0/0 00000100:00100000:1.0:1788201559.818953:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 536 00002000:00100000:1.0:1788201559.818985:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (514850816->515899391) req@ffff9623939e1180 x1875064559662208/t30064771537(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/448 e 0 to 0 dl 1788201570 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201559.818997:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1180 with x1875064559662208 ext(514850816->515899391) 00002000:00010000:1.0:1788201559.819003:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1180 00010000:00010000:1.0:1788201559.863386:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201559.985721:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201559.985850:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559662336 00000100:00100000:3.0:1788201559.985863:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559662336 00002000:00100000:3.0:1788201559.985931:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (515899392->516947967) req@ffff962388ba3800 x1875064559662336/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/0 e 0 to 0 dl 1788201570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201559.985945:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3800 with x1875064559662336 ext(515899392->516947967) 00002000:00010000:3.0:1788201559.985952:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3800 00000100:00100000:3.0:1788201559.985996:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 537 00000100:00100000:3.0:1788201559.986007:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559662336:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201559.998028:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559662336:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12006us (12308us total) trans 30064771538 rc 0/0 00000100:00100000:3.0:1788201559.998046:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 537 00002000:00100000:3.0:1788201559.998062:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (515899392->516947967) req@ffff962388ba3800 x1875064559662336/t30064771538(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:680/0 lens 488/448 e 0 to 0 dl 1788201570 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201559.998074:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3800 with x1875064559662336 ext(515899392->516947967) 00002000:00010000:3.0:1788201559.998975:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3800 00000100:00100000:0.0:1788201560.118936:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570145024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201560.118957:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570145152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201560.119059:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570145280:0@lo:400:kworker.0 00000100:00100000:2.0:1788201560.119552:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570144896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201560.123725:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201560.124801:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570145152 00000100:00100000:1.0:1788201560.124816:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570145152 00000100:00100000:1.0:1788201560.124929:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788201560.124941:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570145152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201560.125045:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570145152:12345-0@lo:400:kworker.0 Request processed in 107us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201560.125054:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788201560.125245:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570145152:0@lo:400:kworker.0 00000100:00080000:1.0:1788201560.126202:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201560.132303:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201560.132388:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570145024 00000100:00100000:0.0:1788201560.132399:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570145024 00000100:00100000:0.0:1788201560.132465:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788201560.132499:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570145024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201560.132587:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570145024:12345-0@lo:400:kworker.0 Request processed in 90us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201560.132595:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788201560.132659:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570145024:0@lo:400:kworker.0 00000100:00100000:0.0:1788201560.132675:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570145536:0@lo:400:kworker.0 00000100:00100000:0.0:1788201560.132710:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201560.133120:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570145536 00000100:00100000:3.0:1788201560.133127:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570145536 00000100:00100000:3.0:1788201560.133189:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1788201560.133199:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570145536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201560.133248:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570145536:12345-0@lo:400:kworker.0 Request processed in 52us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201560.133254:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1788201560.133305:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201560.133327:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570145280 00000100:00100000:3.0:1788201560.133331:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570145280 00000100:00100000:3.0:1788201560.133374:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788201560.133380:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570145280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201560.133410:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570145280:12345-0@lo:400:kworker.0 Request processed in 30us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201560.133416:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788201560.133448:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570145280:0@lo:400:kworker.0 00000100:00080000:1.0:1788201560.133601:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201560.133653:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570145536:0@lo:400:kworker.0 00000100:00100000:2.0:1788201560.139216:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201560.139316:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570145408:0@lo:400:kworker.0 00000100:00100000:2.0:1788201560.139392:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201560.139437:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570145408 00000100:00100000:2.0:1788201560.139461:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570145408 00000100:00100000:2.0:1788201560.140423:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788201560.140437:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570145408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201560.140631:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570144896 00000100:00100000:3.0:1788201560.140639:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570144896 00000100:00100000:3.0:1788201560.140676:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1788201560.140684:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570144896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201560.140745:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570144896:12345-0@lo:400:kworker.0 Request processed in 62us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201560.140753:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1788201560.140853:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570144896:0@lo:400:kworker.0 00000100:00100000:2.0:1788201560.141197:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570145408:12345-0@lo:400:kworker.0 Request processed in 762us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201560.141205:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00010000:00080000:3.0:1788201560.143380:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9623939e1500 x1875064570145408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201560.143403:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570145408:0@lo:400:kworker.0 00000100:00100000:0.0:1788201560.216099:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201560.216273:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559662464 00000100:00100000:3.0:1788201560.216285:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559662464 00002000:00100000:3.0:1788201560.216392:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (516947968->517996543) req@ffff962388ba2680 x1875064559662464/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:681/0 lens 488/0 e 0 to 0 dl 1788201571 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201560.216405:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2680 with x1875064559662464 ext(516947968->517996543) 00002000:00010000:3.0:1788201560.216412:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2680 00000100:00100000:3.0:1788201560.216452:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 538 00000100:00100000:3.0:1788201560.216463:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559662464:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201560.248951:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559662464:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32477us (32855us total) trans 30064771539 rc 0/0 00000100:00100000:3.0:1788201560.248966:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 538 00002000:00100000:3.0:1788201560.248983:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (516947968->517996543) req@ffff962388ba2680 x1875064559662464/t30064771539(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:681/0 lens 488/448 e 0 to 0 dl 1788201571 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201560.248994:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2680 with x1875064559662464 ext(516947968->517996543) 00002000:00010000:3.0:1788201560.249000:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2680 00000100:00100000:0.0:1788201560.474798:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201560.474950:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559662592 00000100:00100000:2.0:1788201560.474963:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559662592 00002000:00100000:2.0:1788201560.475020:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (517996544->519045119) req@ffff962388ba1f80 x1875064559662592/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:681/0 lens 488/0 e 0 to 0 dl 1788201571 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201560.475032:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba1f80 with x1875064559662592 ext(517996544->519045119) 00002000:00010000:2.0:1788201560.475038:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba1f80 00000100:00100000:3.0:1788201560.475220:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 539 00000100:00100000:3.0:1788201560.475234:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559662592:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201560.498996:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559662592:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23753us (24194us total) trans 30064771540 rc 0/0 00000100:00100000:3.0:1788201560.499030:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 539 00002000:00100000:3.0:1788201560.499061:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (517996544->519045119) req@ffff962388ba1f80 x1875064559662592/t30064771540(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:681/0 lens 488/448 e 0 to 0 dl 1788201571 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201560.499072:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba1f80 with x1875064559662592 ext(517996544->519045119) 00002000:00010000:3.0:1788201560.499080:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba1f80 00000100:00100000:0.0:1788201560.733171:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201560.735592:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559662720 00000100:00100000:1.0:1788201560.735612:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559662720 00002000:00100000:1.0:1788201560.735695:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (519045120->520093695) req@ffff962388ba2d80 x1875064559662720/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:681/0 lens 488/0 e 0 to 0 dl 1788201571 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201560.735711:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2d80 with x1875064559662720 ext(519045120->520093695) 00002000:00010000:1.0:1788201560.735718:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2d80 00000100:00100000:1.0:1788201560.735766:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 540 00000100:00100000:1.0:1788201560.735778:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559662720:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201560.752895:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559662720:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17101us (19733us total) trans 30064771541 rc 0/0 00000100:00100000:2.0:1788201560.752932:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 540 00002000:00100000:2.0:1788201560.752948:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (519045120->520093695) req@ffff962388ba2d80 x1875064559662720/t30064771541(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:681/0 lens 488/448 e 0 to 0 dl 1788201571 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201560.752959:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2d80 with x1875064559662720 ext(519045120->520093695) 00002000:00010000:2.0:1788201560.752968:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2d80 00010000:00010000:1.0:1788201560.888052:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201560.982184:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201560.982395:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559662848 00000100:00100000:2.0:1788201560.982408:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559662848 00002000:00100000:2.0:1788201560.982476:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (520093696->521142271) req@ffff9624b9d63480 x1875064559662848/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:681/0 lens 488/0 e 0 to 0 dl 1788201571 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201560.982489:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d63480 with x1875064559662848 ext(520093696->521142271) 00002000:00010000:2.0:1788201560.982496:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d63480 00000100:00100000:2.0:1788201560.982534:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 541 00000100:00100000:2.0:1788201560.982546:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559662848:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201561.006839:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559662848:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24278us (24653us total) trans 30064771542 rc 0/0 00000100:00100000:2.0:1788201561.006858:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 541 00002000:00100000:2.0:1788201561.006873:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (520093696->521142271) req@ffff9624b9d63480 x1875064559662848/t30064771542(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:681/0 lens 488/448 e 0 to 0 dl 1788201571 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201561.006884:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d63480 with x1875064559662848 ext(520093696->521142271) 00002000:00010000:2.0:1788201561.006891:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d63480 00000100:00100000:2.0:1788201561.180537:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201561.180726:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559662976 00000100:00100000:3.0:1788201561.180738:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559662976 00002000:00100000:3.0:1788201561.180830:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (521142272->522190847) req@ffff9624904a0700 x1875064559662976/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:682/0 lens 488/0 e 0 to 0 dl 1788201572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201561.180843:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a0700 with x1875064559662976 ext(521142272->522190847) 00002000:00010000:3.0:1788201561.180849:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a0700 00000100:00100000:3.0:1788201561.180887:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 542 00000100:00100000:3.0:1788201561.180901:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559662976:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201561.181250:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201561.210869:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559662976:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29954us (30329us total) trans 30064771543 rc 0/0 00000100:00100000:3.0:1788201561.210890:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 542 00002000:00100000:3.0:1788201561.210908:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (521142272->522190847) req@ffff9624904a0700 x1875064559662976/t30064771543(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:682/0 lens 488/448 e 0 to 0 dl 1788201572 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201561.210921:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a0700 with x1875064559662976 ext(521142272->522190847) 00002000:00010000:3.0:1788201561.210930:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a0700 00000100:00100000:2.0:1788201561.409032:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201561.409137:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559663104 00000100:00100000:3.0:1788201561.409149:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559663104 00002000:00100000:3.0:1788201561.409217:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (522190848->523239423) req@ffff9624904a0000 x1875064559663104/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:682/0 lens 488/0 e 0 to 0 dl 1788201572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201561.409247:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a0000 with x1875064559663104 ext(522190848->523239423) 00002000:00010000:3.0:1788201561.409253:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a0000 00000100:00100000:3.0:1788201561.409295:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 543 00000100:00100000:3.0:1788201561.409305:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559663104:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201561.425047:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559663104:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15723us (16008us total) trans 30064771544 rc 0/0 00000100:00100000:3.0:1788201561.425065:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 543 00002000:00100000:3.0:1788201561.425081:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (522190848->523239423) req@ffff9624904a0000 x1875064559663104/t30064771544(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:682/0 lens 488/448 e 0 to 0 dl 1788201572 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201561.425094:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a0000 with x1875064559663104 ext(522190848->523239423) 00002000:00010000:3.0:1788201561.425102:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a0000 00000100:00100000:2.0:1788201561.601540:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201561.601786:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559663232 00000100:00100000:1.0:1788201561.601798:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559663232 00002000:00100000:1.0:1788201561.601859:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (523239424->524287999) req@ffff9624904a3800 x1875064559663232/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:682/0 lens 488/0 e 0 to 0 dl 1788201572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201561.601871:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a3800 with x1875064559663232 ext(523239424->524287999) 00002000:00010000:1.0:1788201561.601878:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a3800 00000100:00100000:1.0:1788201561.601919:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 544 00000100:00100000:1.0:1788201561.601929:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559663232:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201561.638843:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559663232:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33358us (33762us total) trans 30064771545 rc 0/0 00000100:00100000:3.0:1788201561.638875:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 544 00002000:00100000:3.0:1788201561.638897:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (523239424->524287999) req@ffff9624904a3800 x1875064559663232/t30064771545(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:682/0 lens 488/448 e 0 to 0 dl 1788201572 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201561.638909:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a3800 with x1875064559663232 ext(523239424->524287999) 00002000:00010000:3.0:1788201561.638917:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a3800 00000100:00100000:3.0:1788201561.788585:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201561.789426:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559663360 00000100:00100000:0.0:1788201561.789441:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559663360 00002000:00100000:0.0:1788201561.789512:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (524288000->525336575) req@ffff96248cd05f80 x1875064559663360/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:682/0 lens 488/0 e 0 to 0 dl 1788201572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201561.789526:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05f80 with x1875064559663360 ext(524288000->525336575) 00002000:00010000:0.0:1788201561.789532:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05f80 00000100:00100000:0.0:1788201561.789573:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 545 00000100:00100000:0.0:1788201561.789585:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559663360:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201561.808082:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559663360:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18481us (19494us total) trans 30064771546 rc 0/0 00000100:00100000:2.0:1788201561.808099:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 545 00002000:00100000:2.0:1788201561.808115:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (524288000->525336575) req@ffff96248cd05f80 x1875064559663360/t30064771546(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:682/0 lens 488/448 e 0 to 0 dl 1788201572 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201561.808126:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05f80 with x1875064559663360 ext(524288000->525336575) 00002000:00010000:2.0:1788201561.808132:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05f80 00010000:00010000:0.0:1788201561.912159:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201561.964339:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201561.967279:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559663488 00000100:00100000:0.0:1788201561.967303:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559663488 00002000:00100000:0.0:1788201561.967419:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (525336576->526385151) req@ffff96248cd07800 x1875064559663488/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:682/0 lens 488/0 e 0 to 0 dl 1788201572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201561.967460:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07800 with x1875064559663488 ext(525336576->526385151) 00002000:00010000:0.0:1788201561.967468:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07800 00000100:00100000:0.0:1788201561.967517:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 546 00000100:00100000:0.0:1788201561.967530:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559663488:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201562.000512:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2342:x1875064559663488:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32964us (36167us total) trans 30064771547 rc 0/0 00000100:00100000:2.0:1788201562.000531:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 546 00002000:00100000:2.0:1788201562.000546:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (525336576->526385151) req@ffff96248cd07800 x1875064559663488/t30064771547(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:682/0 lens 488/448 e 0 to 0 dl 1788201572 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201562.000558:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07800 with x1875064559663488 ext(525336576->526385151) 00002000:00010000:2.0:1788201562.000566:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07800 00000100:00100000:0.0:1788201562.167276:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201562.167306:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570145664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201562.167437:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201562.167644:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570145664 00000100:00100000:3.0:1788201562.167654:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570145664 00000100:00100000:3.0:1788201562.167767:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788201562.167779:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570145664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201562.167806:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 567738368 pending 39190528 free 3357540352 avail 3355443200 00000100:00100000:3.0:1788201562.167860:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570145664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201562.167867:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:0.0:1788201562.168036:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201562.168090:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570145664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201562.209405:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201562.209771:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559663616 00000100:00100000:3.0:1788201562.209785:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559663616 00002000:00100000:3.0:1788201562.209852:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (526385152->527433727) req@ffff96248c843100 x1875064559663616/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:683/0 lens 488/0 e 0 to 0 dl 1788201573 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201562.209865:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c843100 with x1875064559663616 ext(526385152->527433727) 00002000:00010000:3.0:1788201562.209871:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c843100 00000100:00100000:3.0:1788201562.209915:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 547 00000100:00100000:3.0:1788201562.209927:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559663616:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201562.248630:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559663616:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 38691us (39227us total) trans 30064771548 rc 0/0 00000100:00100000:2.0:1788201562.248648:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 547 00002000:00100000:2.0:1788201562.248663:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (526385152->527433727) req@ffff96248c843100 x1875064559663616/t30064771548(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:683/0 lens 488/448 e 0 to 0 dl 1788201573 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201562.248675:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c843100 with x1875064559663616 ext(526385152->527433727) 00002000:00010000:2.0:1788201562.248682:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c843100 00000100:00100000:0.0:1788201562.415032:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201562.415206:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559663744 00000100:00100000:3.0:1788201562.415218:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559663744 00002000:00100000:3.0:1788201562.415301:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (527433728->528482303) req@ffff9624b9c63480 x1875064559663744/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:683/0 lens 488/0 e 0 to 0 dl 1788201573 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201562.415314:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c63480 with x1875064559663744 ext(527433728->528482303) 00002000:00010000:3.0:1788201562.415320:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c63480 00000100:00100000:3.0:1788201562.415378:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 548 00000100:00100000:3.0:1788201562.415389:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559663744:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201562.443941:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559663744:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28531us (28903us total) trans 30064771549 rc 0/0 00000100:00100000:1.0:1788201562.443964:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 548 00002000:00100000:1.0:1788201562.443985:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (527433728->528482303) req@ffff9624b9c63480 x1875064559663744/t30064771549(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:683/0 lens 488/448 e 0 to 0 dl 1788201573 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201562.443997:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c63480 with x1875064559663744 ext(527433728->528482303) 00002000:00010000:1.0:1788201562.444005:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c63480 00000100:00100000:3.0:1788201562.638673:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201562.638742:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559663872 00000100:00100000:2.0:1788201562.638754:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559663872 00002000:00100000:2.0:1788201562.638821:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (528482304->529530879) req@ffff96248cd06680 x1875064559663872/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:683/0 lens 488/0 e 0 to 0 dl 1788201573 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201562.638854:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd06680 with x1875064559663872 ext(528482304->529530879) 00002000:00010000:2.0:1788201562.638861:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd06680 00000100:00100000:2.0:1788201562.638906:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 549 00000100:00100000:2.0:1788201562.638917:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559663872:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201562.653875:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2344:x1875064559663872:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14942us (15200us total) trans 30064771550 rc 0/0 00000100:00100000:2.0:1788201562.653893:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 549 00002000:00100000:2.0:1788201562.653910:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (528482304->529530879) req@ffff96248cd06680 x1875064559663872/t30064771550(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:683/0 lens 488/448 e 0 to 0 dl 1788201573 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201562.653921:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd06680 with x1875064559663872 ext(528482304->529530879) 00002000:00010000:2.0:1788201562.653929:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd06680 00000001:00080000:0.0:1788201562.821950:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771530 is committed 00000001:00080000:0.0:1788201562.821975:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771549 is committed 00000001:00080000:0.0:1788201562.821994:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771550 is committed 00000100:00100000:0.0:1788201562.849840:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201562.850028:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559664000 00000100:00100000:2.0:1788201562.850041:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559664000 00002000:00100000:2.0:1788201562.850095:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (529530880->530579455) req@ffff9624b9c63800 x1875064559664000/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:683/0 lens 488/0 e 0 to 0 dl 1788201573 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201562.850107:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c63800 with x1875064559664000 ext(529530880->530579455) 00002000:00010000:2.0:1788201562.850113:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c63800 00000100:00100000:2.0:1788201562.850179:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 550 00000100:00100000:2.0:1788201562.850188:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559664000:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201562.879822:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559664000:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29611us (29970us total) trans 30064771551 rc 0/0 00000100:00100000:2.0:1788201562.879845:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 550 00002000:00100000:2.0:1788201562.879899:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (529530880->530579455) req@ffff9624b9c63800 x1875064559664000/t30064771551(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:683/0 lens 488/448 e 0 to 0 dl 1788201573 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201562.879912:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c63800 with x1875064559664000 ext(529530880->530579455) 00002000:00010000:2.0:1788201562.879920:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c63800 00010000:00010000:1.0:1788201562.936950:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201563.085545:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201563.085635:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559664128 00000100:00100000:1.0:1788201563.085646:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559664128 00002000:00100000:1.0:1788201563.085722:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (530579456->531628031) req@ffff9624b9c62d80 x1875064559664128/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/0 e 0 to 0 dl 1788201574 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201563.085734:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c62d80 with x1875064559664128 ext(530579456->531628031) 00002000:00010000:1.0:1788201563.085756:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c62d80 00000100:00100000:1.0:1788201563.085796:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 551 00000100:00100000:1.0:1788201563.085807:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559664128:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201563.086054:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201563.126957:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559664128:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 41137us (41405us total) trans 30064771552 rc 0/0 00000100:00100000:3.0:1788201563.126992:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 551 00002000:00100000:3.0:1788201563.127010:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (530579456->531628031) req@ffff9624b9c62d80 x1875064559664128/t30064771552(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/448 e 0 to 0 dl 1788201574 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201563.127218:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c62d80 with x1875064559664128 ext(530579456->531628031) 00002000:00010000:3.0:1788201563.127226:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c62d80 00000100:00100000:1.0:1788201563.256278:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201563.256369:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559664256 00000100:00100000:3.0:1788201563.256380:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559664256 00002000:00100000:3.0:1788201563.256435:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (531628032->532676607) req@ffff9624b9d60700 x1875064559664256/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/0 e 0 to 0 dl 1788201574 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201563.256447:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d60700 with x1875064559664256 ext(531628032->532676607) 00002000:00010000:3.0:1788201563.256452:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d60700 00000100:00100000:3.0:1788201563.256495:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 552 00000100:00100000:3.0:1788201563.256506:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559664256:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201563.282425:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559664256:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25907us (26145us total) trans 30064771553 rc 0/0 00000100:00100000:3.0:1788201563.282440:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 552 00002000:00100000:3.0:1788201563.282454:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (531628032->532676607) req@ffff9624b9d60700 x1875064559664256/t30064771553(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/448 e 0 to 0 dl 1788201574 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201563.282465:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d60700 with x1875064559664256 ext(531628032->532676607) 00002000:00010000:3.0:1788201563.282472:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d60700 00000100:00100000:2.0:1788201563.426048:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201563.426192:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559664384 00000100:00100000:0.0:1788201563.426205:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559664384 00002000:00100000:0.0:1788201563.426267:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (532676608->533725183) req@ffff962381a19180 x1875064559664384/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/0 e 0 to 0 dl 1788201574 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201563.426279:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a19180 with x1875064559664384 ext(532676608->533725183) 00002000:00010000:0.0:1788201563.426285:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a19180 00000100:00100000:0.0:1788201563.426329:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 553 00000100:00100000:0.0:1788201563.426485:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559664384:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201563.459411:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559664384:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32911us (33354us total) trans 30064771554 rc 0/0 00000100:00100000:3.0:1788201563.459452:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 553 00002000:00100000:3.0:1788201563.459470:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (532676608->533725183) req@ffff962381a19180 x1875064559664384/t30064771554(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/448 e 0 to 0 dl 1788201574 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201563.459481:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a19180 with x1875064559664384 ext(532676608->533725183) 00002000:00010000:3.0:1788201563.459489:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a19180 00000100:00100000:1.0:1788201563.560983:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201563.564959:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559664512 00000100:00100000:2.0:1788201563.564978:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559664512 00002000:00100000:3.0:1788201563.572996:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (533725184->534773759) req@ffff9623939e1500 x1875064559664512/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/0 e 0 to 0 dl 1788201574 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201563.573015:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1500 with x1875064559664512 ext(533725184->534773759) 00002000:00010000:3.0:1788201563.573024:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1500 00000100:00100000:3.0:1788201563.573090:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 554 00000100:00100000:3.0:1788201563.573102:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559664512:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201563.594483:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559664512:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21372us (33505us total) trans 30064771555 rc 0/0 00000100:00100000:3.0:1788201563.594499:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 554 00002000:00100000:3.0:1788201563.594514:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (533725184->534773759) req@ffff9623939e1500 x1875064559664512/t30064771555(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/448 e 0 to 0 dl 1788201574 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201563.594525:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1500 with x1875064559664512 ext(533725184->534773759) 00002000:00010000:3.0:1788201563.594532:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1500 00000100:00100000:1.0:1788201563.664965:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201563.665175:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559664640 00000100:00100000:3.0:1788201563.665187:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559664640 00002000:00100000:3.0:1788201563.665275:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (534773760->535822335) req@ffff9623939e3b80 x1875064559664640/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/0 e 0 to 0 dl 1788201574 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201563.665309:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3b80 with x1875064559664640 ext(534773760->535822335) 00002000:00010000:3.0:1788201563.665316:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3b80 00000100:00100000:3.0:1788201563.665389:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 555 00000100:00100000:3.0:1788201563.665400:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559664640:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201563.681054:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559664640:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15636us (16079us total) trans 30064771556 rc 0/0 00000100:00100000:3.0:1788201563.681075:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 555 00002000:00100000:3.0:1788201563.681095:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (534773760->535822335) req@ffff9623939e3b80 x1875064559664640/t30064771556(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/448 e 0 to 0 dl 1788201574 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201563.681108:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3b80 with x1875064559664640 ext(534773760->535822335) 00002000:00010000:3.0:1788201563.681115:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3b80 00000100:00100000:2.0:1788201563.806198:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201563.806390:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559664768 00000100:00100000:1.0:1788201563.806402:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559664768 00002000:00100000:1.0:1788201563.806469:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (535822336->536870911) req@ffff962381a19500 x1875064559664768/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/0 e 0 to 0 dl 1788201574 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201563.806484:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a19500 with x1875064559664768 ext(535822336->536870911) 00002000:00010000:1.0:1788201563.806492:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a19500 00000100:00100000:1.0:1788201563.806533:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 556 00000100:00100000:1.0:1788201563.806545:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559664768:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201563.820338:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559664768:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13777us (14138us total) trans 30064771557 rc 0/0 00000100:00100000:3.0:1788201563.820385:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 556 00002000:00100000:3.0:1788201563.820400:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (535822336->536870911) req@ffff962381a19500 x1875064559664768/t30064771557(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/448 e 0 to 0 dl 1788201574 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201563.820411:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a19500 with x1875064559664768 ext(535822336->536870911) 00002000:00010000:3.0:1788201563.820417:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a19500 00000100:00100000:2.0:1788201563.959906:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201563.959961:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201563.960006:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201563.960049:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559665024 00000100:00100000:2.0:1788201563.960059:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559665024 00000100:00100000:2.0:1788201563.960118:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 540 00000100:00100000:2.0:1788201563.960129:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559665024:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201563.960218:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559665024:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 90us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201563.960237:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 540 00000100:00100000:3.0:1788201563.960772:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559665152 00000100:00100000:3.0:1788201563.960779:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559665152 00000100:00100000:3.0:1788201563.960844:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 395 00000100:00100000:3.0:1788201563.960853:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559665152:12345-192.168.201.56@tcp:400:kworker.0 00010000:00010000:1.0:1788201563.960874:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201563.960934:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559665152:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 83us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201563.960941:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 395 00000100:00100000:0.0:1788201563.961332:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559664896 00000100:00100000:0.0:1788201563.961338:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559664896 00002000:00100000:0.0:1788201563.961409:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (536870912->537919487) req@ffff962381a18000 x1875064559664896/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/0 e 0 to 0 dl 1788201574 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201563.961421:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a18000 with x1875064559664896 ext(536870912->537919487) 00002000:00010000:0.0:1788201563.961427:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a18000 00000100:00100000:0.0:1788201563.961455:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 557 00000100:00100000:0.0:1788201563.961464:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559664896:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201563.962039:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201563.983745:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559664896:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22264us (23837us total) trans 30064771558 rc 0/0 00000100:00100000:0.0:1788201563.983764:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 557 00002000:00100000:0.0:1788201563.983790:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (536870912->537919487) req@ffff962381a18000 x1875064559664896/t30064771558(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:684/0 lens 488/448 e 0 to 0 dl 1788201574 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201563.983803:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a18000 with x1875064559664896 ext(536870912->537919487) 00002000:00010000:0.0:1788201563.983812:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a18000 00000100:00100000:1.0:1788201564.156480:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201564.158039:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559665280 00000100:00100000:3.0:1788201564.158055:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559665280 00002000:00100000:3.0:1788201564.158125:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (537919488->538968063) req@ffff9623939e0380 x1875064559665280/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:685/0 lens 488/0 e 0 to 0 dl 1788201575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201564.158139:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0380 with x1875064559665280 ext(537919488->538968063) 00002000:00010000:3.0:1788201564.158145:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0380 00000100:00100000:3.0:1788201564.158188:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 558 00000100:00100000:3.0:1788201564.158199:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559665280:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201564.209670:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559665280:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 51456us (53190us total) trans 30064771559 rc 0/0 00000100:00100000:3.0:1788201564.209687:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 558 00002000:00100000:3.0:1788201564.209758:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (537919488->538968063) req@ffff9623939e0380 x1875064559665280/t30064771559(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:685/0 lens 488/448 e 0 to 0 dl 1788201575 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201564.209840:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0380 with x1875064559665280 ext(537919488->538968063) 00002000:00010000:3.0:1788201564.209849:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0380 00000100:00100000:1.0:1788201564.424734:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201564.424902:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559665408 00000100:00100000:3.0:1788201564.424914:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559665408 00002000:00100000:3.0:1788201564.424981:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (538968064->540016639) req@ffff9623939e1f80 x1875064559665408/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:685/0 lens 488/0 e 0 to 0 dl 1788201575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201564.424996:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1f80 with x1875064559665408 ext(538968064->540016639) 00002000:00010000:3.0:1788201564.425014:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1f80 00000100:00100000:3.0:1788201564.425081:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 559 00000100:00100000:3.0:1788201564.425092:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559665408:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201564.457253:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559665408:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32139us (32512us total) trans 30064771560 rc 0/0 00000100:00100000:3.0:1788201564.457274:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 559 00002000:00100000:3.0:1788201564.457294:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (538968064->540016639) req@ffff9623939e1f80 x1875064559665408/t30064771560(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:685/0 lens 488/448 e 0 to 0 dl 1788201575 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201564.457306:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1f80 with x1875064559665408 ext(538968064->540016639) 00002000:00010000:3.0:1788201564.457314:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1f80 00000100:00100000:0.0:1788201564.617816:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201564.617994:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559665536 00000100:00100000:1.0:1788201564.618006:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559665536 00002000:00100000:1.0:1788201564.618082:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (540016640->541065215) req@ffff9624b9c61c00 x1875064559665536/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:685/0 lens 488/0 e 0 to 0 dl 1788201575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201564.618095:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c61c00 with x1875064559665536 ext(540016640->541065215) 00002000:00010000:1.0:1788201564.618102:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c61c00 00000100:00100000:1.0:1788201564.618138:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 560 00000100:00100000:1.0:1788201564.618150:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559665536:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201564.633505:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559665536:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15342us (15690us total) trans 30064771561 rc 0/0 00000100:00100000:2.0:1788201564.633525:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 560 00002000:00100000:2.0:1788201564.633540:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (540016640->541065215) req@ffff9624b9c61c00 x1875064559665536/t30064771561(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:685/0 lens 488/448 e 0 to 0 dl 1788201575 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201564.633553:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c61c00 with x1875064559665536 ext(540016640->541065215) 00002000:00010000:2.0:1788201564.633560:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c61c00 00000100:00100000:2.0:1788201564.728179:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201564.728223:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570145792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201564.728337:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201564.728690:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570145792 00000100:00100000:0.0:1788201564.728700:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570145792 00000100:00100000:0.0:1788201564.728786:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788201564.728799:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570145792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201564.728845:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201564.728904:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570145792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201564.728933:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00010000:00080000:0.0:1788201564.728980:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9c63100 x1875064570145792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201564.728999:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570145792:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201564.729969:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201564.858623:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201564.858925:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559665664 00000100:00100000:0.0:1788201564.858938:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559665664 00002000:00100000:0.0:1788201564.859002:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (541065216->542113791) req@ffff9623939e3480 x1875064559665664/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:685/0 lens 488/0 e 0 to 0 dl 1788201575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201564.859015:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3480 with x1875064559665664 ext(541065216->542113791) 00002000:00010000:0.0:1788201564.859022:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3480 00000100:00100000:0.0:1788201564.859134:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 561 00000100:00100000:0.0:1788201564.859149:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559665664:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201564.884844:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559665664:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25678us (26217us total) trans 30064771562 rc 0/0 00000100:00100000:0.0:1788201564.884865:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 561 00002000:00100000:0.0:1788201564.884885:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (541065216->542113791) req@ffff9623939e3480 x1875064559665664/t30064771562(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:685/0 lens 488/448 e 0 to 0 dl 1788201575 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201564.884897:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3480 with x1875064559665664 ext(541065216->542113791) 00002000:00010000:0.0:1788201564.884905:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3480 00010000:00010000:0.0:1788201564.983906:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201565.057947:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201565.058046:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559665792 00000100:00100000:3.0:1788201565.058058:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559665792 00002000:00100000:3.0:1788201565.058150:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (542113792->543162367) req@ffff9623939e2300 x1875064559665792/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:686/0 lens 488/0 e 0 to 0 dl 1788201576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:2.0:1788201565.058158:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1788201565.058164:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2300 with x1875064559665792 ext(542113792->543162367) 00002000:00010000:3.0:1788201565.058171:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2300 00000100:00100000:3.0:1788201565.058217:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 562 00000100:00100000:3.0:1788201565.058228:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559665792:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201565.079961:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559665792:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21719us (22014us total) trans 30064771563 rc 0/0 00000100:00100000:3.0:1788201565.079980:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 562 00002000:00100000:3.0:1788201565.079997:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (542113792->543162367) req@ffff9623939e2300 x1875064559665792/t30064771563(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:686/0 lens 488/448 e 0 to 0 dl 1788201576 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201565.080008:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2300 with x1875064559665792 ext(542113792->543162367) 00002000:00010000:3.0:1788201565.080035:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2300 00000100:00100000:3.0:1788201565.235922:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201565.239310:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559665920 00000100:00100000:0.0:1788201565.239332:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559665920 00002000:00100000:0.0:1788201565.239424:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (543162368->544210943) req@ffff96248cd05c00 x1875064559665920/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:686/0 lens 488/0 e 0 to 0 dl 1788201576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201565.239462:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05c00 with x1875064559665920 ext(543162368->544210943) 00002000:00010000:0.0:1788201565.239470:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05c00 00000100:00100000:0.0:1788201565.239512:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 563 00000100:00100000:0.0:1788201565.239523:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559665920:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201565.242113:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570146176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201565.242134:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570146048:0@lo:400:kworker.0 00000100:00100000:0.0:1788201565.242220:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570145920:0@lo:400:kworker.0 00000100:00100000:2.0:1788201565.246611:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201565.246722:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570146560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201565.246761:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201565.248447:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570146048 00000100:00100000:2.0:1788201565.248461:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570146048 00000100:00100000:2.0:1788201565.248526:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570146560 00000100:00100000:2.0:1788201565.248530:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570146560 00000100:00100000:2.0:1788201565.249907:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788201565.249922:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570146048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201565.250032:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570146048:12345-0@lo:400:kworker.0 Request processed in 113us (3431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201565.250040:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788201565.250183:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788201565.250193:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570146560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201565.250308:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570146560:12345-0@lo:400:kworker.0 Request processed in 117us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201565.250315:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00080000:2.0:1788201565.250358:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201565.250403:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570146048:0@lo:400:kworker.0 00000100:00100000:2.0:1788201565.250419:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570146560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201565.250517:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570146304:0@lo:400:kworker.0 00000100:00100000:2.0:1788201565.250559:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201565.250605:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570146304 00000100:00100000:2.0:1788201565.250611:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570146304 00000100:00100000:2.0:1788201565.250644:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1788201565.250650:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570146304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201565.250685:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570146304:12345-0@lo:400:kworker.0 Request processed in 35us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201565.250691:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00080000:2.0:1788201565.250704:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201565.250721:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570146304:0@lo:400:kworker.0 00000100:00100000:0.0:1788201565.252507:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201565.252573:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962490589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570146432:0@lo:400:kworker.0 00000100:00100000:0.0:1788201565.252611:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201565.252668:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570146432 00000100:00100000:0.0:1788201565.252676:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570146432 00000100:00100000:0.0:1788201565.252728:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788201565.252738:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570146432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201565.252790:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570146432:12345-0@lo:400:kworker.0 Request processed in 54us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201565.252797:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00010000:00080000:0.0:1788201565.252837:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962490589880 x1875064570146432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201565.252851:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962490589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570146432:0@lo:400:kworker.0 00000100:00100000:2.0:1788201565.256304:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570145920 00000100:00100000:2.0:1788201565.256325:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570145920 00000100:00100000:2.0:1788201565.256441:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1788201565.256452:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570145920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201565.256911:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570145920:12345-0@lo:400:kworker.0 Request processed in 459us (4411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201565.256921:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1788201565.257861:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570145920:0@lo:400:kworker.0 00000100:00100000:1.0:1788201565.258846:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201565.258893:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570146176 00000100:00100000:1.0:1788201565.258900:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570146176 00000100:00100000:1.0:1788201565.258963:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788201565.258972:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1d5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570146176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201565.259041:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1d5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570146176:12345-0@lo:400:kworker.0 Request processed in 70us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201565.259048:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:1.0:1788201565.259310:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201565.259361:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570146176:0@lo:400:kworker.0 00000100:00100000:0.0:1788201565.279004:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559665920:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39452us (43066us total) trans 30064771564 rc 0/0 00000100:00100000:0.0:1788201565.279023:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 563 00002000:00100000:0.0:1788201565.280992:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (543162368->544210943) req@ffff96248cd05c00 x1875064559665920/t30064771564(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:686/0 lens 488/448 e 0 to 0 dl 1788201576 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201565.281011:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05c00 with x1875064559665920 ext(543162368->544210943) 00002000:00010000:0.0:1788201565.281020:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05c00 00000100:00100000:1.0:1788201565.454427:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201565.454635:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559666048 00000100:00100000:2.0:1788201565.454646:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559666048 00002000:00100000:2.0:1788201565.454718:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (544210944->545259519) req@ffff9623939e1880 x1875064559666048/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:686/0 lens 488/0 e 0 to 0 dl 1788201576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201565.454730:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1880 with x1875064559666048 ext(544210944->545259519) 00002000:00010000:2.0:1788201565.454737:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1880 00000100:00100000:2.0:1788201565.454783:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 564 00000100:00100000:2.0:1788201565.454810:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559666048:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201565.495501:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559666048:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 40670us (41064us total) trans 30064771565 rc 0/0 00000100:00100000:2.0:1788201565.495522:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 564 00002000:00100000:2.0:1788201565.495541:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (544210944->545259519) req@ffff9623939e1880 x1875064559666048/t30064771565(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:686/0 lens 488/448 e 0 to 0 dl 1788201576 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201565.495554:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1880 with x1875064559666048 ext(544210944->545259519) 00002000:00010000:2.0:1788201565.495563:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1880 00000100:00100000:3.0:1788201565.633484:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201565.633620:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559666176 00000100:00100000:0.0:1788201565.633634:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559666176 00002000:00100000:0.0:1788201565.633699:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (545259520->546308095) req@ffff96248cd07100 x1875064559666176/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:686/0 lens 488/0 e 0 to 0 dl 1788201576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201565.633712:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07100 with x1875064559666176 ext(545259520->546308095) 00002000:00010000:0.0:1788201565.633719:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07100 00000100:00100000:0.0:1788201565.633780:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 565 00000100:00100000:0.0:1788201565.633792:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559666176:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201565.660170:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559666176:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26361us (26681us total) trans 30064771566 rc 0/0 00000100:00100000:0.0:1788201565.660189:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 565 00002000:00100000:0.0:1788201565.660216:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (545259520->546308095) req@ffff96248cd07100 x1875064559666176/t30064771566(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:686/0 lens 488/448 e 0 to 0 dl 1788201576 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201565.660229:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07100 with x1875064559666176 ext(545259520->546308095) 00002000:00010000:0.0:1788201565.660236:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07100 00000100:00100000:3.0:1788201565.849042:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201565.849264:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559666304 00000100:00100000:0.0:1788201565.849279:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559666304 00002000:00100000:0.0:1788201565.849381:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (546308096->547356671) req@ffff96248cd04e00 x1875064559666304/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:686/0 lens 488/0 e 0 to 0 dl 1788201576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201565.849394:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd04e00 with x1875064559666304 ext(546308096->547356671) 00002000:00010000:0.0:1788201565.849418:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd04e00 00000100:00100000:0.0:1788201565.849459:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 566 00000100:00100000:0.0:1788201565.849470:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559666304:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201565.863313:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559666304:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13824us (14269us total) trans 30064771567 rc 0/0 00000100:00100000:0.0:1788201565.863331:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 566 00002000:00100000:0.0:1788201565.863381:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (546308096->547356671) req@ffff96248cd04e00 x1875064559666304/t30064771567(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:686/0 lens 488/448 e 0 to 0 dl 1788201576 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201565.863393:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd04e00 with x1875064559666304 ext(546308096->547356671) 00002000:00010000:0.0:1788201565.863400:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd04e00 00010000:00010000:1.0:1788201566.006655:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201566.047108:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201566.052135:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559666432 00000100:00100000:2.0:1788201566.052160:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559666432 00002000:00100000:2.0:1788201566.052283:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (547356672->548405247) req@ffff9624ba19aa00 x1875064559666432/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:687/0 lens 488/0 e 0 to 0 dl 1788201577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201566.052299:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba19aa00 with x1875064559666432 ext(547356672->548405247) 00002000:00010000:2.0:1788201566.052308:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba19aa00 00000100:00100000:2.0:1788201566.052400:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 567 00000100:00100000:2.0:1788201566.052413:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559666432:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201566.070465:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559666432:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18036us (23353us total) trans 30064771568 rc 0/0 00000100:00100000:2.0:1788201566.070483:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 567 00002000:00100000:2.0:1788201566.070499:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (547356672->548405247) req@ffff9624ba19aa00 x1875064559666432/t30064771568(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:687/0 lens 488/448 e 0 to 0 dl 1788201577 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201566.070511:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba19aa00 with x1875064559666432 ext(547356672->548405247) 00002000:00010000:2.0:1788201566.070519:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba19aa00 00000100:00100000:3.0:1788201566.261746:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201566.261927:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559666560 00000100:00100000:2.0:1788201566.261940:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559666560 00002000:00100000:2.0:1788201566.262018:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (548405248->549453823) req@ffff96248cd05880 x1875064559666560/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:687/0 lens 488/0 e 0 to 0 dl 1788201577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201566.262032:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05880 with x1875064559666560 ext(548405248->549453823) 00002000:00010000:2.0:1788201566.262039:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05880 00000100:00100000:2.0:1788201566.262082:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 568 00000100:00100000:2.0:1788201566.262093:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2342:x1875064559666560:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201566.282127:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2342:x1875064559666560:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19996us (20357us total) trans 30064771569 rc 0/0 00000100:00100000:2.0:1788201566.282146:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 568 00002000:00100000:2.0:1788201566.282162:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (548405248->549453823) req@ffff96248cd05880 x1875064559666560/t30064771569(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:687/0 lens 488/448 e 0 to 0 dl 1788201577 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201566.282175:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05880 with x1875064559666560 ext(548405248->549453823) 00002000:00010000:2.0:1788201566.282195:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05880 00000100:00100000:3.0:1788201566.536091:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201566.536433:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559666688 00000100:00100000:0.0:1788201566.536446:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559666688 00002000:00100000:0.0:1788201566.536513:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (549453824->550502399) req@ffff96248cd04000 x1875064559666688/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:687/0 lens 488/0 e 0 to 0 dl 1788201577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201566.536525:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd04000 with x1875064559666688 ext(549453824->550502399) 00002000:00010000:0.0:1788201566.536532:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd04000 00000100:00100000:0.0:1788201566.536570:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 569 00000100:00100000:0.0:1788201566.536581:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2341:x1875064559666688:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201566.547712:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2341:x1875064559666688:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11115us (11620us total) trans 30064771570 rc 0/0 00000100:00100000:0.0:1788201566.547730:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 569 00002000:00100000:0.0:1788201566.547747:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (549453824->550502399) req@ffff96248cd04000 x1875064559666688/t30064771570(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:687/0 lens 488/448 e 0 to 0 dl 1788201577 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201566.547784:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd04000 with x1875064559666688 ext(549453824->550502399) 00002000:00010000:0.0:1788201566.547791:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd04000 00000100:00100000:3.0:1788201566.661098:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201566.661391:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559666816 00000100:00100000:0.0:1788201566.661404:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559666816 00002000:00100000:0.0:1788201566.661469:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (550502400->551550975) req@ffff96248cd07480 x1875064559666816/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:687/0 lens 488/0 e 0 to 0 dl 1788201577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201566.661483:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07480 with x1875064559666816 ext(550502400->551550975) 00002000:00010000:0.0:1788201566.661490:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07480 00000100:00100000:0.0:1788201566.661532:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 570 00000100:00100000:0.0:1788201566.661544:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559666816:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201566.697040:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559666816:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35481us (35942us total) trans 30064771571 rc 0/0 00000100:00100000:0.0:1788201566.697058:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 570 00002000:00100000:0.0:1788201566.697074:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (550502400->551550975) req@ffff96248cd07480 x1875064559666816/t30064771571(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:687/0 lens 488/448 e 0 to 0 dl 1788201577 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201566.697087:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd07480 with x1875064559666816 ext(550502400->551550975) 00002000:00010000:0.0:1788201566.697094:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd07480 00000100:00100000:1.0:1788201566.834594:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201566.834723:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559666944 00000100:00100000:2.0:1788201566.834735:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559666944 00002000:00100000:2.0:1788201566.834812:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (551550976->552599551) req@ffff96248573a300 x1875064559666944/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:687/0 lens 488/0 e 0 to 0 dl 1788201577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201566.834825:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248573a300 with x1875064559666944 ext(551550976->552599551) 00002000:00010000:2.0:1788201566.834833:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248573a300 00000100:00100000:2.0:1788201566.834872:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 571 00000100:00100000:2.0:1788201566.834883:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248573a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559666944:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201566.844793:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248573a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559666944:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9894us (10199us total) trans 30064771572 rc 0/0 00000100:00100000:0.0:1788201566.844812:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 571 00002000:00100000:0.0:1788201566.844828:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (551550976->552599551) req@ffff96248573a300 x1875064559666944/t30064771572(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:687/0 lens 488/448 e 0 to 0 dl 1788201577 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201566.844864:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248573a300 with x1875064559666944 ext(551550976->552599551) 00002000:00010000:0.0:1788201566.844872:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248573a300 00010000:00010000:1.0:1788201567.031113:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201567.036558:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201567.036701:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559667072 00000100:00100000:1.0:1788201567.036714:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559667072 00002000:00100000:1.0:1788201567.036802:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (552599552->553648127) req@ffff962492c24700 x1875064559667072/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:688/0 lens 488/0 e 0 to 0 dl 1788201578 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201567.036814:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c24700 with x1875064559667072 ext(552599552->553648127) 00002000:00010000:1.0:1788201567.036821:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c24700 00000100:00100000:1.0:1788201567.036859:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 572 00000100:00100000:1.0:1788201567.036870:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559667072:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201567.037596:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201567.058781:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559667072:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20144us (20468us total) trans 30064771573 rc 0/0 00000100:00100000:1.0:1788201567.058808:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 572 00002000:00100000:1.0:1788201567.058829:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (552599552->553648127) req@ffff962492c24700 x1875064559667072/t30064771573(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:688/0 lens 488/448 e 0 to 0 dl 1788201578 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201567.058842:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c24700 with x1875064559667072 ext(552599552->553648127) 00002000:00010000:1.0:1788201567.058850:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c24700 00000100:00100000:2.0:1788201567.208792:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201567.214084:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559667200 00000100:00100000:0.0:1788201567.214110:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559667200 00002000:00100000:0.0:1788201567.214207:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (553648128->554696703) req@ffff962492c27100 x1875064559667200/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:688/0 lens 488/0 e 0 to 0 dl 1788201578 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201567.214221:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c27100 with x1875064559667200 ext(553648128->554696703) 00002000:00010000:0.0:1788201567.214229:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c27100 00000100:00100000:0.0:1788201567.214283:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 573 00000100:00100000:0.0:1788201567.214294:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559667200:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201567.240377:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559667200:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26046us (31565us total) trans 30064771574 rc 0/0 00000100:00100000:0.0:1788201567.240397:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 573 00002000:00100000:0.0:1788201567.240411:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (553648128->554696703) req@ffff962492c27100 x1875064559667200/t30064771574(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:688/0 lens 488/448 e 0 to 0 dl 1788201578 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201567.240423:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c27100 with x1875064559667200 ext(553648128->554696703) 00002000:00010000:0.0:1788201567.240431:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c27100 00000100:00100000:3.0:1788201567.288150:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962492c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570146688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201567.288260:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201567.288395:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570146688 00000100:00100000:3.0:1788201567.288404:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570146688 00000100:00100000:3.0:1788201567.288471:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788201567.288482:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570146688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201567.288511:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 569049088 pending 40894464 free 3330277376 avail 3328180224 00000100:00100000:3.0:1788201567.288560:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570146688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201567.288568:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:3.0:1788201567.288594:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201567.288633:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962492c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570146688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201567.386152:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201567.386542:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559667328 00000100:00100000:0.0:1788201567.386554:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559667328 00002000:00100000:0.0:1788201567.386618:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (554696704->555745279) req@ffff962492c25f80 x1875064559667328/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:688/0 lens 488/0 e 0 to 0 dl 1788201578 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201567.386629:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c25f80 with x1875064559667328 ext(554696704->555745279) 00002000:00010000:0.0:1788201567.386635:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c25f80 00000100:00100000:0.0:1788201567.386698:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 574 00000100:00100000:0.0:1788201567.386710:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2342:x1875064559667328:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201567.404999:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559667328:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18273us (18845us total) trans 30064771575 rc 0/0 00000100:00100000:0.0:1788201567.405016:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 574 00002000:00100000:0.0:1788201567.406150:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (554696704->555745279) req@ffff962492c25f80 x1875064559667328/t30064771575(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:688/0 lens 488/448 e 0 to 0 dl 1788201578 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201567.406175:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c25f80 with x1875064559667328 ext(554696704->555745279) 00002000:00010000:0.0:1788201567.406183:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c25f80 00000100:00100000:3.0:1788201567.538489:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201567.541716:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559667456 00000100:00100000:2.0:1788201567.541739:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559667456 00002000:00100000:2.0:1788201567.541823:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (555745280->556793855) req@ffff96248cd05500 x1875064559667456/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:688/0 lens 488/0 e 0 to 0 dl 1788201578 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201567.541838:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05500 with x1875064559667456 ext(555745280->556793855) 00002000:00010000:2.0:1788201567.541845:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05500 00000100:00100000:2.0:1788201567.541900:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 575 00000100:00100000:2.0:1788201567.541911:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2341:x1875064559667456:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201567.550837:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2341:x1875064559667456:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8910us (12346us total) trans 30064771576 rc 0/0 00000100:00100000:0.0:1788201567.550857:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 575 00002000:00100000:0.0:1788201567.550873:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (555745280->556793855) req@ffff96248cd05500 x1875064559667456/t30064771576(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:688/0 lens 488/448 e 0 to 0 dl 1788201578 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201567.550887:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd05500 with x1875064559667456 ext(555745280->556793855) 00002000:00010000:0.0:1788201567.550895:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd05500 00000100:00100000:1.0:1788201567.773759:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201567.773906:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559667584 00000100:00100000:2.0:1788201567.773919:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559667584 00002000:00100000:2.0:1788201567.773995:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (556793856->557842431) req@ffff962393a1b100 x1875064559667584/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:688/0 lens 488/0 e 0 to 0 dl 1788201578 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201567.774007:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1b100 with x1875064559667584 ext(556793856->557842431) 00002000:00010000:2.0:1788201567.774131:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1b100 00000100:00100000:2.0:1788201567.774183:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 576 00000100:00100000:2.0:1788201567.774195:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2342:x1875064559667584:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201567.795885:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2342:x1875064559667584:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21673us (22125us total) trans 30064771577 rc 0/0 00000100:00100000:1.0:1788201567.795905:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 576 00002000:00100000:1.0:1788201567.795921:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (556793856->557842431) req@ffff962393a1b100 x1875064559667584/t30064771577(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:688/0 lens 488/448 e 0 to 0 dl 1788201578 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201567.795934:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1b100 with x1875064559667584 ext(556793856->557842431) 00002000:00010000:1.0:1788201567.795942:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1b100 00000100:00100000:2.0:1788201567.972123:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201567.972223:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559667712 00000100:00100000:0.0:1788201567.972233:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559667712 00002000:00100000:0.0:1788201567.972297:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (557842432->558891007) req@ffff962492c26680 x1875064559667712/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:688/0 lens 488/0 e 0 to 0 dl 1788201578 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201567.972310:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c26680 with x1875064559667712 ext(557842432->558891007) 00002000:00010000:0.0:1788201567.972316:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c26680 00000100:00100000:0.0:1788201567.972376:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 577 00000100:00100000:0.0:1788201567.972387:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2341:x1875064559667712:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201567.981625:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2341:x1875064559667712:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9218us (9495us total) trans 30064771578 rc 0/0 00000100:00100000:2.0:1788201567.981644:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 577 00002000:00100000:2.0:1788201567.981661:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (557842432->558891007) req@ffff962492c26680 x1875064559667712/t30064771578(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:688/0 lens 488/448 e 0 to 0 dl 1788201578 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201567.981699:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c26680 with x1875064559667712 ext(557842432->558891007) 00002000:00010000:2.0:1788201567.981708:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c26680 00010000:00010000:1.0:1788201568.054489:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788201568.055735:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771576 is committed 00000001:00080000:2.0:1788201568.055814:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771577 is committed 00000100:00100000:2.0:1788201568.099876:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201568.102730:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559667840 00000100:00100000:0.0:1788201568.102747:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559667840 00002000:00100000:0.0:1788201568.102818:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (558891008->559939583) req@ffff962492c27b80 x1875064559667840/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:689/0 lens 488/0 e 0 to 0 dl 1788201579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201568.102832:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c27b80 with x1875064559667840 ext(558891008->559939583) 00002000:00010000:0.0:1788201568.102838:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c27b80 00000100:00100000:0.0:1788201568.102876:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 578 00000100:00100000:0.0:1788201568.102885:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559667840:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201568.126221:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559667840:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23318us (26343us total) trans 30064771579 rc 0/0 00000100:00100000:3.0:1788201568.126241:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 578 00002000:00100000:3.0:1788201568.126472:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (558891008->559939583) req@ffff962492c27b80 x1875064559667840/t30064771579(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:689/0 lens 488/448 e 0 to 0 dl 1788201579 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201568.126485:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c27b80 with x1875064559667840 ext(558891008->559939583) 00002000:00010000:3.0:1788201568.126512:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c27b80 00000100:00100000:2.0:1788201568.211443:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201568.211590:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559667968 00000100:00100000:0.0:1788201568.211605:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559667968 00002000:00100000:0.0:1788201568.211679:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (559939584->560988159) req@ffff962490589880 x1875064559667968/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:689/0 lens 488/0 e 0 to 0 dl 1788201579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201568.211693:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962490589880 with x1875064559667968 ext(559939584->560988159) 00002000:00010000:0.0:1788201568.211700:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962490589880 00000100:00100000:0.0:1788201568.211857:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 579 00000100:00100000:0.0:1788201568.211869:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559667968:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201568.235409:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559667968:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23524us (24279us total) trans 30064771580 rc 0/0 00000100:00100000:0.0:1788201568.235429:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 579 00002000:00100000:0.0:1788201568.235447:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (559939584->560988159) req@ffff962490589880 x1875064559667968/t30064771580(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:689/0 lens 488/448 e 0 to 0 dl 1788201579 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201568.235460:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962490589880 with x1875064559667968 ext(559939584->560988159) 00002000:00010000:0.0:1788201568.235468:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962490589880 00000100:00100000:1.0:1788201568.339883:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201568.351905:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559668096 00000100:00100000:2.0:1788201568.351927:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559668096 00002000:00100000:2.0:1788201568.352083:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (560988160->562036735) req@ffff962393a1dc00 x1875064559668096/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:689/0 lens 488/0 e 0 to 0 dl 1788201579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201568.352097:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1dc00 with x1875064559668096 ext(560988160->562036735) 00002000:00010000:2.0:1788201568.352104:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1dc00 00000100:00100000:2.0:1788201568.352376:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 580 00000100:00100000:2.0:1788201568.352389:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559668096:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201568.387164:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559668096:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34751us (47270us total) trans 30064771581 rc 0/0 00000100:00100000:2.0:1788201568.387183:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 580 00002000:00100000:2.0:1788201568.387199:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (560988160->562036735) req@ffff962393a1dc00 x1875064559668096/t30064771581(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:689/0 lens 488/448 e 0 to 0 dl 1788201579 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201568.387212:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1dc00 with x1875064559668096 ext(560988160->562036735) 00002000:00010000:2.0:1788201568.387219:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1dc00 00000100:00100000:0.0:1788201568.597582:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201568.597876:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559668224 00000100:00100000:2.0:1788201568.597888:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559668224 00002000:00100000:2.0:1788201568.597985:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (562036736->563085311) req@ffff9624b9c60a80 x1875064559668224/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:689/0 lens 488/0 e 0 to 0 dl 1788201579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201568.597998:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c60a80 with x1875064559668224 ext(562036736->563085311) 00002000:00010000:2.0:1788201568.598005:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c60a80 00000100:00100000:2.0:1788201568.598046:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 581 00000100:00100000:2.0:1788201568.598057:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559668224:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201568.610026:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559668224:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11954us (12444us total) trans 30064771582 rc 0/0 00000100:00100000:2.0:1788201568.610043:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 581 00002000:00100000:2.0:1788201568.610059:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (562036736->563085311) req@ffff9624b9c60a80 x1875064559668224/t30064771582(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:689/0 lens 488/448 e 0 to 0 dl 1788201579 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201568.610074:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c60a80 with x1875064559668224 ext(562036736->563085311) 00002000:00010000:2.0:1788201568.610083:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c60a80 00000100:00100000:3.0:1788201568.790550:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201568.791086:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559668352 00000100:00100000:0.0:1788201568.791099:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559668352 00002000:00100000:0.0:1788201568.791179:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (563085312->564133887) req@ffff96248cd06d80 x1875064559668352/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:689/0 lens 488/0 e 0 to 0 dl 1788201579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201568.791193:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd06d80 with x1875064559668352 ext(563085312->564133887) 00002000:00010000:0.0:1788201568.791200:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd06d80 00000100:00100000:0.0:1788201568.791300:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 582 00000100:00100000:0.0:1788201568.791312:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559668352:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201568.813634:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559668352:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22296us (23072us total) trans 30064771583 rc 0/0 00000100:00100000:0.0:1788201568.813655:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 582 00002000:00100000:0.0:1788201568.813674:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (563085312->564133887) req@ffff96248cd06d80 x1875064559668352/t30064771583(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:689/0 lens 488/448 e 0 to 0 dl 1788201579 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201568.813685:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd06d80 with x1875064559668352 ext(563085312->564133887) 00002000:00010000:0.0:1788201568.813693:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd06d80 00000100:00100000:3.0:1788201568.967077:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201568.967215:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559668480 00000100:00100000:0.0:1788201568.967228:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559668480 00002000:00100000:0.0:1788201568.967298:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (564133888->565182463) req@ffff9624ba471180 x1875064559668480/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:689/0 lens 488/0 e 0 to 0 dl 1788201579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201568.967311:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba471180 with x1875064559668480 ext(564133888->565182463) 00002000:00010000:0.0:1788201568.967318:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba471180 00000100:00100000:0.0:1788201568.967394:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 583 00000100:00100000:0.0:1788201568.967406:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559668480:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201568.986532:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559668480:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19110us (19453us total) trans 30064771584 rc 0/0 00000100:00100000:0.0:1788201568.986551:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 583 00002000:00100000:0.0:1788201568.986568:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (564133888->565182463) req@ffff9624ba471180 x1875064559668480/t30064771584(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:689/0 lens 488/448 e 0 to 0 dl 1788201579 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201568.986580:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba471180 with x1875064559668480 ext(564133888->565182463) 00002000:00010000:0.0:1788201568.986589:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba471180 00000100:00100000:3.0:1788201569.075123:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201569.075328:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559668736 00000100:00100000:2.0:1788201569.075398:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559668736 00000100:00100000:2.0:1788201569.075498:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 399 00000100:00100000:2.0:1788201569.075510:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559668736:12345-192.168.201.56@tcp:400:kworker.0 00000100:00080000:0.0:1788201569.075650:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201569.080113:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559668736:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 4586us (4985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201569.080145:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 399 00000100:00100000:0.0:1788201569.082169:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:1.0:1788201569.082319:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201569.082394:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559668608 00000100:00100000:2.0:1788201569.082406:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559668608 00000100:00100000:2.0:1788201569.082476:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 542 00000100:00100000:2.0:1788201569.082487:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559668608:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201569.082784:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559668608:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 296us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201569.082792:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 542 00000100:00100000:0.0:1788201569.133496:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201569.136629:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559668864 00000100:00100000:2.0:1788201569.136650:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559668864 00002000:00100000:2.0:1788201569.136765:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (565182464->566231039) req@ffff9624b9c62a00 x1875064559668864/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:690/0 lens 488/0 e 0 to 0 dl 1788201580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201569.136778:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c62a00 with x1875064559668864 ext(565182464->566231039) 00002000:00010000:2.0:1788201569.136787:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c62a00 00000100:00100000:2.0:1788201569.136842:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 584 00000100:00100000:2.0:1788201569.136866:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559668864:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201569.137653:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201569.171207:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559668864:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34325us (37706us total) trans 30064771585 rc 0/0 00000100:00100000:2.0:1788201569.171229:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 584 00002000:00100000:2.0:1788201569.171248:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (565182464->566231039) req@ffff9624b9c62a00 x1875064559668864/t30064771585(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:690/0 lens 488/448 e 0 to 0 dl 1788201580 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201569.171260:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c62a00 with x1875064559668864 ext(565182464->566231039) 00002000:00010000:2.0:1788201569.171268:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c62a00 00000100:00100000:3.0:1788201569.302105:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201569.302533:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559668992 00000100:00100000:2.0:1788201569.302546:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559668992 00002000:00100000:2.0:1788201569.302614:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (566231040->567279615) req@ffff9624ba470380 x1875064559668992/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:690/0 lens 488/0 e 0 to 0 dl 1788201580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201569.302693:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba470380 with x1875064559668992 ext(566231040->567279615) 00002000:00010000:2.0:1788201569.302700:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba470380 00000100:00100000:2.0:1788201569.302824:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 585 00000100:00100000:2.0:1788201569.302835:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559668992:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201569.316882:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559668992:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14027us (14771us total) trans 30064771586 rc 0/0 00000100:00100000:2.0:1788201569.316903:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 585 00002000:00100000:2.0:1788201569.316931:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (566231040->567279615) req@ffff9624ba470380 x1875064559668992/t30064771586(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:690/0 lens 488/448 e 0 to 0 dl 1788201580 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201569.316944:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba470380 with x1875064559668992 ext(566231040->567279615) 00002000:00010000:2.0:1788201569.316952:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba470380 00000100:00100000:1.0:1788201569.504723:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201569.504899:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559669120 00000100:00100000:3.0:1788201569.504911:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559669120 00002000:00100000:3.0:1788201569.504981:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (567279616->568328191) req@ffff962393a1fb80 x1875064559669120/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:690/0 lens 488/0 e 0 to 0 dl 1788201580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201569.504994:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1fb80 with x1875064559669120 ext(567279616->568328191) 00002000:00010000:3.0:1788201569.505000:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1fb80 00000100:00100000:3.0:1788201569.505045:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 586 00000100:00100000:3.0:1788201569.505056:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559669120:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201569.527572:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559669120:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22498us (22845us total) trans 30064771587 rc 0/0 00000100:00100000:1.0:1788201569.527592:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 586 00002000:00100000:1.0:1788201569.527608:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (567279616->568328191) req@ffff962393a1fb80 x1875064559669120/t30064771587(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:690/0 lens 488/448 e 0 to 0 dl 1788201580 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201569.527650:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393a1fb80 with x1875064559669120 ext(567279616->568328191) 00002000:00010000:1.0:1788201569.527659:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393a1fb80 00000100:00100000:2.0:1788201569.686814:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201569.687064:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559669248 00000100:00100000:0.0:1788201569.687076:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559669248 00002000:00100000:0.0:1788201569.687153:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (568328192->569376767) req@ffff962490588380 x1875064559669248/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:690/0 lens 488/0 e 0 to 0 dl 1788201580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201569.687167:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962490588380 with x1875064559669248 ext(568328192->569376767) 00002000:00010000:0.0:1788201569.687174:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962490588380 00000100:00100000:0.0:1788201569.687222:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 587 00000100:00100000:0.0:1788201569.687234:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962490588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559669248:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201569.714861:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962490588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559669248:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27610us (28045us total) trans 30064771588 rc 0/0 00000100:00100000:0.0:1788201569.714880:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 587 00002000:00100000:0.0:1788201569.714895:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (568328192->569376767) req@ffff962490588380 x1875064559669248/t30064771588(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:690/0 lens 488/448 e 0 to 0 dl 1788201580 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201569.714942:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962490588380 with x1875064559669248 ext(568328192->569376767) 00002000:00010000:0.0:1788201569.714951:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962490588380 00000100:00100000:2.0:1788201569.846753:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570146816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201569.846855:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201569.847190:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570146816 00000100:00100000:3.0:1788201569.847200:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570146816 00000100:00100000:3.0:1788201569.847276:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788201569.847288:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570146816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201569.847335:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201569.847441:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570146816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201569.847449:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:0.0:1788201569.847536:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201569.847620:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9c60000 x1875064570146816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201585 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201569.847643:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570146816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201569.860583:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201569.860767:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559669376 00000100:00100000:2.0:1788201569.860779:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559669376 00002000:00100000:2.0:1788201569.860860:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (569376768->570425343) req@ffff9624b9c60000 x1875064559669376/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:690/0 lens 488/0 e 0 to 0 dl 1788201580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201569.860873:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c60000 with x1875064559669376 ext(569376768->570425343) 00002000:00010000:2.0:1788201569.860879:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c60000 00000100:00100000:2.0:1788201569.860927:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 588 00000100:00100000:2.0:1788201569.860938:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559669376:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201569.884064:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559669376:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23112us (23481us total) trans 30064771589 rc 0/0 00000100:00100000:2.0:1788201569.884080:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 588 00002000:00100000:2.0:1788201569.884113:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (569376768->570425343) req@ffff9624b9c60000 x1875064559669376/t30064771589(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:690/0 lens 488/448 e 0 to 0 dl 1788201580 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201569.884157:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c60000 with x1875064559669376 ext(569376768->570425343) 00002000:00010000:2.0:1788201569.884165:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c60000 00000100:00100000:3.0:1788201570.029902:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201570.030079:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559669504 00000100:00100000:2.0:1788201570.030090:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559669504 00002000:00100000:2.0:1788201570.030171:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (570425344->571473919) req@ffff9624ba470700 x1875064559669504/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:691/0 lens 488/0 e 0 to 0 dl 1788201581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201570.030186:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba470700 with x1875064559669504 ext(570425344->571473919) 00002000:00010000:2.0:1788201570.030193:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba470700 00000100:00100000:2.0:1788201570.030239:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 589 00000100:00100000:2.0:1788201570.030251:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559669504:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201570.042604:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559669504:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12338us (12701us total) trans 30064771590 rc 0/0 00000100:00100000:2.0:1788201570.042623:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 589 00002000:00100000:2.0:1788201570.042639:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (570425344->571473919) req@ffff9624ba470700 x1875064559669504/t30064771590(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:691/0 lens 488/448 e 0 to 0 dl 1788201581 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201570.042651:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba470700 with x1875064559669504 ext(570425344->571473919) 00002000:00010000:2.0:1788201570.042658:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba470700 00010000:00010000:1.0:1788201570.105163:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201570.214640:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201570.214836:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559669632 00000100:00100000:1.0:1788201570.214849:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559669632 00002000:00100000:1.0:1788201570.214926:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (571473920->572522495) req@ffff9624ba471c00 x1875064559669632/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:691/0 lens 488/0 e 0 to 0 dl 1788201581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201570.214938:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba471c00 with x1875064559669632 ext(571473920->572522495) 00002000:00010000:1.0:1788201570.214945:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba471c00 00000100:00100000:1.0:1788201570.214984:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 590 00000100:00100000:1.0:1788201570.214995:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559669632:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201570.238377:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559669632:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23333us (23705us total) trans 30064771591 rc 0/0 00000100:00100000:0.0:1788201570.238395:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 590 00002000:00100000:0.0:1788201570.238411:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (571473920->572522495) req@ffff9624ba471c00 x1875064559669632/t30064771591(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:691/0 lens 488/448 e 0 to 0 dl 1788201581 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201570.238424:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba471c00 with x1875064559669632 ext(571473920->572522495) 00002000:00010000:0.0:1788201570.238432:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba471c00 00000100:00100000:3.0:1788201570.358096:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201570.358273:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559669760 00000100:00100000:1.0:1788201570.358286:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559669760 00002000:00100000:1.0:1788201570.358405:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (572522496->573571071) req@ffff9624b9d23480 x1875064559669760/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:691/0 lens 488/0 e 0 to 0 dl 1788201581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201570.358418:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d23480 with x1875064559669760 ext(572522496->573571071) 00002000:00010000:1.0:1788201570.358425:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d23480 00000100:00100000:1.0:1788201570.358463:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 591 00000100:00100000:1.0:1788201570.358475:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559669760:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201570.360289:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570146944:0@lo:400:kworker.0 00000100:00100000:1.0:1788201570.360391:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201570.360442:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570147456:0@lo:400:kworker.0 00000100:00100000:1.0:1788201570.360476:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201570.360504:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201570.360510:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570147328:0@lo:400:kworker.0 00000100:00100000:1.0:1788201570.360541:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201570.360651:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570147200:0@lo:400:kworker.0 00000100:00100000:3.0:1788201570.360687:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201570.360892:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570146944 00000100:00100000:2.0:1788201570.360908:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570146944 00000100:00100000:2.0:1788201570.360961:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:2.0:1788201570.360970:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570146944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201570.361035:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570146944:12345-0@lo:400:kworker.0 Request processed in 66us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201570.361051:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:2.0:1788201570.361090:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570147328 00000100:00100000:2.0:1788201570.361094:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570147328 00000100:00100000:2.0:1788201570.361144:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1788201570.361152:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570147328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201570.361189:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570147328:12345-0@lo:400:kworker.0 Request processed in 38us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201570.361195:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1788201570.361243:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570147328:0@lo:400:kworker.0 00000100:00100000:2.0:1788201570.361254:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570146944:0@lo:400:kworker.0 00000100:00100000:3.0:1788201570.361554:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201570.361564:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570147072:0@lo:400:kworker.0 00000100:00100000:3.0:1788201570.361595:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201570.361618:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570147584:0@lo:400:kworker.0 00000100:00100000:2.0:1788201570.364254:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570147072 00000100:00100000:2.0:1788201570.364274:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570147072 00000100:00100000:2.0:1788201570.364377:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788201570.364388:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570147072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201570.364481:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570147072:12345-0@lo:400:kworker.0 Request processed in 95us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201570.364489:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00080000:2.0:1788201570.364701:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201570.365197:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201570.365274:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570147072:0@lo:400:kworker.0 00000100:00100000:3.0:1788201570.365309:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570147584 00000100:00100000:3.0:1788201570.365314:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570147584 00000100:00100000:3.0:1788201570.365378:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1788201570.365387:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570147584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201570.365437:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570147584:12345-0@lo:400:kworker.0 Request processed in 51us (3793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201570.365445:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00080000:3.0:1788201570.365467:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201570.365487:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570147584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201570.371260:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559669760:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12770us (13163us total) trans 30064771592 rc 0/0 00000100:00100000:3.0:1788201570.371277:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 591 00002000:00100000:3.0:1788201570.371293:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (572522496->573571071) req@ffff9624b9d23480 x1875064559669760/t30064771592(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:691/0 lens 488/448 e 0 to 0 dl 1788201581 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201570.371304:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d23480 with x1875064559669760 ext(572522496->573571071) 00002000:00010000:3.0:1788201570.371312:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d23480 00000100:00100000:1.0:1788201570.371487:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570147456 00000100:00100000:1.0:1788201570.371497:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570147456 00000100:00100000:1.0:1788201570.371683:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570147200 00000100:00100000:1.0:1788201570.371688:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570147200 00000100:00100000:1.0:1788201570.371737:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788201570.371750:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570147456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201570.371843:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570147456:12345-0@lo:400:kworker.0 Request processed in 95us (11365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201570.371850:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788201570.371863:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788201570.371870:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570147200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201570.371917:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570147200:12345-0@lo:400:kworker.0 Request processed in 48us (11230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201570.371924:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00010000:00080000:1.0:1788201570.371971:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e59500 x1875064570147456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201570.371987:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570147456:0@lo:400:kworker.0 00000100:00080000:3.0:1788201570.373779:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201570.373839:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570147200:0@lo:400:kworker.0 00000100:00100000:2.0:1788201570.460879:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201570.461085:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559669888 00000100:00100000:0.0:1788201570.461101:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559669888 00002000:00100000:0.0:1788201570.461232:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (573571072->574619647) req@ffff962381a18380 x1875064559669888/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:691/0 lens 488/0 e 0 to 0 dl 1788201581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201570.461247:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a18380 with x1875064559669888 ext(573571072->574619647) 00002000:00010000:0.0:1788201570.461254:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a18380 00000100:00100000:0.0:1788201570.461295:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 592 00000100:00100000:0.0:1788201570.461309:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559669888:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201570.493395:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559669888:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32068us (32513us total) trans 30064771593 rc 0/0 00000100:00100000:1.0:1788201570.493441:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 592 00002000:00100000:1.0:1788201570.493462:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (573571072->574619647) req@ffff962381a18380 x1875064559669888/t30064771593(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:691/0 lens 488/448 e 0 to 0 dl 1788201581 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201570.493475:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a18380 with x1875064559669888 ext(573571072->574619647) 00002000:00010000:1.0:1788201570.493483:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a18380 00000100:00100000:2.0:1788201570.601778:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201570.604397:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559670016 00000100:00100000:0.0:1788201570.604419:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559670016 00002000:00100000:0.0:1788201570.604502:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (574619648->575668223) req@ffff962381a19c00 x1875064559670016/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:691/0 lens 488/0 e 0 to 0 dl 1788201581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201570.604544:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a19c00 with x1875064559670016 ext(574619648->575668223) 00002000:00010000:0.0:1788201570.604551:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a19c00 00000100:00100000:3.0:1788201570.605158:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 593 00000100:00100000:3.0:1788201570.605182:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559670016:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201570.647805:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559670016:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 42610us (46024us total) trans 30064771594 rc 0/0 00000100:00100000:2.0:1788201570.647823:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 593 00002000:00100000:2.0:1788201570.647841:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (574619648->575668223) req@ffff962381a19c00 x1875064559670016/t30064771594(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:691/0 lens 488/448 e 0 to 0 dl 1788201581 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201570.647878:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a19c00 with x1875064559670016 ext(574619648->575668223) 00002000:00010000:2.0:1788201570.647886:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a19c00 00000100:00100000:1.0:1788201570.918244:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201570.918784:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559670144 00000100:00100000:0.0:1788201570.918796:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559670144 00002000:00100000:0.0:1788201570.918863:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (575668224->576716799) req@ffff9624c1e59500 x1875064559670144/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:691/0 lens 488/0 e 0 to 0 dl 1788201581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201570.918877:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e59500 with x1875064559670144 ext(575668224->576716799) 00002000:00010000:0.0:1788201570.918884:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e59500 00000100:00100000:0.0:1788201570.918923:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 594 00000100:00100000:0.0:1788201570.918934:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559670144:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201570.970491:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559670144:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 51541us (52245us total) trans 30064771595 rc 0/0 00000100:00100000:2.0:1788201570.970520:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 594 00002000:00100000:2.0:1788201570.970538:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (575668224->576716799) req@ffff9624c1e59500 x1875064559670144/t30064771595(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:691/0 lens 488/448 e 0 to 0 dl 1788201581 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201570.970560:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e59500 with x1875064559670144 ext(575668224->576716799) 00002000:00010000:2.0:1788201570.970567:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e59500 00010000:00010000:1.0:1788201571.128301:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201571.269849:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201571.269993:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559670272 00000100:00100000:0.0:1788201571.270006:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559670272 00002000:00100000:0.0:1788201571.270089:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (576716800->577765375) req@ffff9624c1e59f80 x1875064559670272/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:692/0 lens 488/0 e 0 to 0 dl 1788201582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201571.270129:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e59f80 with x1875064559670272 ext(576716800->577765375) 00002000:00010000:0.0:1788201571.270136:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e59f80 00000100:00100000:0.0:1788201571.270177:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 595 00000100:00100000:0.0:1788201571.270190:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559670272:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201571.270469:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201571.316168:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559670272:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 45965us (46318us total) trans 30064771596 rc 0/0 00000100:00100000:0.0:1788201571.316187:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 595 00002000:00100000:0.0:1788201571.316203:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (576716800->577765375) req@ffff9624c1e59f80 x1875064559670272/t30064771596(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:692/0 lens 488/448 e 0 to 0 dl 1788201582 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201571.316239:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e59f80 with x1875064559670272 ext(576716800->577765375) 00002000:00010000:0.0:1788201571.316247:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e59f80 00000100:00100000:0.0:1788201571.508961:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201571.509133:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559670400 00000100:00100000:1.0:1788201571.509145:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559670400 00002000:00100000:1.0:1788201571.509210:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (577765376->578813951) req@ffff9624b9c61500 x1875064559670400/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:692/0 lens 488/0 e 0 to 0 dl 1788201582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201571.509226:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c61500 with x1875064559670400 ext(577765376->578813951) 00002000:00010000:1.0:1788201571.509233:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c61500 00000100:00100000:1.0:1788201571.509276:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 596 00000100:00100000:1.0:1788201571.509288:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559670400:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201571.535112:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559670400:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25797us (26138us total) trans 30064771597 rc 0/0 00000100:00100000:1.0:1788201571.535133:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 596 00002000:00100000:1.0:1788201571.535150:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (577765376->578813951) req@ffff9624b9c61500 x1875064559670400/t30064771597(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:692/0 lens 488/448 e 0 to 0 dl 1788201582 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201571.535163:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c61500 with x1875064559670400 ext(577765376->578813951) 00002000:00010000:1.0:1788201571.535170:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c61500 00000100:00100000:0.0:1788201571.657159:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201571.657289:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559670528 00000100:00100000:2.0:1788201571.657301:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559670528 00002000:00100000:2.0:1788201571.657417:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (578813952->579862527) req@ffff9624b9c63100 x1875064559670528/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:692/0 lens 488/0 e 0 to 0 dl 1788201582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201571.657431:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c63100 with x1875064559670528 ext(578813952->579862527) 00002000:00010000:2.0:1788201571.657438:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c63100 00000100:00100000:2.0:1788201571.657470:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 597 00000100:00100000:2.0:1788201571.657482:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559670528:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201571.675940:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559670528:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18443us (18781us total) trans 30064771598 rc 0/0 00000100:00100000:3.0:1788201571.675956:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 597 00002000:00100000:3.0:1788201571.675971:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (578813952->579862527) req@ffff9624b9c63100 x1875064559670528/t30064771598(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:692/0 lens 488/448 e 0 to 0 dl 1788201582 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201571.675983:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c63100 with x1875064559670528 ext(578813952->579862527) 00002000:00010000:3.0:1788201571.675990:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c63100 00000100:00100000:1.0:1788201571.917470:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201571.918231:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559670656 00000100:00100000:2.0:1788201571.918244:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559670656 00002000:00100000:2.0:1788201571.918447:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (579862528->580911103) req@ffff9624c1e58a80 x1875064559670656/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:692/0 lens 488/0 e 0 to 0 dl 1788201582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201571.918459:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e58a80 with x1875064559670656 ext(579862528->580911103) 00002000:00010000:2.0:1788201571.918465:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e58a80 00000100:00100000:2.0:1788201571.918656:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 598 00000100:00100000:2.0:1788201571.918669:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559670656:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201571.953687:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559670656:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35003us (36216us total) trans 30064771599 rc 0/0 00000100:00100000:2.0:1788201571.953707:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 598 00002000:00100000:2.0:1788201571.953724:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (579862528->580911103) req@ffff9624c1e58a80 x1875064559670656/t30064771599(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:692/0 lens 488/448 e 0 to 0 dl 1788201582 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201571.953736:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e58a80 with x1875064559670656 ext(579862528->580911103) 00002000:00010000:2.0:1788201571.953744:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e58a80 00010000:00010000:1.0:1788201572.152798:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201572.231319:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201572.231530:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559670784 00000100:00100000:2.0:1788201572.231545:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559670784 00002000:00100000:2.0:1788201572.231613:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (580911104->581959679) req@ffff96248517d500 x1875064559670784/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:693/0 lens 488/0 e 0 to 0 dl 1788201583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201572.231626:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248517d500 with x1875064559670784 ext(580911104->581959679) 00002000:00010000:2.0:1788201572.231633:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248517d500 00000100:00100000:2.0:1788201572.231675:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 599 00000100:00100000:2.0:1788201572.231686:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248517d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559670784:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201572.244055:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248517d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2342:x1875064559670784:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12351us (12734us total) trans 30064771600 rc 0/0 00000100:00100000:0.0:1788201572.244075:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 599 00002000:00100000:0.0:1788201572.244102:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (580911104->581959679) req@ffff96248517d500 x1875064559670784/t30064771600(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:693/0 lens 488/448 e 0 to 0 dl 1788201583 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201572.244115:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248517d500 with x1875064559670784 ext(580911104->581959679) 00002000:00010000:0.0:1788201572.244124:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248517d500 00000100:00100000:0.0:1788201572.407718:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201572.407750:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570147712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201572.407851:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201572.408067:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570147712 00000100:00100000:1.0:1788201572.408087:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570147712 00000100:00100000:1.0:1788201572.408174:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788201572.408185:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570147712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201572.408219:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 566951936 pending 39190528 free 3301965824 avail 3299868672 00000100:00100000:1.0:1788201572.408278:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570147712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201572.408285:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788201572.408336:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570147712:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201572.408439:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201572.448663:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201572.448801:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559670912 00000100:00100000:1.0:1788201572.448815:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559670912 00002000:00100000:1.0:1788201572.448884:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (581959680->583008255) req@ffff962381a1b480 x1875064559670912/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:693/0 lens 488/0 e 0 to 0 dl 1788201583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201572.448897:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a1b480 with x1875064559670912 ext(581959680->583008255) 00002000:00010000:1.0:1788201572.448904:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a1b480 00000100:00100000:1.0:1788201572.448943:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 600 00000100:00100000:1.0:1788201572.448954:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2341:x1875064559670912:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201572.472160:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2341:x1875064559670912:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23191us (23498us total) trans 30064771601 rc 0/0 00000100:00100000:1.0:1788201572.472178:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 600 00002000:00100000:1.0:1788201572.472194:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (581959680->583008255) req@ffff962381a1b480 x1875064559670912/t30064771601(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:693/0 lens 488/448 e 0 to 0 dl 1788201583 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201572.472207:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a1b480 with x1875064559670912 ext(581959680->583008255) 00002000:00010000:1.0:1788201572.472234:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a1b480 00000100:00100000:2.0:1788201572.634383:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201572.634498:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559671040 00000100:00100000:3.0:1788201572.634510:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559671040 00002000:00100000:3.0:1788201572.634583:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (583008256->584056831) req@ffff9624b9d60e00 x1875064559671040/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:693/0 lens 488/0 e 0 to 0 dl 1788201583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201572.634595:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d60e00 with x1875064559671040 ext(583008256->584056831) 00002000:00010000:3.0:1788201572.634601:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d60e00 00000100:00100000:3.0:1788201572.634832:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 601 00000100:00100000:3.0:1788201572.634845:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559671040:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201572.658955:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559671040:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24095us (24599us total) trans 30064771602 rc 0/0 00000100:00100000:3.0:1788201572.658974:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 601 00002000:00100000:3.0:1788201572.658990:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (583008256->584056831) req@ffff9624b9d60e00 x1875064559671040/t30064771602(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:693/0 lens 488/448 e 0 to 0 dl 1788201583 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201572.659003:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d60e00 with x1875064559671040 ext(583008256->584056831) 00002000:00010000:3.0:1788201572.659030:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d60e00 00000100:00100000:0.0:1788201572.837705:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201572.840586:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559671168 00000100:00100000:2.0:1788201572.840608:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559671168 00002000:00100000:2.0:1788201572.840707:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (584056832->585105407) req@ffff9624bfe68000 x1875064559671168/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:693/0 lens 488/0 e 0 to 0 dl 1788201583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201572.840751:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe68000 with x1875064559671168 ext(584056832->585105407) 00002000:00010000:2.0:1788201572.840758:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe68000 00000100:00100000:2.0:1788201572.840962:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 602 00000100:00100000:2.0:1788201572.840975:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559671168:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201572.881380:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559671168:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 40397us (43679us total) trans 30064771603 rc 0/0 00000100:00100000:3.0:1788201572.881395:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 602 00002000:00100000:3.0:1788201572.881408:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (584056832->585105407) req@ffff9624bfe68000 x1875064559671168/t30064771603(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:693/0 lens 488/448 e 0 to 0 dl 1788201583 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201572.881626:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe68000 with x1875064559671168 ext(584056832->585105407) 00002000:00010000:3.0:1788201572.881634:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe68000 00000100:00100000:2.0:1788201573.059558:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201573.059661:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559671296 00000100:00100000:0.0:1788201573.059674:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559671296 00002000:00100000:0.0:1788201573.059766:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (585105408->586153983) req@ffff96248e361880 x1875064559671296/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:694/0 lens 488/0 e 0 to 0 dl 1788201584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201573.059778:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361880 with x1875064559671296 ext(585105408->586153983) 00002000:00010000:0.0:1788201573.059786:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361880 00000100:00100000:0.0:1788201573.059824:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 603 00000100:00100000:0.0:1788201573.059835:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559671296:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201573.060381:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201573.086587:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2343:x1875064559671296:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26741us (27028us total) trans 30064771604 rc 0/0 00000100:00100000:0.0:1788201573.086603:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 603 00002000:00100000:0.0:1788201573.086616:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (585105408->586153983) req@ffff96248e361880 x1875064559671296/t30064771604(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:694/0 lens 488/448 e 0 to 0 dl 1788201584 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201573.086626:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361880 with x1875064559671296 ext(585105408->586153983) 00002000:00010000:0.0:1788201573.086631:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361880 00000001:00080000:3.0:1788201573.096681:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771600 is committed 00000001:00080000:3.0:1788201573.096732:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771601 is committed 00000001:00080000:3.0:1788201573.096876:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771603 is committed 00010000:00010000:1.0:1788201573.174689:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201573.299883:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201573.300171:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559671424 00000100:00100000:1.0:1788201573.300185:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559671424 00002000:00100000:1.0:1788201573.300242:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (586153984->587202559) req@ffff9624bfe6aa00 x1875064559671424/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:694/0 lens 488/0 e 0 to 0 dl 1788201584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201573.300254:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe6aa00 with x1875064559671424 ext(586153984->587202559) 00002000:00010000:1.0:1788201573.300259:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe6aa00 00000100:00100000:1.0:1788201573.300296:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 604 00000100:00100000:1.0:1788201573.300306:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559671424:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201573.330486:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559671424:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30168us (30602us total) trans 30064771605 rc 0/0 00000100:00100000:2.0:1788201573.330502:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 604 00002000:00100000:2.0:1788201573.330515:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (586153984->587202559) req@ffff9624bfe6aa00 x1875064559671424/t30064771605(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:694/0 lens 488/448 e 0 to 0 dl 1788201584 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201573.330527:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe6aa00 with x1875064559671424 ext(586153984->587202559) 00002000:00010000:2.0:1788201573.330533:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe6aa00 00000100:00100000:3.0:1788201573.535441:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201573.535621:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559671552 00000100:00100000:2.0:1788201573.535633:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559671552 00002000:00100000:2.0:1788201573.535688:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (587202560->588251135) req@ffff9624b9d21180 x1875064559671552/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:694/0 lens 488/0 e 0 to 0 dl 1788201584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201573.535699:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d21180 with x1875064559671552 ext(587202560->588251135) 00002000:00010000:2.0:1788201573.535704:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d21180 00000100:00100000:2.0:1788201573.535745:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 605 00000100:00100000:2.0:1788201573.535756:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559671552:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201573.551603:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559671552:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15833us (16156us total) trans 30064771606 rc 0/0 00000100:00100000:3.0:1788201573.551621:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 605 00002000:00100000:3.0:1788201573.551637:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (587202560->588251135) req@ffff9624b9d21180 x1875064559671552/t30064771606(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:694/0 lens 488/448 e 0 to 0 dl 1788201584 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201573.551649:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d21180 with x1875064559671552 ext(587202560->588251135) 00002000:00010000:3.0:1788201573.551655:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d21180 00000100:00100000:1.0:1788201573.667880:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201573.668329:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559671680 00000100:00100000:3.0:1788201573.668389:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559671680 00002000:00100000:3.0:1788201573.668456:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (588251136->589299711) req@ffff9624c1e5aa00 x1875064559671680/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:694/0 lens 488/0 e 0 to 0 dl 1788201584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201573.668469:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5aa00 with x1875064559671680 ext(588251136->589299711) 00002000:00010000:3.0:1788201573.668476:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5aa00 00000100:00100000:3.0:1788201573.668536:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 606 00000100:00100000:3.0:1788201573.668544:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559671680:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201573.682135:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559671680:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13571us (14246us total) trans 30064771607 rc 0/0 00000100:00100000:3.0:1788201573.682154:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 606 00002000:00100000:3.0:1788201573.682170:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (588251136->589299711) req@ffff9624c1e5aa00 x1875064559671680/t30064771607(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:694/0 lens 488/448 e 0 to 0 dl 1788201584 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201573.682183:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5aa00 with x1875064559671680 ext(588251136->589299711) 00002000:00010000:3.0:1788201573.682192:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5aa00 00000100:00100000:1.0:1788201573.810777:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201573.811017:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559671808 00000100:00100000:0.0:1788201573.811030:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559671808 00002000:00100000:0.0:1788201573.811111:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (589299712->590348287) req@ffff9624c1e59180 x1875064559671808/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:694/0 lens 488/0 e 0 to 0 dl 1788201584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201573.811123:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e59180 with x1875064559671808 ext(589299712->590348287) 00002000:00010000:0.0:1788201573.811129:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e59180 00000100:00100000:0.0:1788201573.811206:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 607 00000100:00100000:0.0:1788201573.811218:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559671808:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201573.829204:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559671808:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17971us (18428us total) trans 30064771608 rc 0/0 00000100:00100000:2.0:1788201573.829243:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 607 00002000:00100000:2.0:1788201573.829260:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (589299712->590348287) req@ffff9624c1e59180 x1875064559671808/t30064771608(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:694/0 lens 488/448 e 0 to 0 dl 1788201584 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201573.829272:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e59180 with x1875064559671808 ext(589299712->590348287) 00002000:00010000:2.0:1788201573.829280:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e59180 00000100:00100000:0.0:1788201573.997278:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201573.997544:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559671936 00000100:00100000:2.0:1788201573.997557:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559671936 00002000:00100000:2.0:1788201573.997631:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (590348288->591396863) req@ffff9624bfe6b800 x1875064559671936/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:694/0 lens 488/0 e 0 to 0 dl 1788201584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201573.997644:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe6b800 with x1875064559671936 ext(590348288->591396863) 00002000:00010000:2.0:1788201573.997650:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe6b800 00000100:00100000:2.0:1788201573.997686:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 608 00000100:00100000:2.0:1788201573.997696:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559671936:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201574.018092:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559671936:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20378us (20808us total) trans 30064771609 rc 0/0 00000100:00100000:2.0:1788201574.018109:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 608 00002000:00100000:2.0:1788201574.018125:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (590348288->591396863) req@ffff9624bfe6b800 x1875064559671936/t30064771609(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:694/0 lens 488/448 e 0 to 0 dl 1788201584 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201574.018137:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe6b800 with x1875064559671936 ext(590348288->591396863) 00002000:00010000:2.0:1788201574.018145:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe6b800 00000100:00100000:1.0:1788201574.192560:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201574.194337:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559672064 00000100:00100000:3.0:1788201574.194395:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559672064 00002000:00100000:3.0:1788201574.194472:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (591396864->592445439) req@ffff9624c1e5bb80 x1875064559672064/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:695/0 lens 488/0 e 0 to 0 dl 1788201585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201574.194485:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5bb80 with x1875064559672064 ext(591396864->592445439) 00002000:00010000:3.0:1788201574.194491:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5bb80 00000100:00100000:3.0:1788201574.194531:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 609 00000100:00100000:3.0:1788201574.194543:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559672064:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201574.195023:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201574.195088:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201574.195091:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559672320 00000100:00100000:2.0:1788201574.195098:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559672320 00000100:00080000:1.0:1788201574.195149:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201574.195158:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 403 00000100:00100000:2.0:1788201574.195187:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559672320:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201574.195271:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559672320:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201574.195333:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559672192 00000100:00100000:0.0:1788201574.195339:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559672192 00000100:00100000:0.0:1788201574.195396:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 544 00000100:00100000:0.0:1788201574.195404:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559672192:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201574.195434:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559672192:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 32us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201574.195441:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 544 00000100:00100000:2.0:1788201574.200916:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 403 00000100:00100000:2.0:1788201574.210644:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559672064:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16086us (18082us total) trans 30064771610 rc 0/0 00000100:00100000:2.0:1788201574.210663:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 609 00002000:00100000:2.0:1788201574.210681:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (591396864->592445439) req@ffff9624c1e5bb80 x1875064559672064/t30064771610(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:695/0 lens 488/448 e 0 to 0 dl 1788201585 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201574.210694:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5bb80 with x1875064559672064 ext(591396864->592445439) 00002000:00010000:2.0:1788201574.210702:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5bb80 00010000:00010000:0.0:1788201574.211899:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201574.382876:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201574.386855:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559672448 00000100:00100000:2.0:1788201574.386875:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559672448 00002000:00100000:2.0:1788201574.386950:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (592445440->593494015) req@ffff9624b9d22300 x1875064559672448/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:695/0 lens 488/0 e 0 to 0 dl 1788201585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201574.386964:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d22300 with x1875064559672448 ext(592445440->593494015) 00002000:00010000:2.0:1788201574.386971:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d22300 00000100:00100000:2.0:1788201574.387078:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 610 00000100:00100000:2.0:1788201574.387091:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559672448:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201574.402424:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559672448:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15320us (19546us total) trans 30064771611 rc 0/0 00000100:00100000:2.0:1788201574.402443:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 610 00002000:00100000:2.0:1788201574.402460:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (592445440->593494015) req@ffff9624b9d22300 x1875064559672448/t30064771611(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:695/0 lens 488/448 e 0 to 0 dl 1788201585 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201574.402498:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d22300 with x1875064559672448 ext(592445440->593494015) 00002000:00010000:2.0:1788201574.402506:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d22300 00000100:00100000:0.0:1788201574.603977:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201574.604151:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559672576 00000100:00100000:2.0:1788201574.604164:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559672576 00002000:00100000:2.0:1788201574.604246:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (593494016->594542591) req@ffff9624bfe6a300 x1875064559672576/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:695/0 lens 488/0 e 0 to 0 dl 1788201585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201574.604261:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe6a300 with x1875064559672576 ext(593494016->594542591) 00002000:00010000:2.0:1788201574.604269:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe6a300 00000100:00100000:2.0:1788201574.604310:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 611 00000100:00100000:2.0:1788201574.604321:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfe6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559672576:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201574.645138:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfe6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559672576:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 38017us (38376us total) trans 30064771612 rc 0/0 00000100:00100000:2.0:1788201574.645160:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 611 00002000:00100000:2.0:1788201574.645181:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (593494016->594542591) req@ffff9624bfe6a300 x1875064559672576/t30064771612(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:695/0 lens 488/448 e 0 to 0 dl 1788201585 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201574.645193:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfe6a300 with x1875064559672576 ext(593494016->594542591) 00002000:00010000:2.0:1788201574.645200:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfe6a300 00000100:00100000:1.0:1788201574.922737:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201574.922853:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559672704 00000100:00100000:2.0:1788201574.922864:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559672704 00002000:00100000:2.0:1788201574.922919:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (594542592->595591167) req@ffff9624c1e5b800 x1875064559672704/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:695/0 lens 488/0 e 0 to 0 dl 1788201585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201574.922932:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5b800 with x1875064559672704 ext(594542592->595591167) 00002000:00010000:2.0:1788201574.922938:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5b800 00000100:00100000:2.0:1788201574.922987:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 612 00000100:00100000:2.0:1788201574.922997:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559672704:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201574.949711:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559672704:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26704us (26984us total) trans 30064771613 rc 0/0 00000100:00100000:2.0:1788201574.950069:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 612 00002000:00100000:2.0:1788201574.950085:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (594542592->595591167) req@ffff9624c1e5b800 x1875064559672704/t30064771613(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:695/0 lens 488/448 e 0 to 0 dl 1788201585 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201574.950097:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e5b800 with x1875064559672704 ext(594542592->595591167) 00002000:00010000:2.0:1788201574.950103:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e5b800 00000100:00100000:1.0:1788201574.967531:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570147840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201574.967619:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201574.967871:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570147840 00000100:00100000:3.0:1788201574.967881:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570147840 00000100:00100000:3.0:1788201574.967958:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788201574.967969:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570147840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201574.968006:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201574.968078:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570147840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201574.968099:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:1.0:1788201574.968167:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788201574.968238:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba172d80 x1875064570147840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201574.968259:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570147840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201575.202713:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201575.204656:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559672832 00000100:00100000:3.0:1788201575.204670:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559672832 00000100:00080000:1.0:1788201575.204816:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1788201575.204946:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (595591168->596639743) req@ffff9624ba172680 x1875064559672832/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:696/0 lens 488/0 e 0 to 0 dl 1788201586 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201575.204959:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba172680 with x1875064559672832 ext(595591168->596639743) 00002000:00010000:3.0:1788201575.204966:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba172680 00000100:00100000:3.0:1788201575.205063:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 613 00000100:00100000:3.0:1788201575.205075:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559672832:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:1.0:1788201575.222848:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201575.241682:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559672832:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35262us (37630us total) trans 30064771614 rc 0/0 00000100:00100000:3.0:1788201575.241702:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 613 00002000:00100000:3.0:1788201575.241719:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (595591168->596639743) req@ffff9624ba172680 x1875064559672832/t30064771614(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:696/0 lens 488/448 e 0 to 0 dl 1788201586 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201575.241730:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba172680 with x1875064559672832 ext(595591168->596639743) 00002000:00010000:3.0:1788201575.241738:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba172680 00000100:00100000:3.0:1788201575.482745:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570148096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201575.482855:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201575.482945:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201575.483167:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570148352:0@lo:400:kworker.0 00000100:00100000:0.0:1788201575.483202:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201575.483231:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201575.483237:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570147968:0@lo:400:kworker.0 00000100:00100000:0.0:1788201575.483270:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201575.483293:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570148480:0@lo:400:kworker.0 00000100:00100000:0.0:1788201575.483315:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201575.483385:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570147968 00000100:00100000:0.0:1788201575.483393:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570147968 00000100:00100000:0.0:1788201575.483451:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1788201575.483462:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570147968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201575.483540:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570147968:12345-0@lo:400:kworker.0 Request processed in 80us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201575.483548:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1788201575.483603:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570147968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201575.483932:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570148224:0@lo:400:kworker.0 00000100:00100000:3.0:1788201575.484090:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201575.484133:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570148096 00000100:00100000:3.0:1788201575.484138:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570148096 00000100:00100000:3.0:1788201575.484174:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570148352 00000100:00100000:3.0:1788201575.484196:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570148352 00000100:00100000:3.0:1788201575.484227:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570148480 00000100:00100000:3.0:1788201575.484231:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570148480 00000100:00100000:3.0:1788201575.484249:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788201575.484259:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570148096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201575.484313:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570148096:12345-0@lo:400:kworker.0 Request processed in 56us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201575.484320:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788201575.484362:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1788201575.484370:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570148352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201575.484401:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570148352:12345-0@lo:400:kworker.0 Request processed in 33us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201575.484407:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1788201575.484420:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1788201575.484427:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570148480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201575.484454:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570148480:12345-0@lo:400:kworker.0 Request processed in 28us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201575.484459:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1788201575.484484:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570148224 00000100:00100000:3.0:1788201575.484488:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570148224 00000100:00100000:3.0:1788201575.484529:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788201575.484536:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570148224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201575.484568:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570148224:12345-0@lo:400:kworker.0 Request processed in 33us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201575.484574:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:3.0:1788201575.484591:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201575.484596:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201575.485179:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570148480:0@lo:400:kworker.0 00000100:00100000:0.0:1788201575.485191:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570148352:0@lo:400:kworker.0 00000100:00100000:0.0:1788201575.485259:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570148224:0@lo:400:kworker.0 00000100:00100000:0.0:1788201575.485271:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570148096:0@lo:400:kworker.0 00000100:00100000:0.0:1788201575.486707:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201575.491151:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559672960 00000100:00100000:3.0:1788201575.491170:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559672960 00002000:00100000:3.0:1788201575.491251:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (596639744->597688319) req@ffff9624ba172d80 x1875064559672960/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:696/0 lens 488/0 e 0 to 0 dl 1788201586 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201575.491264:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba172d80 with x1875064559672960 ext(596639744->597688319) 00002000:00010000:3.0:1788201575.491270:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba172d80 00000100:00100000:3.0:1788201575.491477:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 614 00000100:00100000:3.0:1788201575.491489:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559672960:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201575.519647:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2341:x1875064559672960:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28140us (32933us total) trans 30064771615 rc 0/0 00000100:00100000:2.0:1788201575.519666:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 614 00002000:00100000:2.0:1788201575.519682:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (596639744->597688319) req@ffff9624ba172d80 x1875064559672960/t30064771615(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:696/0 lens 488/448 e 0 to 0 dl 1788201586 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201575.519694:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba172d80 with x1875064559672960 ext(596639744->597688319) 00002000:00010000:2.0:1788201575.519701:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba172d80 00000100:00100000:0.0:1788201575.716416:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201575.716554:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559673088 00000100:00100000:2.0:1788201575.716567:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559673088 00002000:00100000:2.0:1788201575.716632:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (597688320->598736895) req@ffff9624b9c43480 x1875064559673088/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:696/0 lens 488/0 e 0 to 0 dl 1788201586 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201575.716659:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c43480 with x1875064559673088 ext(597688320->598736895) 00002000:00010000:2.0:1788201575.716666:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c43480 00000100:00100000:2.0:1788201575.716708:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 615 00000100:00100000:2.0:1788201575.716720:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559673088:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201575.749171:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559673088:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32432us (32751us total) trans 30064771616 rc 0/0 00000100:00100000:3.0:1788201575.749191:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 615 00002000:00100000:3.0:1788201575.749208:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (597688320->598736895) req@ffff9624b9c43480 x1875064559673088/t30064771616(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:696/0 lens 488/448 e 0 to 0 dl 1788201586 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201575.749219:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c43480 with x1875064559673088 ext(597688320->598736895) 00002000:00010000:3.0:1788201575.749227:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c43480 00000100:00100000:3.0:1788201575.977700:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201575.978180:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559673216 00000100:00100000:1.0:1788201575.978194:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559673216 00002000:00100000:1.0:1788201575.978258:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (598736896->599785471) req@ffff9624b9d20380 x1875064559673216/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:696/0 lens 488/0 e 0 to 0 dl 1788201586 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201575.978271:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d20380 with x1875064559673216 ext(598736896->599785471) 00002000:00010000:1.0:1788201575.978293:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d20380 00000100:00100000:1.0:1788201575.978446:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 616 00000100:00100000:1.0:1788201575.978458:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559673216:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201575.999417:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559673216:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20945us (21717us total) trans 30064771617 rc 0/0 00000100:00100000:1.0:1788201575.999435:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 616 00002000:00100000:1.0:1788201575.999451:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (598736896->599785471) req@ffff9624b9d20380 x1875064559673216/t30064771617(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:696/0 lens 488/448 e 0 to 0 dl 1788201586 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201575.999463:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d20380 with x1875064559673216 ext(598736896->599785471) 00002000:00010000:1.0:1788201575.999470:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d20380 00000100:00100000:0.0:1788201576.192185:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201576.192515:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559673344 00000100:00100000:3.0:1788201576.192528:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559673344 00002000:00100000:3.0:1788201576.192603:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (599785472->600834047) req@ffff9624b9c42680 x1875064559673344/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:697/0 lens 488/0 e 0 to 0 dl 1788201587 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201576.192618:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c42680 with x1875064559673344 ext(599785472->600834047) 00002000:00010000:3.0:1788201576.192625:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c42680 00000100:00100000:3.0:1788201576.192708:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 617 00000100:00100000:3.0:1788201576.192721:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559673344:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201576.216992:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559673344:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24258us (24810us total) trans 30064771618 rc 0/0 00000100:00100000:2.0:1788201576.217022:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 617 00002000:00100000:2.0:1788201576.217039:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (599785472->600834047) req@ffff9624b9c42680 x1875064559673344/t30064771618(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:697/0 lens 488/448 e 0 to 0 dl 1788201587 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201576.217052:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c42680 with x1875064559673344 ext(599785472->600834047) 00002000:00010000:2.0:1788201576.217059:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c42680 00010000:00010000:1.0:1788201576.246774:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201576.454656:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201576.454832:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559673472 00000100:00100000:2.0:1788201576.454843:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559673472 00002000:00100000:2.0:1788201576.454906:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (600834048->601882623) req@ffff9623939cd880 x1875064559673472/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:697/0 lens 488/0 e 0 to 0 dl 1788201587 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201576.454918:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cd880 with x1875064559673472 ext(600834048->601882623) 00002000:00010000:2.0:1788201576.454925:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cd880 00000100:00100000:2.0:1788201576.454961:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 618 00000100:00100000:2.0:1788201576.454972:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559673472:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201576.490475:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559673472:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35488us (35819us total) trans 30064771619 rc 0/0 00000100:00100000:2.0:1788201576.490493:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 618 00002000:00100000:2.0:1788201576.490528:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (600834048->601882623) req@ffff9623939cd880 x1875064559673472/t30064771619(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:697/0 lens 488/448 e 0 to 0 dl 1788201587 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201576.490540:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cd880 with x1875064559673472 ext(600834048->601882623) 00002000:00010000:2.0:1788201576.490548:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cd880 00000100:00100000:1.0:1788201576.664418:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201576.664542:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559673600 00000100:00100000:0.0:1788201576.664564:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559673600 00002000:00100000:0.0:1788201576.664637:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (601882624->602931199) req@ffff9623939cc700 x1875064559673600/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:697/0 lens 488/0 e 0 to 0 dl 1788201587 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201576.664649:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cc700 with x1875064559673600 ext(601882624->602931199) 00002000:00010000:0.0:1788201576.664656:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cc700 00000100:00100000:0.0:1788201576.664701:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 619 00000100:00100000:0.0:1788201576.664713:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559673600:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201576.700668:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559673600:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35936us (36316us total) trans 30064771620 rc 0/0 00000100:00100000:1.0:1788201576.700688:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 619 00002000:00100000:1.0:1788201576.700707:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (601882624->602931199) req@ffff9623939cc700 x1875064559673600/t30064771620(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:697/0 lens 488/448 e 0 to 0 dl 1788201587 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201576.700720:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cc700 with x1875064559673600 ext(601882624->602931199) 00002000:00010000:1.0:1788201576.700727:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cc700 00000100:00100000:0.0:1788201576.806179:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201576.806297:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559673728 00000100:00100000:1.0:1788201576.806310:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559673728 00002000:00100000:1.0:1788201576.806437:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (602931200->603979775) req@ffff9624b9c41500 x1875064559673728/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:697/0 lens 488/0 e 0 to 0 dl 1788201587 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201576.806477:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c41500 with x1875064559673728 ext(602931200->603979775) 00002000:00010000:1.0:1788201576.806494:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c41500 00000100:00100000:1.0:1788201576.806534:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 620 00000100:00100000:1.0:1788201576.806545:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559673728:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201576.832821:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559673728:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26258us (26639us total) trans 30064771621 rc 0/0 00000100:00100000:1.0:1788201576.832843:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 620 00002000:00100000:1.0:1788201576.832863:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (602931200->603979775) req@ffff9624b9c41500 x1875064559673728/t30064771621(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:697/0 lens 488/448 e 0 to 0 dl 1788201587 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201576.832875:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9c41500 with x1875064559673728 ext(602931200->603979775) 00002000:00010000:1.0:1788201576.832882:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9c41500 00000100:00100000:3.0:1788201577.150153:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201577.150374:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559673856 00000100:00100000:2.0:1788201577.150387:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559673856 00002000:00100000:2.0:1788201577.150478:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (603979776->605028351) req@ffff9624b9d23800 x1875064559673856/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/0 e 0 to 0 dl 1788201588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201577.150491:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d23800 with x1875064559673856 ext(603979776->605028351) 00002000:00010000:2.0:1788201577.150500:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d23800 00000100:00100000:2.0:1788201577.150542:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 621 00000100:00100000:2.0:1788201577.150762:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559673856:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201577.151497:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201577.207152:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559673856:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 56372us (56990us total) trans 30064771622 rc 0/0 00000100:00100000:2.0:1788201577.207173:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 621 00002000:00100000:2.0:1788201577.207198:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (603979776->605028351) req@ffff9624b9d23800 x1875064559673856/t30064771622(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/448 e 0 to 0 dl 1788201588 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201577.207211:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d23800 with x1875064559673856 ext(603979776->605028351) 00002000:00010000:2.0:1788201577.207219:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d23800 00010000:00010000:0.0:1788201577.271520:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201577.372843:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201577.372982:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559673984 00000100:00100000:2.0:1788201577.373022:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559673984 00002000:00100000:2.0:1788201577.373093:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (605028352->606076927) req@ffff962492c21f80 x1875064559673984/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/0 e 0 to 0 dl 1788201588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201577.373105:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c21f80 with x1875064559673984 ext(605028352->606076927) 00002000:00010000:2.0:1788201577.373130:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c21f80 00000100:00100000:2.0:1788201577.373178:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 622 00000100:00100000:2.0:1788201577.373190:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559673984:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201577.395428:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559673984:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22216us (22576us total) trans 30064771623 rc 0/0 00000100:00100000:2.0:1788201577.395450:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 622 00002000:00100000:2.0:1788201577.395482:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (605028352->606076927) req@ffff962492c21f80 x1875064559673984/t30064771623(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/448 e 0 to 0 dl 1788201588 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201577.395497:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c21f80 with x1875064559673984 ext(605028352->606076927) 00002000:00010000:2.0:1788201577.395505:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c21f80 00000100:00100000:3.0:1788201577.472851:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201577.473072:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559674112 00000100:00100000:1.0:1788201577.473087:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559674112 00002000:00100000:1.0:1788201577.473151:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (606076928->607125503) req@ffff9624b9d20000 x1875064559674112/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/0 e 0 to 0 dl 1788201588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201577.473166:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d20000 with x1875064559674112 ext(606076928->607125503) 00002000:00010000:1.0:1788201577.473173:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d20000 00000100:00100000:1.0:1788201577.473216:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 623 00000100:00100000:1.0:1788201577.473228:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2342:x1875064559674112:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201577.489055:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2342:x1875064559674112:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15807us (16202us total) trans 30064771624 rc 0/0 00000100:00100000:3.0:1788201577.489075:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 623 00002000:00100000:3.0:1788201577.489093:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (606076928->607125503) req@ffff9624b9d20000 x1875064559674112/t30064771624(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/448 e 0 to 0 dl 1788201588 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201577.489106:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d20000 with x1875064559674112 ext(606076928->607125503) 00002000:00010000:3.0:1788201577.489114:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d20000 00000100:00100000:3.0:1788201577.527148:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201577.527183:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248e362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570148608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201577.527289:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201577.527517:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570148608 00000100:00100000:1.0:1788201577.527528:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570148608 00000100:00100000:1.0:1788201577.527605:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788201577.527616:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570148608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201577.527666:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3407872 granted 565248000 pending 35782656 free 3274702848 avail 3272605696 00000100:00100000:1.0:1788201577.527720:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570148608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201577.527728:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:3.0:1788201577.527900:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201577.527941:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248e362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570148608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201577.546732:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201577.546915:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559674240 00000100:00100000:1.0:1788201577.546928:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559674240 00002000:00100000:1.0:1788201577.547004:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (607125504->608174079) req@ffff96248e361180 x1875064559674240/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/0 e 0 to 0 dl 1788201588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201577.547019:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361180 with x1875064559674240 ext(607125504->608174079) 00002000:00010000:1.0:1788201577.547027:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361180 00000100:00100000:1.0:1788201577.547065:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 624 00000100:00100000:1.0:1788201577.547077:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559674240:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201577.574422:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559674240:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27329us (27686us total) trans 30064771625 rc 0/0 00000100:00100000:1.0:1788201577.574440:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 624 00002000:00100000:1.0:1788201577.574455:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (607125504->608174079) req@ffff96248e361180 x1875064559674240/t30064771625(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/448 e 0 to 0 dl 1788201588 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201577.574467:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361180 with x1875064559674240 ext(607125504->608174079) 00002000:00010000:1.0:1788201577.574475:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361180 00000100:00100000:0.0:1788201577.651892:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201577.652787:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559674368 00000100:00100000:2.0:1788201577.652801:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559674368 00002000:00100000:2.0:1788201577.652870:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (608174080->609222655) req@ffff962492c21880 x1875064559674368/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/0 e 0 to 0 dl 1788201588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201577.652884:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c21880 with x1875064559674368 ext(608174080->609222655) 00002000:00010000:2.0:1788201577.652890:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c21880 00000100:00100000:2.0:1788201577.652932:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 625 00000100:00100000:2.0:1788201577.652944:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559674368:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201577.666031:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2342:x1875064559674368:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13072us (14139us total) trans 30064771626 rc 0/0 00000100:00100000:1.0:1788201577.666051:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 625 00002000:00100000:1.0:1788201577.666068:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (608174080->609222655) req@ffff962492c21880 x1875064559674368/t30064771626(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/448 e 0 to 0 dl 1788201588 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201577.666105:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c21880 with x1875064559674368 ext(608174080->609222655) 00002000:00010000:1.0:1788201577.666113:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c21880 00000100:00100000:3.0:1788201577.764283:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201577.764495:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559674496 00000100:00100000:2.0:1788201577.764508:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559674496 00002000:00100000:2.0:1788201577.764573:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (609222656->610271231) req@ffff9624b9d21500 x1875064559674496/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/0 e 0 to 0 dl 1788201588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201577.764586:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d21500 with x1875064559674496 ext(609222656->610271231) 00002000:00010000:2.0:1788201577.764613:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d21500 00000100:00100000:2.0:1788201577.764654:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 626 00000100:00100000:2.0:1788201577.764665:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559674496:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201577.780799:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559674496:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16117us (16512us total) trans 30064771627 rc 0/0 00000100:00100000:0.0:1788201577.780816:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 626 00002000:00100000:0.0:1788201577.780832:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (609222656->610271231) req@ffff9624b9d21500 x1875064559674496/t30064771627(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/448 e 0 to 0 dl 1788201588 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201577.780844:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d21500 with x1875064559674496 ext(609222656->610271231) 00002000:00010000:0.0:1788201577.780852:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d21500 00000100:00100000:2.0:1788201577.901730:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201577.901886:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559674624 00000100:00100000:3.0:1788201577.901898:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559674624 00002000:00100000:3.0:1788201577.902152:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (610271232->611319807) req@ffff96248e360700 x1875064559674624/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/0 e 0 to 0 dl 1788201588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201577.902165:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360700 with x1875064559674624 ext(610271232->611319807) 00002000:00010000:3.0:1788201577.902172:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360700 00000100:00100000:3.0:1788201577.902213:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 627 00000100:00100000:3.0:1788201577.902224:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559674624:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201577.930690:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559674624:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28450us (28958us total) trans 30064771628 rc 0/0 00000100:00100000:3.0:1788201577.930710:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 627 00002000:00100000:3.0:1788201577.930727:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (610271232->611319807) req@ffff96248e360700 x1875064559674624/t30064771628(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:698/0 lens 488/448 e 0 to 0 dl 1788201588 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201577.930739:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360700 with x1875064559674624 ext(610271232->611319807) 00002000:00010000:3.0:1788201577.930747:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360700 00000100:00100000:1.0:1788201578.109246:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201578.109385:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559674752 00000100:00100000:2.0:1788201578.109398:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559674752 00002000:00100000:2.0:1788201578.109463:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (611319808->612368383) req@ffff9623939ce300 x1875064559674752/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:699/0 lens 488/0 e 0 to 0 dl 1788201589 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201578.109475:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939ce300 with x1875064559674752 ext(611319808->612368383) 00002000:00010000:2.0:1788201578.109482:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939ce300 00000100:00100000:2.0:1788201578.109519:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 628 00000100:00100000:2.0:1788201578.109530:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559674752:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201578.122183:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2344:x1875064559674752:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12634us (12931us total) trans 30064771629 rc 0/0 00000100:00100000:1.0:1788201578.122221:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 628 00002000:00100000:1.0:1788201578.122240:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (611319808->612368383) req@ffff9623939ce300 x1875064559674752/t30064771629(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:699/0 lens 488/448 e 0 to 0 dl 1788201589 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201578.122252:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939ce300 with x1875064559674752 ext(611319808->612368383) 00002000:00010000:1.0:1788201578.122260:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939ce300 00000100:00100000:3.0:1788201578.258892:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201578.259061:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559674880 00000100:00100000:2.0:1788201578.259073:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559674880 00002000:00100000:2.0:1788201578.259130:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (612368384->613416959) req@ffff9624904a1c00 x1875064559674880/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:699/0 lens 488/0 e 0 to 0 dl 1788201589 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201578.259142:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a1c00 with x1875064559674880 ext(612368384->613416959) 00002000:00010000:2.0:1788201578.259149:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a1c00 00000100:00100000:2.0:1788201578.259182:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 629 00000100:00100000:2.0:1788201578.259191:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559674880:12345-192.168.201.56@tcp:4:iozone.0 00000001:00080000:3.0:1788201578.266738:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771627 is committed 00000001:00080000:3.0:1788201578.266921:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771628 is committed 00000100:00100000:3.0:1788201578.281095:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559674880:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21885us (22199us total) trans 30064771630 rc 0/0 00000100:00100000:3.0:1788201578.281115:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 629 00002000:00100000:3.0:1788201578.281131:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (612368384->613416959) req@ffff9624904a1c00 x1875064559674880/t30064771630(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:699/0 lens 488/448 e 0 to 0 dl 1788201589 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201578.281142:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624904a1c00 with x1875064559674880 ext(612368384->613416959) 00002000:00010000:3.0:1788201578.281148:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624904a1c00 00010000:00010000:1.0:1788201578.294709:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201578.399541:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201578.399690:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559675008 00000100:00100000:3.0:1788201578.399703:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559675008 00002000:00100000:3.0:1788201578.399767:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (613416960->614465535) req@ffff962492c23800 x1875064559675008/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:699/0 lens 488/0 e 0 to 0 dl 1788201589 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201578.399780:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c23800 with x1875064559675008 ext(613416960->614465535) 00002000:00010000:3.0:1788201578.399786:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c23800 00000100:00100000:3.0:1788201578.399828:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 630 00000100:00100000:3.0:1788201578.399857:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559675008:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201578.428185:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559675008:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28313us (28643us total) trans 30064771631 rc 0/0 00000100:00100000:3.0:1788201578.428204:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 630 00002000:00100000:3.0:1788201578.428220:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (613416960->614465535) req@ffff962492c23800 x1875064559675008/t30064771631(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:699/0 lens 488/448 e 0 to 0 dl 1788201589 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201578.428233:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492c23800 with x1875064559675008 ext(613416960->614465535) 00002000:00010000:3.0:1788201578.428241:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492c23800 00000100:00100000:2.0:1788201578.754714:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201578.755301:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559675136 00000100:00100000:3.0:1788201578.755315:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559675136 00002000:00100000:3.0:1788201578.755419:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (614465536->615514111) req@ffff96248e362300 x1875064559675136/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:699/0 lens 488/0 e 0 to 0 dl 1788201589 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201578.755433:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e362300 with x1875064559675136 ext(614465536->615514111) 00002000:00010000:3.0:1788201578.755440:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e362300 00000100:00100000:3.0:1788201578.755492:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 631 00000100:00100000:3.0:1788201578.755504:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559675136:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201578.781183:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559675136:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25653us (26457us total) trans 30064771632 rc 0/0 00000100:00100000:3.0:1788201578.781201:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 631 00002000:00100000:3.0:1788201578.781218:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (614465536->615514111) req@ffff96248e362300 x1875064559675136/t30064771632(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:699/0 lens 488/448 e 0 to 0 dl 1788201589 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201578.781231:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e362300 with x1875064559675136 ext(614465536->615514111) 00002000:00010000:3.0:1788201578.781239:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e362300 00000100:00100000:2.0:1788201579.073697:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201579.073882:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559675264 00000100:00100000:1.0:1788201579.073895:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559675264 00002000:00100000:1.0:1788201579.073988:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (615514112->616562687) req@ffff96248e360380 x1875064559675264/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:700/0 lens 488/0 e 0 to 0 dl 1788201590 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201579.074001:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360380 with x1875064559675264 ext(615514112->616562687) 00002000:00010000:1.0:1788201579.074008:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360380 00000100:00100000:1.0:1788201579.074055:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 632 00000100:00100000:1.0:1788201579.074069:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559675264:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201579.074381:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201579.100330:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559675264:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26248us (26634us total) trans 30064771633 rc 0/0 00000100:00100000:1.0:1788201579.100378:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 632 00002000:00100000:1.0:1788201579.100393:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (615514112->616562687) req@ffff96248e360380 x1875064559675264/t30064771633(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:700/0 lens 488/448 e 0 to 0 dl 1788201590 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201579.100423:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360380 with x1875064559675264 ext(615514112->616562687) 00002000:00010000:1.0:1788201579.100431:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360380 00000100:00100000:2.0:1788201579.278888:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201579.281153:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559675392 00000100:00100000:3.0:1788201579.281173:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559675392 00002000:00100000:3.0:1788201579.281252:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (616562688->617611263) req@ffff96248e361f80 x1875064559675392/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:700/0 lens 488/0 e 0 to 0 dl 1788201590 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201579.281264:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361f80 with x1875064559675392 ext(616562688->617611263) 00002000:00010000:3.0:1788201579.281271:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361f80 00000100:00100000:3.0:1788201579.281321:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 633 00000100:00100000:3.0:1788201579.281332:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559675392:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201579.302868:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559675392:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21012us (23469us total) trans 30064771634 rc 0/0 00000100:00100000:3.0:1788201579.302885:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 633 00002000:00100000:3.0:1788201579.302902:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (616562688->617611263) req@ffff96248e361f80 x1875064559675392/t30064771634(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:700/0 lens 488/448 e 0 to 0 dl 1788201590 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201579.302913:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361f80 with x1875064559675392 ext(616562688->617611263) 00002000:00010000:3.0:1788201579.302920:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361f80 00000100:00100000:2.0:1788201579.319084:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201579.319162:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201579.319987:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559675648 00000100:00100000:0.0:1788201579.320000:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559675648 00000100:00100000:0.0:1788201579.320096:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 407 00000100:00100000:0.0:1788201579.320109:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559675648:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201579.320221:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559675648:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 115us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201579.320230:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 407 00000100:00100000:0.0:1788201579.320258:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559675520 00000100:00100000:0.0:1788201579.320262:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559675520 00000100:00100000:0.0:1788201579.320288:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 546 00000100:00100000:0.0:1788201579.320294:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559675520:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201579.320322:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559675520:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 28us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201579.320328:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 546 00000100:00080000:3.0:1788201579.320811:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788201579.322592:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201579.503833:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201579.503975:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559675776 00000100:00100000:0.0:1788201579.503987:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559675776 00002000:00100000:0.0:1788201579.504055:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (617611264->618659839) req@ffff96248e363800 x1875064559675776/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:700/0 lens 488/0 e 0 to 0 dl 1788201590 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201579.504068:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363800 with x1875064559675776 ext(617611264->618659839) 00002000:00010000:0.0:1788201579.504074:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363800 00000100:00100000:0.0:1788201579.504110:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 634 00000100:00100000:0.0:1788201579.504120:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559675776:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201579.544297:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559675776:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 40161us (40465us total) trans 30064771635 rc 0/0 00000100:00100000:2.0:1788201579.544315:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 634 00002000:00100000:2.0:1788201579.544331:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (617611264->618659839) req@ffff96248e363800 x1875064559675776/t30064771635(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:700/0 lens 488/448 e 0 to 0 dl 1788201590 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201579.544392:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363800 with x1875064559675776 ext(617611264->618659839) 00002000:00010000:2.0:1788201579.544400:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363800 00000100:00100000:0.0:1788201579.736291:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201579.736886:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559675904 00000100:00100000:1.0:1788201579.736901:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559675904 00002000:00100000:1.0:1788201579.736985:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (618659840->619708415) req@ffff9624bfd0ed80 x1875064559675904/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:700/0 lens 488/0 e 0 to 0 dl 1788201590 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201579.736999:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd0ed80 with x1875064559675904 ext(618659840->619708415) 00002000:00010000:1.0:1788201579.737006:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd0ed80 00000100:00100000:1.0:1788201579.737057:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 635 00000100:00100000:1.0:1788201579.737070:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559675904:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201579.776717:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559675904:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39631us (40423us total) trans 30064771636 rc 0/0 00000100:00100000:3.0:1788201579.781608:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 635 00002000:00100000:3.0:1788201579.781639:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (618659840->619708415) req@ffff9624bfd0ed80 x1875064559675904/t30064771636(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:700/0 lens 488/448 e 0 to 0 dl 1788201590 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201579.781652:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd0ed80 with x1875064559675904 ext(618659840->619708415) 00002000:00010000:3.0:1788201579.781660:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd0ed80 00000100:00100000:1.0:1788201579.968856:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201579.969481:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559676032 00000100:00100000:2.0:1788201579.969493:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559676032 00002000:00100000:2.0:1788201579.969558:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (619708416->620756991) req@ffff9623939cd500 x1875064559676032/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:700/0 lens 488/0 e 0 to 0 dl 1788201590 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201579.969571:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cd500 with x1875064559676032 ext(619708416->620756991) 00002000:00010000:2.0:1788201579.969578:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cd500 00000100:00100000:2.0:1788201579.969623:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 636 00000100:00100000:2.0:1788201579.969636:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559676032:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201580.018115:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559676032:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 48465us (49256us total) trans 30064771637 rc 0/0 00000100:00100000:3.0:1788201580.018133:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 636 00002000:00100000:3.0:1788201580.018147:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (619708416->620756991) req@ffff9623939cd500 x1875064559676032/t30064771637(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:700/0 lens 488/448 e 0 to 0 dl 1788201590 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201580.018160:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cd500 with x1875064559676032 ext(619708416->620756991) 00002000:00010000:3.0:1788201580.018167:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cd500 00000100:00100000:2.0:1788201580.096935:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201580.096997:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570148736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201580.097104:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201580.097695:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570148736 00000100:00100000:0.0:1788201580.097706:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570148736 00000100:00100000:0.0:1788201580.097797:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788201580.097808:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570148736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201580.097855:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201580.097932:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570148736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201580.097968:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:3.0:1788201580.098096:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788201580.098381:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd0fb80 x1875064570148736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201580.098401:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570148736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201580.200096:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201580.200421:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559676160 00000100:00100000:2.0:1788201580.200453:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559676160 00002000:00100000:2.0:1788201580.200514:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (620756992->621805567) req@ffff9623939cc380 x1875064559676160/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:701/0 lens 488/0 e 0 to 0 dl 1788201591 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201580.200527:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cc380 with x1875064559676160 ext(620756992->621805567) 00002000:00010000:2.0:1788201580.200533:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cc380 00000100:00100000:2.0:1788201580.200573:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 637 00000100:00100000:2.0:1788201580.200584:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559676160:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201580.222246:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559676160:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21644us (22145us total) trans 30064771638 rc 0/0 00000100:00100000:2.0:1788201580.222269:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 637 00002000:00100000:2.0:1788201580.222287:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (620756992->621805567) req@ffff9623939cc380 x1875064559676160/t30064771638(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:701/0 lens 488/448 e 0 to 0 dl 1788201591 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201580.222299:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cc380 with x1875064559676160 ext(620756992->621805567) 00002000:00010000:2.0:1788201580.222307:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cc380 00010000:00010000:0.0:1788201580.345996:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201580.412992:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201580.425736:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559676288 00000100:00100000:0.0:1788201580.425758:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559676288 00002000:00100000:0.0:1788201580.425836:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (621805568->622854143) req@ffff9624c1e02d80 x1875064559676288/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:701/0 lens 488/0 e 0 to 0 dl 1788201591 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201580.425847:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02d80 with x1875064559676288 ext(621805568->622854143) 00002000:00010000:0.0:1788201580.425854:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02d80 00000100:00100000:0.0:1788201580.425899:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 638 00000100:00100000:0.0:1788201580.425910:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559676288:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201580.459427:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559676288:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33503us (46435us total) trans 30064771639 rc 0/0 00000100:00100000:1.0:1788201580.459445:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 638 00002000:00100000:1.0:1788201580.459461:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (621805568->622854143) req@ffff9624c1e02d80 x1875064559676288/t30064771639(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:701/0 lens 488/448 e 0 to 0 dl 1788201591 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201580.459474:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02d80 with x1875064559676288 ext(621805568->622854143) 00002000:00010000:1.0:1788201580.459482:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02d80 00000100:00100000:2.0:1788201580.601032:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248e363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570148992:0@lo:400:kworker.0 00000100:00100000:2.0:1788201580.601131:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201580.601224:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788201580.601232:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248e361c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570148864:0@lo:400:kworker.0 00000100:00100000:2.0:1788201580.601268:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201580.601290:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248e361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570149376:0@lo:400:kworker.0 00000100:00100000:2.0:1788201580.601316:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201580.601363:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248e360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570149120:0@lo:400:kworker.0 00000100:00100000:2.0:1788201580.601393:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201580.601412:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201580.601573:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248e363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570149248:0@lo:400:kworker.0 00000100:00100000:2.0:1788201580.601600:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201580.601811:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570148864 00000100:00100000:0.0:1788201580.601821:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570148864 00000100:00100000:0.0:1788201580.601889:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1788201580.601900:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570148864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201580.601978:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570148864:12345-0@lo:400:kworker.0 Request processed in 78us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201580.601985:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1788201580.602024:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570148992 00000100:00100000:0.0:1788201580.602027:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570148992 00000100:00100000:0.0:1788201580.602068:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570149376 00000100:00100000:0.0:1788201580.602071:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570149376 00000100:00100000:0.0:1788201580.602095:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570149248 00000100:00100000:0.0:1788201580.602097:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570149248 00000100:00100000:0.0:1788201580.602111:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1788201580.602117:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570148992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201580.602152:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570148992:12345-0@lo:400:kworker.0 Request processed in 34us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201580.602167:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1788201580.602181:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1788201580.602186:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570149376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201580.602230:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570149376:12345-0@lo:400:kworker.0 Request processed in 43us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201580.602236:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1788201580.602249:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1788201580.602255:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570149248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201580.602287:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570149248:12345-0@lo:400:kworker.0 Request processed in 32us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201580.602293:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1788201580.602333:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248e361c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570148864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201580.602381:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248e361500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570149376:0@lo:400:kworker.0 00000100:00100000:0.0:1788201580.602394:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248e363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570148992:0@lo:400:kworker.0 00000100:00100000:0.0:1788201580.602605:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248e363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570149248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201580.602764:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570149120 00000100:00100000:3.0:1788201580.602769:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570149120 00000100:00100000:3.0:1788201580.602818:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788201580.602827:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570149120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201580.602878:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570149120:12345-0@lo:400:kworker.0 Request processed in 53us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201580.602884:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1788201580.602924:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201580.602929:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201580.602961:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248e360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570149120:0@lo:400:kworker.0 00000100:00100000:0.0:1788201580.656793:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201580.656951:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559676416 00000100:00100000:1.0:1788201580.656965:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559676416 00002000:00100000:1.0:1788201580.657033:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (622854144->623902719) req@ffff9624bfd0fb80 x1875064559676416/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:701/0 lens 488/0 e 0 to 0 dl 1788201591 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201580.657090:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd0fb80 with x1875064559676416 ext(622854144->623902719) 00002000:00010000:1.0:1788201580.657100:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd0fb80 00000100:00100000:1.0:1788201580.657150:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 639 00000100:00100000:1.0:1788201580.657163:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559676416:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201580.683415:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559676416:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26235us (26622us total) trans 30064771640 rc 0/0 00000100:00100000:1.0:1788201580.683434:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 639 00002000:00100000:1.0:1788201580.683450:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (622854144->623902719) req@ffff9624bfd0fb80 x1875064559676416/t30064771640(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:701/0 lens 488/448 e 0 to 0 dl 1788201591 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201580.683463:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd0fb80 with x1875064559676416 ext(622854144->623902719) 00002000:00010000:1.0:1788201580.683473:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd0fb80 00000100:00100000:0.0:1788201580.826105:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201580.826224:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559676544 00000100:00100000:3.0:1788201580.826236:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559676544 00002000:00100000:3.0:1788201580.826302:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (623902720->624951295) req@ffff96248e360a80 x1875064559676544/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:701/0 lens 488/0 e 0 to 0 dl 1788201591 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201580.826314:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360a80 with x1875064559676544 ext(623902720->624951295) 00002000:00010000:3.0:1788201580.826321:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360a80 00000100:00100000:3.0:1788201580.826392:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 640 00000100:00100000:3.0:1788201580.826433:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559676544:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201580.866122:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559676544:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39672us (40013us total) trans 30064771641 rc 0/0 00000100:00100000:3.0:1788201580.866144:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 640 00002000:00100000:3.0:1788201580.866163:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (623902720->624951295) req@ffff96248e360a80 x1875064559676544/t30064771641(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:701/0 lens 488/448 e 0 to 0 dl 1788201591 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201580.866175:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e360a80 with x1875064559676544 ext(623902720->624951295) 00002000:00010000:3.0:1788201580.866184:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e360a80 00000100:00100000:0.0:1788201581.044721:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201581.044841:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559676672 00000100:00100000:2.0:1788201581.044853:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559676672 00002000:00100000:2.0:1788201581.044947:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (624951296->625999871) req@ffff96248e363b80 x1875064559676672/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/0 e 0 to 0 dl 1788201592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201581.044960:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363b80 with x1875064559676672 ext(624951296->625999871) 00002000:00010000:2.0:1788201581.044966:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363b80 00000100:00100000:2.0:1788201581.045007:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 641 00000100:00100000:2.0:1788201581.045018:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559676672:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201581.048032:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201581.066591:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559676672:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21559us (21878us total) trans 30064771642 rc 0/0 00000100:00100000:3.0:1788201581.066608:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 641 00002000:00100000:3.0:1788201581.066623:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (624951296->625999871) req@ffff96248e363b80 x1875064559676672/t30064771642(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/448 e 0 to 0 dl 1788201592 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201581.066635:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363b80 with x1875064559676672 ext(624951296->625999871) 00002000:00010000:3.0:1788201581.066643:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363b80 00000100:00100000:0.0:1788201581.156297:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201581.156551:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559676800 00000100:00100000:1.0:1788201581.156563:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559676800 00002000:00100000:1.0:1788201581.156625:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (625999872->627048447) req@ffff96248e363100 x1875064559676800/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/0 e 0 to 0 dl 1788201592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201581.156640:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363100 with x1875064559676800 ext(625999872->627048447) 00002000:00010000:1.0:1788201581.156648:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363100 00000100:00100000:1.0:1788201581.156692:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 642 00000100:00100000:1.0:1788201581.156704:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559676800:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201581.195030:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559676800:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 38310us (38732us total) trans 30064771643 rc 0/0 00000100:00100000:1.0:1788201581.195049:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 642 00002000:00100000:1.0:1788201581.195085:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (625999872->627048447) req@ffff96248e363100 x1875064559676800/t30064771643(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/448 e 0 to 0 dl 1788201592 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201581.195099:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e363100 with x1875064559676800 ext(625999872->627048447) 00002000:00010000:1.0:1788201581.195108:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e363100 00000100:00100000:2.0:1788201581.230418:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201581.234731:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559676928 00000100:00100000:1.0:1788201581.234753:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559676928 00002000:00100000:1.0:1788201581.234836:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (627048448->628097023) req@ffff962492cb8700 x1875064559676928/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/0 e 0 to 0 dl 1788201592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201581.234850:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb8700 with x1875064559676928 ext(627048448->628097023) 00002000:00010000:1.0:1788201581.234857:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb8700 00000100:00100000:1.0:1788201581.236238:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 643 00000100:00100000:1.0:1788201581.236263:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559676928:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201581.245938:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559676928:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9655us (15505us total) trans 30064771644 rc 0/0 00000100:00100000:1.0:1788201581.245956:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 643 00002000:00100000:1.0:1788201581.245974:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (627048448->628097023) req@ffff962492cb8700 x1875064559676928/t30064771644(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/448 e 0 to 0 dl 1788201592 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201581.245987:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb8700 with x1875064559676928 ext(627048448->628097023) 00002000:00010000:1.0:1788201581.245997:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb8700 00000100:00100000:2.0:1788201581.326730:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201581.327008:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559677056 00000100:00100000:3.0:1788201581.327021:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559677056 00002000:00100000:3.0:1788201581.327092:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (628097024->629145599) req@ffff962492cbad80 x1875064559677056/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/0 e 0 to 0 dl 1788201592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201581.327106:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbad80 with x1875064559677056 ext(628097024->629145599) 00002000:00010000:3.0:1788201581.327112:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbad80 00000100:00100000:3.0:1788201581.327157:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 644 00000100:00100000:3.0:1788201581.327168:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559677056:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201581.341493:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559677056:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14309us (14762us total) trans 30064771645 rc 0/0 00000100:00100000:0.0:1788201581.341509:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 644 00002000:00100000:0.0:1788201581.341524:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (628097024->629145599) req@ffff962492cbad80 x1875064559677056/t30064771645(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/448 e 0 to 0 dl 1788201592 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201581.341553:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbad80 with x1875064559677056 ext(628097024->629145599) 00002000:00010000:0.0:1788201581.341561:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbad80 00010000:00010000:1.0:1788201581.367011:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201581.424056:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201581.424493:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559677184 00000100:00100000:2.0:1788201581.424509:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559677184 00002000:00100000:2.0:1788201581.424600:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (629145600->630194175) req@ffff9624c1e03100 x1875064559677184/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/0 e 0 to 0 dl 1788201592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201581.424618:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e03100 with x1875064559677184 ext(629145600->630194175) 00002000:00010000:2.0:1788201581.424628:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e03100 00000100:00100000:2.0:1788201581.424678:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 645 00000100:00100000:2.0:1788201581.424691:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2342:x1875064559677184:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201581.432435:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2342:x1875064559677184:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 7728us (8386us total) trans 30064771646 rc 0/0 00000100:00100000:2.0:1788201581.432454:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 645 00002000:00100000:2.0:1788201581.432471:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (629145600->630194175) req@ffff9624c1e03100 x1875064559677184/t30064771646(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/448 e 0 to 0 dl 1788201592 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201581.432509:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e03100 with x1875064559677184 ext(629145600->630194175) 00002000:00010000:2.0:1788201581.432517:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e03100 00000100:00100000:0.0:1788201581.524297:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201581.526423:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559677312 00000100:00100000:1.0:1788201581.526446:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559677312 00002000:00100000:1.0:1788201581.526528:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (630194176->631242751) req@ffff96248e361500 x1875064559677312/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/0 e 0 to 0 dl 1788201592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201581.526571:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361500 with x1875064559677312 ext(630194176->631242751) 00002000:00010000:1.0:1788201581.526579:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361500 00000100:00100000:1.0:1788201581.526638:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 646 00000100:00100000:1.0:1788201581.526650:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e361500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559677312:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201581.542031:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e361500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559677312:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15367us (17737us total) trans 30064771647 rc 0/0 00000100:00100000:1.0:1788201581.542050:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 646 00002000:00100000:1.0:1788201581.542067:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (630194176->631242751) req@ffff96248e361500 x1875064559677312/t30064771647(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/448 e 0 to 0 dl 1788201592 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201581.542078:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361500 with x1875064559677312 ext(630194176->631242751) 00002000:00010000:1.0:1788201581.542086:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361500 00000100:00100000:3.0:1788201581.657336:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201581.657788:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559677440 00000100:00100000:1.0:1788201581.657800:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559677440 00002000:00100000:2.0:1788201581.658110:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (631242752->632291327) req@ffff9624c1e00a80 x1875064559677440/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/0 e 0 to 0 dl 1788201592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201581.658124:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00a80 with x1875064559677440 ext(631242752->632291327) 00002000:00010000:2.0:1788201581.658130:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00a80 00000100:00100000:2.0:1788201581.658208:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 647 00000100:00100000:2.0:1788201581.658219:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559677440:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201581.681303:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559677440:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23073us (23968us total) trans 30064771648 rc 0/0 00000100:00100000:1.0:1788201581.681318:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 647 00002000:00100000:1.0:1788201581.681331:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (631242752->632291327) req@ffff9624c1e00a80 x1875064559677440/t30064771648(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/448 e 0 to 0 dl 1788201592 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201581.681371:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00a80 with x1875064559677440 ext(631242752->632291327) 00002000:00010000:1.0:1788201581.681378:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00a80 00000100:00100000:0.0:1788201581.839474:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201581.839593:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559677568 00000100:00100000:2.0:1788201581.839605:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559677568 00002000:00100000:2.0:1788201581.839675:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (632291328->633339903) req@ffff96248e361c00 x1875064559677568/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/0 e 0 to 0 dl 1788201592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201581.839688:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361c00 with x1875064559677568 ext(632291328->633339903) 00002000:00010000:2.0:1788201581.839693:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361c00 00000100:00100000:2.0:1788201581.839827:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 648 00000100:00100000:2.0:1788201581.839838:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248e361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559677568:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201581.862296:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248e361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559677568:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22447us (22824us total) trans 30064771649 rc 0/0 00000100:00100000:0.0:1788201581.862310:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 648 00002000:00100000:0.0:1788201581.862326:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (632291328->633339903) req@ffff96248e361c00 x1875064559677568/t30064771649(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:702/0 lens 488/448 e 0 to 0 dl 1788201592 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201581.862338:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248e361c00 with x1875064559677568 ext(632291328->633339903) 00002000:00010000:0.0:1788201581.862372:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248e361c00 00000100:00100000:3.0:1788201582.091401:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201582.092549:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559677696 00000100:00100000:2.0:1788201582.092564:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559677696 00002000:00100000:2.0:1788201582.092636:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (633339904->634388479) req@ffff9624c1e03b80 x1875064559677696/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:703/0 lens 488/0 e 0 to 0 dl 1788201593 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201582.092650:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e03b80 with x1875064559677696 ext(633339904->634388479) 00002000:00010000:2.0:1788201582.092658:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e03b80 00000100:00100000:2.0:1788201582.092733:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 649 00000100:00100000:2.0:1788201582.092746:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559677696:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201582.122378:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559677696:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29590us (30957us total) trans 30064771650 rc 0/0 00000100:00100000:0.0:1788201582.123974:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 649 00002000:00100000:0.0:1788201582.123995:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (633339904->634388479) req@ffff9624c1e03b80 x1875064559677696/t30064771650(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:703/0 lens 488/448 e 0 to 0 dl 1788201593 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201582.124008:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e03b80 with x1875064559677696 ext(633339904->634388479) 00002000:00010000:0.0:1788201582.124016:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e03b80 00000100:00100000:3.0:1788201582.380114:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201582.380396:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559677824 00000100:00100000:1.0:1788201582.380409:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559677824 00002000:00100000:1.0:1788201582.380476:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (634388480->635437055) req@ffff9624c1e01880 x1875064559677824/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:703/0 lens 488/0 e 0 to 0 dl 1788201593 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201582.380506:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e01880 with x1875064559677824 ext(634388480->635437055) 00002000:00010000:1.0:1788201582.380513:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e01880 00000100:00100000:1.0:1788201582.380561:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 650 00000100:00100000:1.0:1788201582.380571:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559677824:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:1.0:1788201582.393306:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201582.407187:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559677824:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26597us (27068us total) trans 30064771651 rc 0/0 00000100:00100000:0.0:1788201582.407206:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 650 00002000:00100000:0.0:1788201582.407226:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (634388480->635437055) req@ffff9624c1e01880 x1875064559677824/t30064771651(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:703/0 lens 488/448 e 0 to 0 dl 1788201593 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201582.407265:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e01880 with x1875064559677824 ext(634388480->635437055) 00002000:00010000:0.0:1788201582.407273:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e01880 00000100:00100000:2.0:1788201582.613973:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201582.614333:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559677952 00000100:00100000:1.0:1788201582.614385:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559677952 00002000:00100000:1.0:1788201582.614449:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (635437056->636485631) req@ffff962492cbb800 x1875064559677952/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:703/0 lens 488/0 e 0 to 0 dl 1788201593 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201582.614462:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbb800 with x1875064559677952 ext(635437056->636485631) 00002000:00010000:1.0:1788201582.614470:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbb800 00000100:00100000:1.0:1788201582.614511:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 651 00000100:00100000:1.0:1788201582.614522:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559677952:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201582.647096:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201582.647131:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570149504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201582.647228:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201582.647679:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570149504 00000100:00100000:0.0:1788201582.647699:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570149504 00000100:00100000:0.0:1788201582.647787:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788201582.647799:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570149504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201582.647827:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 568655872 pending 40894464 free 3248488448 avail 3246391296 00000100:00100000:0.0:1788201582.647879:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570149504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201582.647895:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788201582.647998:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570149504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201582.648677:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559677952:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34149us (34716us total) trans 30064771652 rc 0/0 00000100:00100000:1.0:1788201582.648687:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 651 00002000:00100000:1.0:1788201582.648698:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (635437056->636485631) req@ffff962492cbb800 x1875064559677952/t30064771652(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:703/0 lens 488/448 e 0 to 0 dl 1788201593 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201582.648709:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbb800 with x1875064559677952 ext(635437056->636485631) 00002000:00010000:1.0:1788201582.648716:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbb800 00000100:00080000:3.0:1788201582.648933:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201582.813097:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201582.815652:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559678080 00000100:00100000:0.0:1788201582.815670:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559678080 00002000:00100000:0.0:1788201582.816566:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (636485632->637534207) req@ffff9624c1e02300 x1875064559678080/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:703/0 lens 488/0 e 0 to 0 dl 1788201593 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201582.816581:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02300 with x1875064559678080 ext(636485632->637534207) 00002000:00010000:0.0:1788201582.816588:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02300 00000100:00100000:0.0:1788201582.816652:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 652 00000100:00100000:0.0:1788201582.816665:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559678080:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201582.831548:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559678080:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14869us (18453us total) trans 30064771653 rc 0/0 00000100:00100000:0.0:1788201582.831565:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 652 00002000:00100000:0.0:1788201582.831582:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (636485632->637534207) req@ffff9624c1e02300 x1875064559678080/t30064771653(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:703/0 lens 488/448 e 0 to 0 dl 1788201593 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201582.831607:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02300 with x1875064559678080 ext(636485632->637534207) 00002000:00010000:0.0:1788201582.831615:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02300 00000100:00100000:3.0:1788201582.990305:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201582.990555:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559678208 00000100:00100000:0.0:1788201582.990568:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559678208 00002000:00100000:0.0:1788201582.990636:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (637534208->638582783) req@ffff9624c1e01500 x1875064559678208/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:703/0 lens 488/0 e 0 to 0 dl 1788201593 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201582.990649:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e01500 with x1875064559678208 ext(637534208->638582783) 00002000:00010000:0.0:1788201582.990656:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e01500 00000100:00100000:0.0:1788201582.990705:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 653 00000100:00100000:0.0:1788201582.990716:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559678208:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201583.024966:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559678208:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34233us (34661us total) trans 30064771654 rc 0/0 00000100:00100000:0.0:1788201583.024984:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 653 00002000:00100000:0.0:1788201583.024999:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (637534208->638582783) req@ffff9624c1e01500 x1875064559678208/t30064771654(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:703/0 lens 488/448 e 0 to 0 dl 1788201593 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201583.025010:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e01500 with x1875064559678208 ext(637534208->638582783) 00002000:00010000:0.0:1788201583.025017:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e01500 00000001:00080000:3.0:1788201583.291549:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771654 is committed 00000100:00100000:2.0:1788201583.312080:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201583.312205:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559678336 00000100:00100000:1.0:1788201583.312216:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559678336 00002000:00100000:1.0:1788201583.312306:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (638582784->639631359) req@ffff962492cbbb80 x1875064559678336/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:704/0 lens 488/0 e 0 to 0 dl 1788201594 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201583.312386:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbbb80 with x1875064559678336 ext(638582784->639631359) 00002000:00010000:1.0:1788201583.312396:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbbb80 00000100:00100000:1.0:1788201583.312427:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 654 00000100:00100000:1.0:1788201583.312440:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559678336:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201583.312771:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201583.347156:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559678336:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34697us (35082us total) trans 30064771655 rc 0/0 00000100:00100000:0.0:1788201583.347175:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 654 00002000:00100000:0.0:1788201583.347191:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (638582784->639631359) req@ffff962492cbbb80 x1875064559678336/t30064771655(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:704/0 lens 488/448 e 0 to 0 dl 1788201594 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201583.347230:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbbb80 with x1875064559678336 ext(638582784->639631359) 00002000:00010000:0.0:1788201583.347238:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbbb80 00010000:00010000:0.0:1788201583.417852:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201583.502584:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201583.509008:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559678464 00000100:00100000:1.0:1788201583.509031:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559678464 00002000:00100000:1.0:1788201583.509118:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (639631360->640679935) req@ffff9624c1e00380 x1875064559678464/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:704/0 lens 488/0 e 0 to 0 dl 1788201594 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201583.509132:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00380 with x1875064559678464 ext(639631360->640679935) 00002000:00010000:1.0:1788201583.509617:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00380 00000100:00100000:1.0:1788201583.509671:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 655 00000100:00100000:1.0:1788201583.509695:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559678464:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201583.539516:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559678464:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29813us (36926us total) trans 30064771656 rc 0/0 00000100:00100000:0.0:1788201583.539535:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 655 00002000:00100000:0.0:1788201583.539553:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (639631360->640679935) req@ffff9624c1e00380 x1875064559678464/t30064771656(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:704/0 lens 488/448 e 0 to 0 dl 1788201594 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201583.539565:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00380 with x1875064559678464 ext(639631360->640679935) 00002000:00010000:0.0:1788201583.539573:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00380 00000100:00100000:2.0:1788201583.651488:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201583.651592:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559678592 00000100:00100000:0.0:1788201583.651604:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559678592 00002000:00100000:0.0:1788201583.651680:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (640679936->641728511) req@ffff962492cb8380 x1875064559678592/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:704/0 lens 488/0 e 0 to 0 dl 1788201594 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201583.651692:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb8380 with x1875064559678592 ext(640679936->641728511) 00002000:00010000:0.0:1788201583.651699:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb8380 00000100:00100000:0.0:1788201583.651742:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 656 00000100:00100000:0.0:1788201583.651754:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559678592:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201583.668682:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559678592:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16913us (17192us total) trans 30064771657 rc 0/0 00000100:00100000:0.0:1788201583.668699:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 656 00002000:00100000:0.0:1788201583.668713:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (640679936->641728511) req@ffff962492cb8380 x1875064559678592/t30064771657(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:704/0 lens 488/448 e 0 to 0 dl 1788201594 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201583.668749:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb8380 with x1875064559678592 ext(640679936->641728511) 00002000:00010000:0.0:1788201583.668756:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb8380 00000100:00100000:3.0:1788201583.810315:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201583.810490:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559678720 00000100:00100000:0.0:1788201583.810502:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559678720 00002000:00100000:0.0:1788201583.810568:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (641728512->642777087) req@ffff9624c1e03480 x1875064559678720/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:704/0 lens 488/0 e 0 to 0 dl 1788201594 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201583.810581:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e03480 with x1875064559678720 ext(641728512->642777087) 00002000:00010000:0.0:1788201583.810588:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e03480 00000100:00100000:0.0:1788201583.810686:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 657 00000100:00100000:0.0:1788201583.810698:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559678720:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201583.826704:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559678720:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15990us (16386us total) trans 30064771658 rc 0/0 00000100:00100000:0.0:1788201583.826722:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 657 00002000:00100000:0.0:1788201583.826738:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (641728512->642777087) req@ffff9624c1e03480 x1875064559678720/t30064771658(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:704/0 lens 488/448 e 0 to 0 dl 1788201594 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201583.826750:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e03480 with x1875064559678720 ext(641728512->642777087) 00002000:00010000:0.0:1788201583.826757:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e03480 00000100:00100000:3.0:1788201584.110914:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201584.111218:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559678848 00000100:00100000:2.0:1788201584.111231:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559678848 00002000:00100000:2.0:1788201584.111294:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (642777088->643825663) req@ffff9624c1e00000 x1875064559678848/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:705/0 lens 488/0 e 0 to 0 dl 1788201595 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201584.111308:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00000 with x1875064559678848 ext(642777088->643825663) 00002000:00010000:2.0:1788201584.111315:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00000 00000100:00100000:2.0:1788201584.111395:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 658 00000100:00100000:2.0:1788201584.111407:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559678848:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201584.128999:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559678848:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17577us (18082us total) trans 30064771659 rc 0/0 00000100:00100000:3.0:1788201584.129016:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 658 00002000:00100000:3.0:1788201584.129030:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (642777088->643825663) req@ffff9624c1e00000 x1875064559678848/t30064771659(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:705/0 lens 488/448 e 0 to 0 dl 1788201595 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201584.129042:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00000 with x1875064559678848 ext(642777088->643825663) 00002000:00010000:3.0:1788201584.129049:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00000 00000100:00100000:1.0:1788201584.320803:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201584.321904:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559678976 00000100:00100000:2.0:1788201584.321920:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559678976 00002000:00100000:2.0:1788201584.322545:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (643825664->644874239) req@ffff9623939cdf80 x1875064559678976/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:705/0 lens 488/0 e 0 to 0 dl 1788201595 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201584.322562:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cdf80 with x1875064559678976 ext(643825664->644874239) 00002000:00010000:2.0:1788201584.322569:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cdf80 00000100:00100000:2.0:1788201584.322622:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 659 00000100:00100000:2.0:1788201584.322634:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559678976:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201584.356051:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559678976:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33401us (35247us total) trans 30064771660 rc 0/0 00000100:00100000:2.0:1788201584.356069:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 659 00002000:00100000:2.0:1788201584.356107:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (643825664->644874239) req@ffff9623939cdf80 x1875064559678976/t30064771660(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:705/0 lens 488/448 e 0 to 0 dl 1788201595 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201584.356119:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cdf80 with x1875064559678976 ext(643825664->644874239) 00002000:00010000:2.0:1788201584.356127:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cdf80 00000100:00100000:1.0:1788201584.437132:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201584.437217:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201584.437589:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559679104 00000100:00100000:0.0:1788201584.437604:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559679104 00000100:00100000:0.0:1788201584.437701:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 548 00000100:00100000:0.0:1788201584.437715:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559679104:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201584.437826:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559679104:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 114us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201584.437857:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 548 00010000:00010000:1.0:1788201584.438918:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201584.441435:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559679232 00000100:00100000:2.0:1788201584.441456:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559679232 00000100:00100000:2.0:1788201584.441578:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 411 00000100:00100000:2.0:1788201584.441591:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559679232:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201584.441785:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559679232:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 196us (4567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201584.441794:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 411 00000100:00080000:3.0:1788201584.442222:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201584.529545:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201584.529674:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559679360 00000100:00100000:0.0:1788201584.529687:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559679360 00002000:00100000:0.0:1788201584.529756:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (644874240->645922815) req@ffff9623939cc000 x1875064559679360/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:705/0 lens 488/0 e 0 to 0 dl 1788201595 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201584.529770:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cc000 with x1875064559679360 ext(644874240->645922815) 00002000:00010000:0.0:1788201584.529777:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cc000 00000100:00100000:0.0:1788201584.529819:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 660 00000100:00100000:0.0:1788201584.529831:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559679360:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201584.552431:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559679360:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22581us (22882us total) trans 30064771661 rc 0/0 00000100:00100000:0.0:1788201584.552450:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 660 00002000:00100000:0.0:1788201584.552469:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (644874240->645922815) req@ffff9623939cc000 x1875064559679360/t30064771661(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:705/0 lens 488/448 e 0 to 0 dl 1788201595 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201584.552482:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cc000 with x1875064559679360 ext(644874240->645922815) 00002000:00010000:0.0:1788201584.552490:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cc000 00000100:00100000:1.0:1788201584.707982:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201584.710999:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559679488 00000100:00100000:0.0:1788201584.711021:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559679488 00002000:00100000:0.0:1788201584.711100:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (645922816->646971391) req@ffff9623939cce00 x1875064559679488/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:705/0 lens 488/0 e 0 to 0 dl 1788201595 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201584.711113:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cce00 with x1875064559679488 ext(645922816->646971391) 00002000:00010000:0.0:1788201584.711121:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cce00 00000100:00100000:0.0:1788201584.711329:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 661 00000100:00100000:0.0:1788201584.711381:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559679488:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201584.732497:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559679488:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21103us (24514us total) trans 30064771662 rc 0/0 00000100:00100000:0.0:1788201584.732517:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 661 00002000:00100000:0.0:1788201584.732533:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (645922816->646971391) req@ffff9623939cce00 x1875064559679488/t30064771662(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:705/0 lens 488/448 e 0 to 0 dl 1788201595 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201584.732545:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cce00 with x1875064559679488 ext(645922816->646971391) 00002000:00010000:0.0:1788201584.732553:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cce00 00000100:00100000:3.0:1788201584.845890:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201584.846089:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559679616 00000100:00100000:2.0:1788201584.846101:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559679616 00002000:00100000:2.0:1788201584.846170:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (646971392->648019967) req@ffff9624c1e00e00 x1875064559679616/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:705/0 lens 488/0 e 0 to 0 dl 1788201595 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201584.846184:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00e00 with x1875064559679616 ext(646971392->648019967) 00002000:00010000:2.0:1788201584.846191:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00e00 00000100:00100000:2.0:1788201584.846235:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 662 00000100:00100000:2.0:1788201584.846247:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559679616:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201584.864276:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559679616:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18015us (18385us total) trans 30064771663 rc 0/0 00000100:00100000:2.0:1788201584.864296:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 662 00002000:00100000:2.0:1788201584.864314:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (646971392->648019967) req@ffff9624c1e00e00 x1875064559679616/t30064771663(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:705/0 lens 488/448 e 0 to 0 dl 1788201595 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201584.864382:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e00e00 with x1875064559679616 ext(646971392->648019967) 00002000:00010000:2.0:1788201584.864391:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e00e00 00000100:00100000:1.0:1788201585.129697:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201585.129938:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559679744 00000100:00100000:2.0:1788201585.129954:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559679744 00002000:00100000:2.0:1788201585.130060:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (648019968->649068543) req@ffff9623939ce680 x1875064559679744/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:706/0 lens 488/0 e 0 to 0 dl 1788201596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201585.130074:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939ce680 with x1875064559679744 ext(648019968->649068543) 00002000:00010000:2.0:1788201585.130081:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939ce680 00000100:00100000:2.0:1788201585.130135:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 663 00000100:00100000:2.0:1788201585.130148:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559679744:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201585.132006:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201585.157907:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559679744:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27745us (28208us total) trans 30064771664 rc 0/0 00000100:00100000:2.0:1788201585.157927:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 663 00002000:00100000:2.0:1788201585.157942:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (648019968->649068543) req@ffff9623939ce680 x1875064559679744/t30064771664(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:706/0 lens 488/448 e 0 to 0 dl 1788201596 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201585.157953:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939ce680 with x1875064559679744 ext(648019968->649068543) 00002000:00010000:2.0:1788201585.157961:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939ce680 00000100:00100000:3.0:1788201585.206874:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570149632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201585.207006:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201585.207475:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570149632 00000100:00100000:0.0:1788201585.207484:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570149632 00000100:00100000:0.0:1788201585.207561:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788201585.207573:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570149632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201585.207621:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201585.207698:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570149632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201585.207706:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00010000:00080000:1.0:1788201585.207838:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba116300 x1875064570149632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201585.207871:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570149632:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201585.208021:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201585.452007:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201585.452134:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559679872 00000100:00100000:0.0:1788201585.452152:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559679872 00002000:00100000:0.0:1788201585.452223:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (649068544->650117119) req@ffff9623939ced80 x1875064559679872/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:706/0 lens 488/0 e 0 to 0 dl 1788201596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201585.452237:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939ced80 with x1875064559679872 ext(649068544->650117119) 00002000:00010000:0.0:1788201585.452244:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939ced80 00000100:00100000:0.0:1788201585.452287:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 664 00000100:00100000:0.0:1788201585.452297:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559679872:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:1.0:1788201585.477939:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201585.482105:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559679872:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29791us (30091us total) trans 30064771665 rc 0/0 00000100:00100000:0.0:1788201585.482123:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 664 00002000:00100000:0.0:1788201585.482140:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (649068544->650117119) req@ffff9623939ced80 x1875064559679872/t30064771665(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:706/0 lens 488/448 e 0 to 0 dl 1788201596 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201585.482152:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939ced80 with x1875064559679872 ext(649068544->650117119) 00002000:00010000:0.0:1788201585.482159:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939ced80 00000100:00100000:2.0:1788201585.563033:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201585.563291:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559680000 00000100:00100000:0.0:1788201585.563308:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559680000 00002000:00100000:0.0:1788201585.563423:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (650117120->651165695) req@ffff962492cbb100 x1875064559680000/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:706/0 lens 488/0 e 0 to 0 dl 1788201596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201585.563438:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbb100 with x1875064559680000 ext(650117120->651165695) 00002000:00010000:0.0:1788201585.563445:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbb100 00000100:00100000:0.0:1788201585.563490:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 665 00000100:00100000:0.0:1788201585.563501:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559680000:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201585.600538:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2341:x1875064559680000:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37023us (37506us total) trans 30064771666 rc 0/0 00000100:00100000:2.0:1788201585.600555:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 665 00002000:00100000:2.0:1788201585.600570:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (650117120->651165695) req@ffff962492cbb100 x1875064559680000/t30064771666(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:706/0 lens 488/448 e 0 to 0 dl 1788201596 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201585.600606:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbb100 with x1875064559680000 ext(650117120->651165695) 00002000:00010000:2.0:1788201585.600614:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbb100 00000100:00100000:0.0:1788201585.681309:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201585.681398:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559680128 00000100:00100000:2.0:1788201585.681410:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559680128 00002000:00100000:2.0:1788201585.681471:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (651165696->652214271) req@ffff9624ba114700 x1875064559680128/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:706/0 lens 488/0 e 0 to 0 dl 1788201596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201585.681484:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba114700 with x1875064559680128 ext(651165696->652214271) 00002000:00010000:2.0:1788201585.681491:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba114700 00000100:00100000:2.0:1788201585.681532:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 666 00000100:00100000:2.0:1788201585.681544:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559680128:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201585.707994:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559680128:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26435us (26683us total) trans 30064771667 rc 0/0 00000100:00100000:2.0:1788201585.708013:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 666 00002000:00100000:2.0:1788201585.708029:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (651165696->652214271) req@ffff9624ba114700 x1875064559680128/t30064771667(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:706/0 lens 488/448 e 0 to 0 dl 1788201596 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201585.708042:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba114700 with x1875064559680128 ext(651165696->652214271) 00002000:00010000:2.0:1788201585.708049:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba114700 00000100:00100000:1.0:1788201585.719217:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570150016:0@lo:400:kworker.0 00000100:00100000:1.0:1788201585.719339:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201585.719449:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201585.719458:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570149888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201585.719495:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201585.719578:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570150144:0@lo:400:kworker.0 00000100:00100000:0.0:1788201585.719611:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201585.719647:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201585.719653:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570149760:0@lo:400:kworker.0 00000100:00100000:0.0:1788201585.719685:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201585.719707:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570150272:0@lo:400:kworker.0 00000100:00100000:0.0:1788201585.719732:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201585.719995:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570150016 00000100:00100000:3.0:1788201585.720003:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570150016 00000100:00100000:3.0:1788201585.720080:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788201585.720091:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570150016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.720171:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570150016:12345-0@lo:400:kworker.0 Request processed in 82us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201585.720180:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788201585.720214:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570149888 00000100:00100000:3.0:1788201585.720218:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570149888 00000100:00100000:3.0:1788201585.720245:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570150144 00000100:00100000:3.0:1788201585.720247:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570150144 00000100:00100000:3.0:1788201585.720260:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570150272 00000100:00100000:3.0:1788201585.720263:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570150272 00000100:00100000:3.0:1788201585.720275:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1788201585.720280:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570149888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.720311:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570149888:12345-0@lo:400:kworker.0 Request processed in 31us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201585.720318:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1788201585.720330:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1788201585.720336:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570150144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.720394:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570150144:12345-0@lo:400:kworker.0 Request processed in 59us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201585.720400:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1788201585.720413:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1788201585.720419:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570150272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.720461:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570150272:12345-0@lo:400:kworker.0 Request processed in 42us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201585.720467:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1788201585.720518:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570150272:0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.720529:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570150144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.720563:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570149888:0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.720574:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570150016:0@lo:400:kworker.0 00000100:00080000:0.0:1788201585.720814:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201585.720821:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201585.720966:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570149760 00000100:00100000:2.0:1788201585.720973:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570149760 00000100:00100000:2.0:1788201585.721019:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1788201585.721027:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570149760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201585.721083:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570149760:12345-0@lo:400:kworker.0 Request processed in 58us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201585.721102:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1788201585.722560:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570149760:0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.839127:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201585.839266:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559680256 00000100:00100000:2.0:1788201585.839279:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559680256 00002000:00100000:2.0:1788201585.839373:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (652214272->653262847) req@ffff9624c1e02a00 x1875064559680256/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:706/0 lens 488/0 e 0 to 0 dl 1788201596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201585.839387:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02a00 with x1875064559680256 ext(652214272->653262847) 00002000:00010000:2.0:1788201585.839395:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02a00 00000100:00100000:2.0:1788201585.839432:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 667 00000100:00100000:2.0:1788201585.839443:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559680256:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201585.864188:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559680256:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24731us (25062us total) trans 30064771668 rc 0/0 00000100:00100000:2.0:1788201585.864207:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 667 00002000:00100000:2.0:1788201585.864222:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (652214272->653262847) req@ffff9624c1e02a00 x1875064559680256/t30064771668(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:706/0 lens 488/448 e 0 to 0 dl 1788201596 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201585.864235:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e02a00 with x1875064559680256 ext(652214272->653262847) 00002000:00010000:2.0:1788201585.864242:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e02a00 00000100:00100000:1.0:1788201586.039034:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201586.039271:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559680384 00000100:00100000:0.0:1788201586.039284:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559680384 00002000:00100000:0.0:1788201586.039480:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (653262848->654311423) req@ffff962381955180 x1875064559680384/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:707/0 lens 488/0 e 0 to 0 dl 1788201597 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201586.039494:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955180 with x1875064559680384 ext(653262848->654311423) 00002000:00010000:0.0:1788201586.039501:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955180 00000100:00100000:0.0:1788201586.039646:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 668 00000100:00100000:0.0:1788201586.039660:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559680384:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201586.055368:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559680384:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15681us (16321us total) trans 30064771669 rc 0/0 00000100:00100000:0.0:1788201586.055386:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 668 00002000:00100000:0.0:1788201586.055403:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (653262848->654311423) req@ffff962381955180 x1875064559680384/t30064771669(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:707/0 lens 488/448 e 0 to 0 dl 1788201597 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201586.055414:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955180 with x1875064559680384 ext(653262848->654311423) 00002000:00010000:0.0:1788201586.055422:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955180 00000100:00100000:3.0:1788201586.295962:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201586.297648:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559680512 00000100:00100000:0.0:1788201586.297666:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559680512 00002000:00100000:0.0:1788201586.297741:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (654311424->655359999) req@ffff9623939cdc00 x1875064559680512/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:707/0 lens 488/0 e 0 to 0 dl 1788201597 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201586.297754:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cdc00 with x1875064559680512 ext(654311424->655359999) 00002000:00010000:0.0:1788201586.297761:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cdc00 00000100:00100000:0.0:1788201586.297806:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 669 00000100:00100000:0.0:1788201586.297818:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559680512:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201586.323309:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559680512:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25477us (27348us total) trans 30064771670 rc 0/0 00000100:00100000:2.0:1788201586.323328:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 669 00002000:00100000:2.0:1788201586.323368:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (654311424->655359999) req@ffff9623939cdc00 x1875064559680512/t30064771670(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:707/0 lens 488/448 e 0 to 0 dl 1788201597 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201586.323381:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cdc00 with x1875064559680512 ext(654311424->655359999) 00002000:00010000:2.0:1788201586.323389:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cdc00 00010000:00010000:0.0:1788201586.487139:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201586.511890:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201586.511983:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559680640 00000100:00100000:2.0:1788201586.511995:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559680640 00002000:00100000:2.0:1788201586.512058:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (655360000->656408575) req@ffff962381954700 x1875064559680640/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:707/0 lens 488/0 e 0 to 0 dl 1788201597 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201586.512070:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954700 with x1875064559680640 ext(655360000->656408575) 00002000:00010000:2.0:1788201586.512077:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954700 00000100:00100000:2.0:1788201586.512122:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 670 00000100:00100000:2.0:1788201586.512133:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559680640:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201586.527224:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2342:x1875064559680640:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15078us (15336us total) trans 30064771671 rc 0/0 00000100:00100000:2.0:1788201586.527240:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 670 00002000:00100000:2.0:1788201586.527255:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (655360000->656408575) req@ffff962381954700 x1875064559680640/t30064771671(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:707/0 lens 488/448 e 0 to 0 dl 1788201597 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201586.527267:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954700 with x1875064559680640 ext(655360000->656408575) 00002000:00010000:2.0:1788201586.527274:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954700 00000100:00100000:3.0:1788201586.720048:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201586.720320:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559680768 00000100:00100000:0.0:1788201586.720334:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559680768 00002000:00100000:0.0:1788201586.720443:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (656408576->657457151) req@ffff9623939cfb80 x1875064559680768/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:707/0 lens 488/0 e 0 to 0 dl 1788201597 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201586.720457:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cfb80 with x1875064559680768 ext(656408576->657457151) 00002000:00010000:0.0:1788201586.720464:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cfb80 00000100:00100000:0.0:1788201586.720501:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 671 00000100:00100000:0.0:1788201586.720512:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559680768:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201586.742948:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559680768:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22408us (22887us total) trans 30064771672 rc 0/0 00000100:00100000:2.0:1788201586.742967:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 671 00002000:00100000:2.0:1788201586.742987:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (656408576->657457151) req@ffff9623939cfb80 x1875064559680768/t30064771672(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:707/0 lens 488/448 e 0 to 0 dl 1788201597 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201586.743011:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cfb80 with x1875064559680768 ext(656408576->657457151) 00002000:00010000:2.0:1788201586.743020:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cfb80 00000100:00100000:1.0:1788201586.929748:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201586.929938:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559680896 00000100:00100000:0.0:1788201586.929951:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559680896 00002000:00100000:0.0:1788201586.930020:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (657457152->658505727) req@ffff962381954380 x1875064559680896/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:707/0 lens 488/0 e 0 to 0 dl 1788201597 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201586.930035:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954380 with x1875064559680896 ext(657457152->658505727) 00002000:00010000:0.0:1788201586.930042:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954380 00000100:00100000:0.0:1788201586.930100:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 672 00000100:00100000:0.0:1788201586.930112:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559680896:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201586.956701:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559680896:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26573us (26950us total) trans 30064771673 rc 0/0 00000100:00100000:2.0:1788201586.956739:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 672 00002000:00100000:2.0:1788201586.956754:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (657457152->658505727) req@ffff962381954380 x1875064559680896/t30064771673(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:707/0 lens 488/448 e 0 to 0 dl 1788201597 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201586.956765:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954380 with x1875064559680896 ext(657457152->658505727) 00002000:00010000:2.0:1788201586.956772:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954380 00000100:00100000:0.0:1788201587.160842:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201587.161024:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559681024 00000100:00100000:2.0:1788201587.161039:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559681024 00002000:00100000:2.0:1788201587.161129:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (658505728->659554303) req@ffff9624ba0d8380 x1875064559681024/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:708/0 lens 488/0 e 0 to 0 dl 1788201598 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201587.161143:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d8380 with x1875064559681024 ext(658505728->659554303) 00002000:00010000:2.0:1788201587.161150:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d8380 00000100:00100000:2.0:1788201587.161193:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 673 00000100:00100000:2.0:1788201587.161207:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559681024:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201587.161908:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201587.194639:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559681024:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33420us (33802us total) trans 30064771674 rc 0/0 00000100:00100000:2.0:1788201587.194656:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 673 00002000:00100000:2.0:1788201587.194672:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (658505728->659554303) req@ffff9624ba0d8380 x1875064559681024/t30064771674(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:708/0 lens 488/448 e 0 to 0 dl 1788201598 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201587.194686:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d8380 with x1875064559681024 ext(658505728->659554303) 00002000:00010000:2.0:1788201587.194694:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d8380 00000100:00100000:1.0:1788201587.284631:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201587.284925:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559681152 00000100:00100000:2.0:1788201587.284937:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559681152 00002000:00100000:2.0:1788201587.285003:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (659554304->660602879) req@ffff962381955f80 x1875064559681152/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:708/0 lens 488/0 e 0 to 0 dl 1788201598 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201587.285030:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955f80 with x1875064559681152 ext(659554304->660602879) 00002000:00010000:2.0:1788201587.285037:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955f80 00000100:00100000:2.0:1788201587.286042:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 674 00000100:00100000:2.0:1788201587.286071:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2341:x1875064559681152:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201587.296483:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2341:x1875064559681152:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10402us (11860us total) trans 30064771675 rc 0/0 00000100:00100000:2.0:1788201587.296500:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 674 00002000:00100000:2.0:1788201587.296516:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (659554304->660602879) req@ffff962381955f80 x1875064559681152/t30064771675(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:708/0 lens 488/448 e 0 to 0 dl 1788201598 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201587.296530:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955f80 with x1875064559681152 ext(659554304->660602879) 00002000:00010000:2.0:1788201587.296538:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955f80 00000100:00100000:3.0:1788201587.372959:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201587.373187:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559681280 00000100:00100000:2.0:1788201587.373199:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559681280 00002000:00100000:2.0:1788201587.373264:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (660602880->661651455) req@ffff9623939cf100 x1875064559681280/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:708/0 lens 488/0 e 0 to 0 dl 1788201598 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201587.373278:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cf100 with x1875064559681280 ext(660602880->661651455) 00002000:00010000:2.0:1788201587.373285:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cf100 00000100:00100000:2.0:1788201587.373483:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 675 00000100:00100000:2.0:1788201587.373496:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559681280:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201587.406136:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559681280:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32624us (33178us total) trans 30064771676 rc 0/0 00000100:00100000:2.0:1788201587.406153:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 675 00002000:00100000:2.0:1788201587.406191:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (660602880->661651455) req@ffff9623939cf100 x1875064559681280/t30064771676(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:708/0 lens 488/448 e 0 to 0 dl 1788201598 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201587.406203:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939cf100 with x1875064559681280 ext(660602880->661651455) 00002000:00010000:2.0:1788201587.406211:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939cf100 00000100:00100000:1.0:1788201587.506690:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201587.507183:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559681408 00000100:00100000:0.0:1788201587.507195:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559681408 00002000:00100000:0.0:1788201587.507268:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (661651456->662700031) req@ffff962381957480 x1875064559681408/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:708/0 lens 488/0 e 0 to 0 dl 1788201598 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201587.507282:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381957480 with x1875064559681408 ext(661651456->662700031) 00002000:00010000:0.0:1788201587.507308:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381957480 00000100:00100000:0.0:1788201587.507425:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 676 00000100:00100000:0.0:1788201587.507437:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2341:x1875064559681408:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:1.0:1788201587.510992:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201587.537642:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2341:x1875064559681408:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30191us (30952us total) trans 30064771677 rc 0/0 00000100:00100000:2.0:1788201587.537660:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 676 00002000:00100000:2.0:1788201587.537675:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (661651456->662700031) req@ffff962381957480 x1875064559681408/t30064771677(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:708/0 lens 488/448 e 0 to 0 dl 1788201598 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201587.537688:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381957480 with x1875064559681408 ext(661651456->662700031) 00002000:00010000:2.0:1788201587.537695:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381957480 00000100:00100000:1.0:1788201587.767051:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201587.767088:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570150400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201587.767190:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201587.767360:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570150400 00000100:00100000:0.0:1788201587.767371:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570150400 00000100:00100000:0.0:1788201587.767467:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00080000:3.0:1788201587.767471:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201587.767480:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570150400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201587.767513:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3407872 granted 568655872 pending 39190528 free 3221225472 avail 3219128320 00000100:00100000:0.0:1788201587.767574:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570150400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201587.767582:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788201587.767700:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570150400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201587.796613:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201587.796742:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559681536 00000100:00100000:2.0:1788201587.796758:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559681536 00002000:00100000:2.0:1788201587.796897:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (662700032->663748607) req@ffff9624ba0d9500 x1875064559681536/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:708/0 lens 488/0 e 0 to 0 dl 1788201598 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201587.796909:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d9500 with x1875064559681536 ext(662700032->663748607) 00002000:00010000:2.0:1788201587.796915:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d9500 00000100:00100000:3.0:1788201587.797396:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 677 00000100:00100000:3.0:1788201587.797411:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559681536:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201587.830643:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559681536:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33226us (34036us total) trans 30064771678 rc 0/0 00000100:00100000:3.0:1788201587.830658:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 677 00002000:00100000:3.0:1788201587.830672:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (662700032->663748607) req@ffff9624ba0d9500 x1875064559681536/t30064771678(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:708/0 lens 488/448 e 0 to 0 dl 1788201598 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201587.830682:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d9500 with x1875064559681536 ext(662700032->663748607) 00002000:00010000:3.0:1788201587.830702:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d9500 00000100:00100000:0.0:1788201588.023513:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201588.023647:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559681664 00000100:00100000:2.0:1788201588.023659:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559681664 00002000:00100000:2.0:1788201588.023724:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (501190656->664543231) req@ffff9624ba0d8700 x1875064559681664/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:709/0 lens 504/0 e 0 to 0 dl 1788201599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201588.023738:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d8700 with x1875064559681664 ext(501190656->664543231) 00002000:00010000:2.0:1788201588.023745:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d8700 00000100:00100000:2.0:1788201588.023782:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 678 00000100:00100000:2.0:1788201588.023826:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559681664:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201588.080232:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559681664:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 56389us (56716us total) trans 30064771679 rc 0/0 00000100:00100000:2.0:1788201588.080250:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 678 00002000:00100000:2.0:1788201588.080267:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (501190656->664543231) req@ffff9624ba0d8700 x1875064559681664/t30064771679(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:709/0 lens 504/448 e 0 to 0 dl 1788201599 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201588.080280:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0d8700 with x1875064559681664 ext(501190656->664543231) 00002000:00010000:2.0:1788201588.081608:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0d8700 00000100:00100000:3.0:1788201588.376114:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201588.376277:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559681792 00000100:00100000:2.0:1788201588.376289:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559681792 00002000:00100000:2.0:1788201588.376393:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (664797184->665845759) req@ffff962381a0ca80 x1875064559681792/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:709/0 lens 488/0 e 0 to 0 dl 1788201599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201588.376406:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0ca80 with x1875064559681792 ext(664797184->665845759) 00002000:00010000:2.0:1788201588.376414:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0ca80 00000100:00100000:2.0:1788201588.376456:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 679 00000100:00100000:2.0:1788201588.376470:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559681792:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201588.408027:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2344:x1875064559681792:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31543us (31905us total) trans 30064771680 rc 0/0 00000100:00100000:0.0:1788201588.408045:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 679 00002000:00100000:0.0:1788201588.408064:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (664797184->665845759) req@ffff962381a0ca80 x1875064559681792/t30064771680(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:709/0 lens 488/448 e 0 to 0 dl 1788201599 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201588.408076:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0ca80 with x1875064559681792 ext(664797184->665845759) 00002000:00010000:0.0:1788201588.408081:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0ca80 00000001:00080000:3.0:1788201588.525285:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771669 is committed 00000001:00080000:3.0:1788201588.525382:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771679 is committed 00010000:00010000:1.0:1788201588.535984:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201588.718865:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201588.719058:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559681920 00000100:00100000:3.0:1788201588.719069:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559681920 00002000:00100000:3.0:1788201588.719124:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (665845760->666894335) req@ffff962492cbaa00 x1875064559681920/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:709/0 lens 488/0 e 0 to 0 dl 1788201599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201588.719137:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbaa00 with x1875064559681920 ext(665845760->666894335) 00002000:00010000:3.0:1788201588.719142:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbaa00 00000100:00100000:3.0:1788201588.719177:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 680 00000100:00100000:3.0:1788201588.719188:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559681920:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201588.744479:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559681920:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25276us (25609us total) trans 30064771681 rc 0/0 00000100:00100000:3.0:1788201588.744497:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 680 00002000:00100000:3.0:1788201588.744511:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (665845760->666894335) req@ffff962492cbaa00 x1875064559681920/t30064771681(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:709/0 lens 488/448 e 0 to 0 dl 1788201599 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201588.744524:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cbaa00 with x1875064559681920 ext(665845760->666894335) 00002000:00010000:3.0:1788201588.744532:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cbaa00 00000100:00100000:2.0:1788201588.919237:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201588.919449:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559682048 00000100:00100000:3.0:1788201588.919461:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559682048 00002000:00100000:3.0:1788201588.919529:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (666894336->667942911) req@ffff962492cb9c00 x1875064559682048/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:709/0 lens 488/0 e 0 to 0 dl 1788201599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201588.919542:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb9c00 with x1875064559682048 ext(666894336->667942911) 00002000:00010000:3.0:1788201588.919550:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb9c00 00000100:00100000:3.0:1788201588.920113:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 681 00000100:00100000:3.0:1788201588.920126:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962492cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559682048:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201588.940508:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962492cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559682048:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20361us (21264us total) trans 30064771682 rc 0/0 00000100:00100000:0.0:1788201588.940529:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 681 00002000:00100000:0.0:1788201588.940550:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (666894336->667942911) req@ffff962492cb9c00 x1875064559682048/t30064771682(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:709/0 lens 488/448 e 0 to 0 dl 1788201599 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201588.940615:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962492cb9c00 with x1875064559682048 ext(666894336->667942911) 00002000:00010000:0.0:1788201588.940623:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962492cb9c00 00000100:00100000:2.0:1788201589.102506:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201589.102585:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559682176 00000100:00100000:3.0:1788201589.102597:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559682176 00002000:00100000:3.0:1788201589.102740:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (667942912->668991487) req@ffff9624c1e70000 x1875064559682176/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:710/0 lens 488/0 e 0 to 0 dl 1788201600 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201589.102752:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70000 with x1875064559682176 ext(667942912->668991487) 00002000:00010000:3.0:1788201589.102758:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70000 00000100:00100000:3.0:1788201589.102806:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 682 00000100:00100000:3.0:1788201589.102819:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2341:x1875064559682176:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201589.109197:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201589.141368:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2341:x1875064559682176:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 38450us (38776us total) trans 30064771683 rc 0/0 00000100:00100000:3.0:1788201589.141389:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 682 00002000:00100000:3.0:1788201589.141406:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (667942912->668991487) req@ffff9624c1e70000 x1875064559682176/t30064771683(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:710/0 lens 488/448 e 0 to 0 dl 1788201600 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201589.141418:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70000 with x1875064559682176 ext(667942912->668991487) 00002000:00010000:3.0:1788201589.141425:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70000 00000100:00100000:0.0:1788201589.274482:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201589.275924:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559682304 00000100:00100000:2.0:1788201589.275948:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559682304 00002000:00100000:2.0:1788201589.276230:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (668991488->670040063) req@ffff9624ba0db800 x1875064559682304/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:710/0 lens 488/0 e 0 to 0 dl 1788201600 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201589.276244:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0db800 with x1875064559682304 ext(668991488->670040063) 00002000:00010000:2.0:1788201589.276277:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0db800 00000100:00100000:2.0:1788201589.276322:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 683 00000100:00100000:2.0:1788201589.276334:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559682304:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201589.303040:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559682304:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26679us (28543us total) trans 30064771684 rc 0/0 00000100:00100000:2.0:1788201589.305657:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 683 00002000:00100000:2.0:1788201589.305678:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (668991488->670040063) req@ffff9624ba0db800 x1875064559682304/t30064771684(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:710/0 lens 488/448 e 0 to 0 dl 1788201600 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201589.305691:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0db800 with x1875064559682304 ext(668991488->670040063) 00002000:00010000:2.0:1788201589.305698:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0db800 00010000:00010000:0.0:1788201589.558651:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201589.565093:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201589.565135:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201589.565250:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559682432 00000100:00100000:1.0:1788201589.565266:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559682432 00000100:00100000:1.0:1788201589.565441:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 550 00000100:00100000:1.0:1788201589.565457:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559682432:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201589.565461:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559682560 00000100:00100000:3.0:1788201589.565473:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559682560 00000100:00100000:3.0:1788201589.565545:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 415 00000100:00100000:3.0:1788201589.565556:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559682560:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201589.565574:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559682432:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 121us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201589.565583:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 550 00000100:00080000:0.0:1788201589.566024:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201589.568524:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559682560:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 2957us (3375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201589.568541:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 415 00000100:00100000:0.0:1788201589.685401:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201589.685634:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559682688 00000100:00100000:2.0:1788201589.685648:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559682688 00002000:00100000:2.0:1788201589.685723:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (670040064->671088639) req@ffff9624ba0db100 x1875064559682688/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:710/0 lens 488/0 e 0 to 0 dl 1788201600 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201589.685738:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0db100 with x1875064559682688 ext(670040064->671088639) 00002000:00010000:2.0:1788201589.685745:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0db100 00000100:00100000:2.0:1788201589.685795:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 684 00000100:00100000:2.0:1788201589.685808:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba0db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559682688:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201589.696862:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba0db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559682688:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11038us (11459us total) trans 30064771685 rc 0/0 00000100:00100000:2.0:1788201589.696881:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 684 00002000:00100000:2.0:1788201589.696898:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (670040064->671088639) req@ffff9624ba0db100 x1875064559682688/t30064771685(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:710/0 lens 488/448 e 0 to 0 dl 1788201600 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201589.696948:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba0db100 with x1875064559682688 ext(670040064->671088639) 00002000:00010000:2.0:1788201589.696956:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba0db100 00000100:00100000:3.0:1788201589.750878:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201589.762476:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559682816 00000100:00100000:0.0:1788201589.762498:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559682816 00002000:00100000:0.0:1788201589.762585:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (671088640->672137215) req@ffff962381a0c380 x1875064559682816/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:710/0 lens 488/0 e 0 to 0 dl 1788201600 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201589.762599:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0c380 with x1875064559682816 ext(671088640->672137215) 00002000:00010000:0.0:1788201589.762605:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0c380 00000100:00100000:0.0:1788201589.762658:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 685 00000100:00100000:0.0:1788201589.762670:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559682816:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201589.780273:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559682816:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17589us (29396us total) trans 30064771686 rc 0/0 00000100:00100000:0.0:1788201589.780291:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 685 00002000:00100000:0.0:1788201589.780308:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (671088640->672137215) req@ffff962381a0c380 x1875064559682816/t30064771686(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:710/0 lens 488/448 e 0 to 0 dl 1788201600 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201589.780320:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0c380 with x1875064559682816 ext(671088640->672137215) 00002000:00010000:0.0:1788201589.780327:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0c380 00000100:00100000:3.0:1788201589.822915:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201589.825436:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559682944 00000100:00100000:2.0:1788201589.825459:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559682944 00002000:00100000:2.0:1788201589.825543:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (672137216->673185791) req@ffff962381a0df80 x1875064559682944/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:710/0 lens 488/0 e 0 to 0 dl 1788201600 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201589.825568:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0df80 with x1875064559682944 ext(672137216->673185791) 00002000:00010000:2.0:1788201589.825579:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0df80 00000100:00100000:2.0:1788201589.825629:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 686 00000100:00100000:2.0:1788201589.825641:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559682944:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201589.846380:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559682944:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20704us (23444us total) trans 30064771687 rc 0/0 00000100:00100000:2.0:1788201589.846399:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 686 00002000:00100000:2.0:1788201589.846414:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (672137216->673185791) req@ffff962381a0df80 x1875064559682944/t30064771687(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:710/0 lens 488/448 e 0 to 0 dl 1788201600 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201589.846427:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0df80 with x1875064559682944 ext(672137216->673185791) 00002000:00010000:2.0:1788201589.846436:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0df80 00000100:00100000:3.0:1788201589.930244:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201589.930366:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559683072 00000100:00100000:2.0:1788201589.930379:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559683072 00002000:00100000:2.0:1788201589.930446:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (673185792->674234367) req@ffff962381a0f480 x1875064559683072/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:710/0 lens 488/0 e 0 to 0 dl 1788201600 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201589.930459:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0f480 with x1875064559683072 ext(673185792->674234367) 00002000:00010000:2.0:1788201589.930466:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0f480 00000100:00100000:2.0:1788201589.930524:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 687 00000100:00100000:2.0:1788201589.930536:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559683072:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201589.975599:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559683072:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 45047us (45353us total) trans 30064771688 rc 0/0 00000100:00100000:2.0:1788201589.975617:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 687 00002000:00100000:2.0:1788201589.975632:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (673185792->674234367) req@ffff962381a0f480 x1875064559683072/t30064771688(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:710/0 lens 488/448 e 0 to 0 dl 1788201600 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201589.975644:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0f480 with x1875064559683072 ext(673185792->674234367) 00002000:00010000:2.0:1788201589.975652:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0f480 00000100:00100000:3.0:1788201590.154974:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201590.160458:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559683200 00000100:00100000:2.0:1788201590.160481:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559683200 00002000:00100000:2.0:1788201590.160580:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (674234368->675282943) req@ffff962381a0f800 x1875064559683200/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:711/0 lens 488/0 e 0 to 0 dl 1788201601 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201590.160595:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0f800 with x1875064559683200 ext(674234368->675282943) 00002000:00010000:2.0:1788201590.160602:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0f800 00000100:00100000:2.0:1788201590.160649:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 688 00000100:00100000:2.0:1788201590.160662:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559683200:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201590.185585:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559683200:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24907us (30609us total) trans 30064771689 rc 0/0 00000100:00100000:2.0:1788201590.185604:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 688 00002000:00100000:2.0:1788201590.185620:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (674234368->675282943) req@ffff962381a0f800 x1875064559683200/t30064771689(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:711/0 lens 488/448 e 0 to 0 dl 1788201601 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201590.185633:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0f800 with x1875064559683200 ext(674234368->675282943) 00002000:00010000:2.0:1788201590.185657:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0f800 00000100:00100000:3.0:1788201590.326986:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570150528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201590.327092:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201590.327388:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570150528 00000100:00100000:2.0:1788201590.327399:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570150528 00000100:00100000:2.0:1788201590.327474:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788201590.327487:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570150528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201590.327534:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201590.327605:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570150528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201590.327613:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00010000:00080000:2.0:1788201590.327661:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba438e00 x1875064570150528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201590.327681:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570150528:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201590.328376:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201590.367538:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201590.367640:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559683328 00000100:00100000:0.0:1788201590.367652:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559683328 00002000:00100000:0.0:1788201590.367719:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (675282944->676331519) req@ffff962381a0e680 x1875064559683328/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:711/0 lens 488/0 e 0 to 0 dl 1788201601 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201590.367731:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0e680 with x1875064559683328 ext(675282944->676331519) 00002000:00010000:0.0:1788201590.367739:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0e680 00000100:00100000:0.0:1788201590.367799:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 689 00000100:00100000:0.0:1788201590.367811:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559683328:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201590.389672:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559683328:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21846us (22134us total) trans 30064771690 rc 0/0 00000100:00100000:1.0:1788201590.389692:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 689 00002000:00100000:1.0:1788201590.389707:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (675282944->676331519) req@ffff962381a0e680 x1875064559683328/t30064771690(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:711/0 lens 488/448 e 0 to 0 dl 1788201601 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201590.389736:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0e680 with x1875064559683328 ext(675282944->676331519) 00002000:00010000:1.0:1788201590.389744:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0e680 00000100:00100000:0.0:1788201590.560459:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201590.560705:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559683456 00000100:00100000:3.0:1788201590.560717:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559683456 00002000:00100000:3.0:1788201590.560786:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (676331520->677380095) req@ffff9624ba43a680 x1875064559683456/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:711/0 lens 488/0 e 0 to 0 dl 1788201601 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201590.560797:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43a680 with x1875064559683456 ext(676331520->677380095) 00002000:00010000:3.0:1788201590.560803:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43a680 00000100:00100000:3.0:1788201590.560842:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 690 00000100:00100000:3.0:1788201590.560853:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559683456:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201590.571180:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559683456:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10318us (10721us total) trans 30064771691 rc 0/0 00000100:00100000:2.0:1788201590.571191:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 690 00002000:00100000:2.0:1788201590.571202:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (676331520->677380095) req@ffff9624ba43a680 x1875064559683456/t30064771691(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:711/0 lens 488/448 e 0 to 0 dl 1788201601 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201590.571209:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43a680 with x1875064559683456 ext(676331520->677380095) 00002000:00010000:2.0:1788201590.571214:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43a680 00010000:00010000:1.0:1788201590.582789:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201590.776907:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201590.785891:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559683584 00000100:00100000:2.0:1788201590.785907:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559683584 00002000:00100000:2.0:1788201590.785968:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (677380096->678428671) req@ffff962381a0ed80 x1875064559683584/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:711/0 lens 488/0 e 0 to 0 dl 1788201601 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201590.785980:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0ed80 with x1875064559683584 ext(677380096->678428671) 00002000:00010000:2.0:1788201590.785984:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0ed80 00000100:00100000:2.0:1788201590.786037:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 691 00000100:00100000:2.0:1788201590.786046:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2341:x1875064559683584:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201590.824089:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559683584:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 38027us (47175us total) trans 30064771692 rc 0/0 00000100:00100000:2.0:1788201590.824106:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 691 00002000:00100000:2.0:1788201590.824124:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (677380096->678428671) req@ffff962381a0ed80 x1875064559683584/t30064771692(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:711/0 lens 488/448 e 0 to 0 dl 1788201601 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201590.824135:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0ed80 with x1875064559683584 ext(677380096->678428671) 00002000:00010000:2.0:1788201590.824143:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0ed80 00000100:00100000:3.0:1788201590.838908:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570150656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201590.838996:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201590.839081:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570150656 00000100:00100000:0.0:1788201590.839094:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570150656 00000100:00100000:0.0:1788201590.839159:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:0.0:1788201590.839172:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570150656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201590.839192:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570151168:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.839293:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570150784:0@lo:400:kworker.0 00000100:00100000:3.0:1788201590.840309:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201590.840379:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570151168 00000100:00100000:3.0:1788201590.840387:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570151168 00000100:00100000:3.0:1788201590.840441:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1788201590.840450:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570151168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201590.840508:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570151168:12345-0@lo:400:kworker.0 Request processed in 60us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.840530:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00080000:3.0:1788201590.840554:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201590.840592:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570151168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201590.841202:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570151040:0@lo:400:kworker.0 00000100:00100000:3.0:1788201590.841298:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201590.841326:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201590.841332:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570150912:0@lo:400:kworker.0 00000100:00100000:3.0:1788201590.841377:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201590.841402:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570150912 00000100:00100000:3.0:1788201590.841407:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570150912 00000100:00100000:3.0:1788201590.841442:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788201590.841448:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570150912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201590.841482:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570150912:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.841488:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788201590.841508:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201590.841523:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570150912:0@lo:400:kworker.0 00000100:00100000:0.0:1788201590.842678:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570150656:12345-0@lo:400:kworker.0 Request processed in 3497us (3669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201590.842695:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1788201590.844093:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570150656:0@lo:400:kworker.0 00000100:00100000:0.0:1788201590.844183:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570151040 00000100:00100000:0.0:1788201590.844194:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570151040 00000100:00100000:0.0:1788201590.844268:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1788201590.844278:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570151040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201590.844402:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570151040:12345-0@lo:400:kworker.0 Request processed in 125us (3104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201590.844409:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00080000:3.0:1788201590.850961:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201590.855118:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570151040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.859934:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201590.860015:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570150784 00000100:00100000:1.0:1788201590.860026:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570150784 00000100:00100000:1.0:1788201590.860092:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788201590.860103:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570150784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.860176:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570150784:12345-0@lo:400:kworker.0 Request processed in 75us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.860183:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788201590.860241:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570150784:0@lo:400:kworker.0 00000100:00100000:3.0:1788201591.025053:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201591.025190:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559683712 00000100:00100000:2.0:1788201591.025202:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559683712 00002000:00100000:2.0:1788201591.025289:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (678428672->679477247) req@ffff962381a0c700 x1875064559683712/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:712/0 lens 488/0 e 0 to 0 dl 1788201602 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201591.025302:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0c700 with x1875064559683712 ext(678428672->679477247) 00002000:00010000:2.0:1788201591.025308:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0c700 00000100:00100000:2.0:1788201591.025393:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 692 00000100:00100000:2.0:1788201591.025405:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559683712:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201591.025840:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201591.061326:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559683712:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35903us (36264us total) trans 30064771693 rc 0/0 00000100:00100000:3.0:1788201591.061386:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 692 00002000:00100000:3.0:1788201591.061405:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (678428672->679477247) req@ffff962381a0c700 x1875064559683712/t30064771693(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:712/0 lens 488/448 e 0 to 0 dl 1788201602 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201591.061418:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0c700 with x1875064559683712 ext(678428672->679477247) 00002000:00010000:3.0:1788201591.061426:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0c700 00000100:00100000:2.0:1788201591.299134:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201591.300487:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559683840 00000100:00100000:1.0:1788201591.300505:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559683840 00002000:00100000:1.0:1788201591.300584:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (679477248->680525823) req@ffff9624c1e70380 x1875064559683840/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:712/0 lens 488/0 e 0 to 0 dl 1788201602 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201591.300598:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70380 with x1875064559683840 ext(679477248->680525823) 00002000:00010000:1.0:1788201591.300605:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70380 00000100:00100000:1.0:1788201591.300649:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 693 00000100:00100000:1.0:1788201591.300659:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559683840:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201591.339848:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559683840:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39169us (40710us total) trans 30064771694 rc 0/0 00000100:00100000:0.0:1788201591.339885:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 693 00002000:00100000:0.0:1788201591.339902:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (679477248->680525823) req@ffff9624c1e70380 x1875064559683840/t30064771694(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:712/0 lens 488/448 e 0 to 0 dl 1788201602 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201591.339914:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70380 with x1875064559683840 ext(679477248->680525823) 00002000:00010000:0.0:1788201591.339922:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70380 00010000:00010000:1.0:1788201591.606955:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201591.662624:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201591.662917:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559683968 00000100:00100000:0.0:1788201591.662929:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559683968 00002000:00100000:0.0:1788201591.663000:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (680525824->681574399) req@ffff962381956680 x1875064559683968/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:712/0 lens 488/0 e 0 to 0 dl 1788201602 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201591.663013:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381956680 with x1875064559683968 ext(680525824->681574399) 00002000:00010000:0.0:1788201591.663021:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381956680 00000100:00100000:0.0:1788201591.663064:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 694 00000100:00100000:0.0:1788201591.663075:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559683968:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201591.693028:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559683968:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29939us (30403us total) trans 30064771695 rc 0/0 00000100:00100000:0.0:1788201591.693045:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 694 00002000:00100000:0.0:1788201591.693061:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (680525824->681574399) req@ffff962381956680 x1875064559683968/t30064771695(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:712/0 lens 488/448 e 0 to 0 dl 1788201602 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201591.693073:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381956680 with x1875064559683968 ext(680525824->681574399) 00002000:00010000:0.0:1788201591.693080:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381956680 00000100:00100000:1.0:1788201592.007304:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201592.013504:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559684096 00000100:00100000:2.0:1788201592.013522:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559684096 00002000:00100000:2.0:1788201592.013591:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (681574400->682622975) req@ffff962381954000 x1875064559684096/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:713/0 lens 488/0 e 0 to 0 dl 1788201603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201592.013603:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954000 with x1875064559684096 ext(681574400->682622975) 00002000:00010000:2.0:1788201592.013609:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954000 00000100:00100000:2.0:1788201592.013664:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 695 00000100:00100000:2.0:1788201592.013674:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559684096:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201592.039453:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559684096:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25768us (32145us total) trans 30064771696 rc 0/0 00000100:00100000:0.0:1788201592.039484:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 695 00002000:00100000:0.0:1788201592.039507:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (681574400->682622975) req@ffff962381954000 x1875064559684096/t30064771696(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:713/0 lens 488/448 e 0 to 0 dl 1788201603 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201592.039519:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954000 with x1875064559684096 ext(681574400->682622975) 00002000:00010000:0.0:1788201592.039525:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954000 00000100:00100000:2.0:1788201592.185762:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201592.185904:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559684224 00000100:00100000:3.0:1788201592.185917:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559684224 00002000:00100000:3.0:1788201592.185979:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (682622976->683671551) req@ffff9624c1e72300 x1875064559684224/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:713/0 lens 488/0 e 0 to 0 dl 1788201603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201592.185992:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72300 with x1875064559684224 ext(682622976->683671551) 00002000:00010000:3.0:1788201592.185998:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72300 00000100:00100000:3.0:1788201592.186043:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 696 00000100:00100000:3.0:1788201592.186054:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559684224:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201592.207382:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2341:x1875064559684224:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21308us (21627us total) trans 30064771697 rc 0/0 00000100:00100000:3.0:1788201592.207403:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 696 00002000:00100000:3.0:1788201592.207420:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (682622976->683671551) req@ffff9624c1e72300 x1875064559684224/t30064771697(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:713/0 lens 488/448 e 0 to 0 dl 1788201603 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201592.207434:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72300 with x1875064559684224 ext(682622976->683671551) 00002000:00010000:3.0:1788201592.207442:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72300 00000100:00100000:2.0:1788201592.549056:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201592.549241:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559684352 00000100:00100000:0.0:1788201592.549252:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559684352 00002000:00100000:0.0:1788201592.549325:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (683671552->684720127) req@ffff9624c1e73480 x1875064559684352/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:713/0 lens 488/0 e 0 to 0 dl 1788201603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201592.549338:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73480 with x1875064559684352 ext(683671552->684720127) 00002000:00010000:0.0:1788201592.549393:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73480 00000100:00100000:0.0:1788201592.549431:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 697 00000100:00100000:0.0:1788201592.549443:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2342:x1875064559684352:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201592.583482:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2342:x1875064559684352:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34023us (34422us total) trans 30064771698 rc 0/0 00000100:00100000:0.0:1788201592.583501:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 697 00002000:00100000:0.0:1788201592.583520:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (683671552->684720127) req@ffff9624c1e73480 x1875064559684352/t30064771698(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:713/0 lens 488/448 e 0 to 0 dl 1788201603 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201592.583532:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73480 with x1875064559684352 ext(683671552->684720127) 00002000:00010000:0.0:1788201592.583539:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73480 00010000:00010000:0.0:1788201592.632364:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201592.785225:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201592.785588:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559684480 00000100:00100000:0.0:1788201592.785603:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559684480 00002000:00100000:0.0:1788201592.785695:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (684720128->685768703) req@ffff962381a0e300 x1875064559684480/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:713/0 lens 488/0 e 0 to 0 dl 1788201603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201592.785708:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0e300 with x1875064559684480 ext(684720128->685768703) 00002000:00010000:0.0:1788201592.785715:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0e300 00000100:00100000:0.0:1788201592.785771:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 698 00000100:00100000:0.0:1788201592.785782:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559684480:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201592.806557:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559684480:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20759us (21330us total) trans 30064771699 rc 0/0 00000100:00100000:0.0:1788201592.806577:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 698 00002000:00100000:0.0:1788201592.806593:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (684720128->685768703) req@ffff962381a0e300 x1875064559684480/t30064771699(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:713/0 lens 488/448 e 0 to 0 dl 1788201603 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201592.806606:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0e300 with x1875064559684480 ext(684720128->685768703) 00002000:00010000:0.0:1788201592.806614:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0e300 00000100:00100000:0.0:1788201592.886973:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201592.887011:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570151296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201592.887883:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201592.888624:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570151296 00000100:00100000:1.0:1788201592.888637:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570151296 00000100:00100000:1.0:1788201592.888741:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788201592.888753:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570151296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201592.888788:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 562364416 pending 34078720 free 3195011072 avail 3192913920 00000100:00100000:1.0:1788201592.888859:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570151296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201592.888867:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:3.0:1788201592.889952:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201592.890695:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570151296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201593.061177:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201593.061381:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559684608 00000100:00100000:2.0:1788201593.061396:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559684608 00002000:00100000:2.0:1788201593.061496:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (685768704->686817279) req@ffff962381956d80 x1875064559684608/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:714/0 lens 488/0 e 0 to 0 dl 1788201604 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201593.061509:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381956d80 with x1875064559684608 ext(685768704->686817279) 00002000:00010000:2.0:1788201593.061529:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381956d80 00000100:00100000:2.0:1788201593.061569:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 699 00000100:00100000:2.0:1788201593.061582:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2341:x1875064559684608:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201593.065234:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201593.085430:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2341:x1875064559684608:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23834us (24252us total) trans 30064771700 rc 0/0 00000100:00100000:2.0:1788201593.085446:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 699 00002000:00100000:2.0:1788201593.085461:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (685768704->686817279) req@ffff962381956d80 x1875064559684608/t30064771700(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:714/0 lens 488/448 e 0 to 0 dl 1788201604 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201593.085472:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381956d80 with x1875064559684608 ext(685768704->686817279) 00002000:00010000:2.0:1788201593.085479:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381956d80 00000100:00100000:3.0:1788201593.472100:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201593.472188:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559684736 00000100:00100000:2.0:1788201593.472199:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559684736 00002000:00100000:2.0:1788201593.472255:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (686817280->687865855) req@ffff962381a0ea00 x1875064559684736/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:714/0 lens 488/0 e 0 to 0 dl 1788201604 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201593.472268:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0ea00 with x1875064559684736 ext(686817280->687865855) 00002000:00010000:2.0:1788201593.472289:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0ea00 00000100:00100000:2.0:1788201593.472327:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 700 00000100:00100000:2.0:1788201593.472337:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559684736:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201593.509106:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559684736:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36756us (37001us total) trans 30064771701 rc 0/0 00000100:00100000:1.0:1788201593.509123:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 700 00002000:00100000:1.0:1788201593.509140:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (686817280->687865855) req@ffff962381a0ea00 x1875064559684736/t30064771701(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:714/0 lens 488/448 e 0 to 0 dl 1788201604 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201593.509151:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0ea00 with x1875064559684736 ext(686817280->687865855) 00002000:00010000:1.0:1788201593.509158:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0ea00 00000001:00080000:2.0:1788201593.608453:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771699 is committed 00000001:00080000:2.0:1788201593.608629:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771700 is committed 00010000:00010000:1.0:1788201593.657126:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201593.758960:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201593.759069:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559684864 00000100:00100000:0.0:1788201593.759080:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559684864 00002000:00100000:0.0:1788201593.759137:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (687865856->688914431) req@ffff962381a0f100 x1875064559684864/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:714/0 lens 488/0 e 0 to 0 dl 1788201604 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201593.759146:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0f100 with x1875064559684864 ext(687865856->688914431) 00002000:00010000:0.0:1788201593.759151:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0f100 00000100:00100000:0.0:1788201593.759228:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 701 00000100:00100000:0.0:1788201593.759247:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559684864:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201593.775689:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559684864:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16425us (16721us total) trans 30064771702 rc 0/0 00000100:00100000:0.0:1788201593.775716:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 701 00002000:00100000:0.0:1788201593.775734:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (687865856->688914431) req@ffff962381a0f100 x1875064559684864/t30064771702(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:714/0 lens 488/448 e 0 to 0 dl 1788201604 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201593.775746:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381a0f100 with x1875064559684864 ext(687865856->688914431) 00002000:00010000:0.0:1788201593.775753:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381a0f100 00000100:00100000:3.0:1788201594.024429:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201594.024593:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559684992 00000100:00100000:0.0:1788201594.024606:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559684992 00002000:00100000:0.0:1788201594.024679:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (688914432->689963007) req@ffff96248c9cd500 x1875064559684992/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:715/0 lens 488/0 e 0 to 0 dl 1788201605 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201594.024691:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cd500 with x1875064559684992 ext(688914432->689963007) 00002000:00010000:0.0:1788201594.024696:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cd500 00000100:00100000:0.0:1788201594.024790:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 702 00000100:00100000:0.0:1788201594.024802:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559684992:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201594.038206:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559684992:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13392us (13772us total) trans 30064771703 rc 0/0 00000100:00100000:2.0:1788201594.038221:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 702 00002000:00100000:2.0:1788201594.038235:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (688914432->689963007) req@ffff96248c9cd500 x1875064559684992/t30064771703(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:715/0 lens 488/448 e 0 to 0 dl 1788201605 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201594.038245:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cd500 with x1875064559684992 ext(688914432->689963007) 00002000:00010000:2.0:1788201594.038251:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cd500 00000100:00100000:3.0:1788201594.179657:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201594.179791:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559685120 00000100:00100000:2.0:1788201594.179803:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559685120 00002000:00100000:2.0:1788201594.179859:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (689963008->691011583) req@ffff96248c9cf480 x1875064559685120/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:715/0 lens 488/0 e 0 to 0 dl 1788201605 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201594.179870:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cf480 with x1875064559685120 ext(689963008->691011583) 00002000:00010000:2.0:1788201594.179878:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cf480 00000100:00100000:2.0:1788201594.179914:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 703 00000100:00100000:2.0:1788201594.179924:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559685120:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201594.217898:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559685120:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37960us (38235us total) trans 30064771704 rc 0/0 00000100:00100000:2.0:1788201594.217915:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 703 00002000:00100000:2.0:1788201594.217942:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (689963008->691011583) req@ffff96248c9cf480 x1875064559685120/t30064771704(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:715/0 lens 488/448 e 0 to 0 dl 1788201605 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201594.217977:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cf480 with x1875064559685120 ext(689963008->691011583) 00002000:00010000:2.0:1788201594.217983:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cf480 00000100:00100000:1.0:1788201594.343253:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201594.347200:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559685248 00000100:00100000:2.0:1788201594.347217:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559685248 00002000:00100000:2.0:1788201594.347285:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (691011584->692060159) req@ffff962381955500 x1875064559685248/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:715/0 lens 488/0 e 0 to 0 dl 1788201605 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201594.347298:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955500 with x1875064559685248 ext(691011584->692060159) 00002000:00010000:2.0:1788201594.347303:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955500 00000100:00100000:2.0:1788201594.347357:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 704 00000100:00100000:2.0:1788201594.347367:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559685248:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201594.381374:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559685248:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33957us (38079us total) trans 30064771705 rc 0/0 00000100:00100000:2.0:1788201594.381393:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 704 00002000:00100000:2.0:1788201594.381409:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (691011584->692060159) req@ffff962381955500 x1875064559685248/t30064771705(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:715/0 lens 488/448 e 0 to 0 dl 1788201605 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201594.381424:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381955500 with x1875064559685248 ext(691011584->692060159) 00002000:00010000:2.0:1788201594.381433:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381955500 00000100:00100000:3.0:1788201594.487076:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201594.487205:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559685376 00000100:00100000:0.0:1788201594.487226:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559685376 00002000:00100000:0.0:1788201594.487299:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (692060160->693108735) req@ffff96248c9cd180 x1875064559685376/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:715/0 lens 488/0 e 0 to 0 dl 1788201605 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201594.487312:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cd180 with x1875064559685376 ext(692060160->693108735) 00002000:00010000:0.0:1788201594.487317:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cd180 00000100:00100000:0.0:1788201594.487390:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 705 00000100:00100000:0.0:1788201594.487401:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559685376:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201594.499994:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559685376:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12583us (12921us total) trans 30064771706 rc 0/0 00000100:00100000:0.0:1788201594.500010:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 705 00002000:00100000:0.0:1788201594.500023:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (692060160->693108735) req@ffff96248c9cd180 x1875064559685376/t30064771706(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:715/0 lens 488/448 e 0 to 0 dl 1788201605 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201594.500035:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cd180 with x1875064559685376 ext(692060160->693108735) 00002000:00010000:0.0:1788201594.500041:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cd180 00000100:00100000:3.0:1788201594.653600:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201594.654578:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559685504 00000100:00100000:0.0:1788201594.654595:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559685504 00002000:00100000:0.0:1788201594.654672:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (693108736->694157311) req@ffff96248c9ced80 x1875064559685504/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:715/0 lens 488/0 e 0 to 0 dl 1788201605 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201594.654686:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9ced80 with x1875064559685504 ext(693108736->694157311) 00002000:00010000:0.0:1788201594.654706:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9ced80 00000100:00100000:0.0:1788201594.654750:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 706 00000100:00100000:0.0:1788201594.654761:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559685504:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201594.674544:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559685504:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19764us (20939us total) trans 30064771707 rc 0/0 00000100:00100000:0.0:1788201594.674565:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 706 00002000:00100000:0.0:1788201594.674584:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (693108736->694157311) req@ffff96248c9ced80 x1875064559685504/t30064771707(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:715/0 lens 488/448 e 0 to 0 dl 1788201605 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201594.674597:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9ced80 with x1875064559685504 ext(693108736->694157311) 00002000:00010000:0.0:1788201594.674604:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9ced80 00000100:00100000:3.0:1788201594.680129:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:0.0:1788201594.680271:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201594.680306:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559685760 00000100:00100000:0.0:1788201594.680317:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559685760 00000100:00100000:0.0:1788201594.680406:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 419 00000100:00100000:0.0:1788201594.680417:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559685760:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201594.680512:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559685760:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 97us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201594.680521:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 419 00000100:00080000:3.0:1788201594.680655:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201594.680724:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201594.681932:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559685632 00000100:00100000:0.0:1788201594.681946:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559685632 00000100:00100000:0.0:1788201594.681997:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 552 00000100:00100000:0.0:1788201594.682006:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559685632:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201594.682063:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559685632:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 59us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201594.682069:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 552 00000100:00100000:1.0:1788201594.838631:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201594.838721:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559685888 00000100:00100000:2.0:1788201594.838734:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559685888 00002000:00100000:2.0:1788201594.838810:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (694157312->695205887) req@ffff962381957100 x1875064559685888/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:715/0 lens 488/0 e 0 to 0 dl 1788201605 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201594.838823:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381957100 with x1875064559685888 ext(694157312->695205887) 00002000:00010000:2.0:1788201594.838831:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381957100 00000100:00100000:2.0:1788201594.838892:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 707 00000100:00100000:2.0:1788201594.838903:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559685888:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201594.857547:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559685888:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18628us (18916us total) trans 30064771708 rc 0/0 00000100:00100000:2.0:1788201594.857567:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 707 00002000:00100000:2.0:1788201594.857584:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (694157312->695205887) req@ffff962381957100 x1875064559685888/t30064771708(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:715/0 lens 488/448 e 0 to 0 dl 1788201605 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201594.857596:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381957100 with x1875064559685888 ext(694157312->695205887) 00002000:00010000:2.0:1788201594.857604:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381957100 00000100:00100000:0.0:1788201595.010011:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201595.010117:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559686016 00000100:00100000:2.0:1788201595.010130:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559686016 00002000:00100000:2.0:1788201595.010227:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (695205888->696254463) req@ffff9624ba438a80 x1875064559686016/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:716/0 lens 488/0 e 0 to 0 dl 1788201606 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201595.010241:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba438a80 with x1875064559686016 ext(695205888->696254463) 00002000:00010000:2.0:1788201595.010248:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba438a80 00000100:00100000:2.0:1788201595.010444:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 708 00000100:00100000:2.0:1788201595.010457:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559686016:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201595.011032:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201595.039619:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559686016:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29148us (29608us total) trans 30064771709 rc 0/0 00000100:00100000:2.0:1788201595.039637:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 708 00002000:00100000:2.0:1788201595.039653:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (695205888->696254463) req@ffff9624ba438a80 x1875064559686016/t30064771709(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:716/0 lens 488/448 e 0 to 0 dl 1788201606 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201595.039666:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba438a80 with x1875064559686016 ext(695205888->696254463) 00002000:00010000:2.0:1788201595.039704:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba438a80 00000100:00100000:0.0:1788201595.150896:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201595.151703:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559686144 00000100:00100000:1.0:1788201595.151718:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559686144 00002000:00100000:1.0:1788201595.151874:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (696254464->697303039) req@ffff9624ba43bb80 x1875064559686144/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:716/0 lens 488/0 e 0 to 0 dl 1788201606 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201595.151888:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43bb80 with x1875064559686144 ext(696254464->697303039) 00002000:00010000:1.0:1788201595.151895:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43bb80 00000100:00100000:1.0:1788201595.151939:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 709 00000100:00100000:1.0:1788201595.151971:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559686144:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201595.177985:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559686144:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25999us (27090us total) trans 30064771710 rc 0/0 00000100:00100000:1.0:1788201595.178014:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 709 00002000:00100000:1.0:1788201595.178031:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (696254464->697303039) req@ffff9624ba43bb80 x1875064559686144/t30064771710(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:716/0 lens 488/448 e 0 to 0 dl 1788201606 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201595.178044:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43bb80 with x1875064559686144 ext(696254464->697303039) 00002000:00010000:1.0:1788201595.178050:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43bb80 00000100:00100000:0.0:1788201595.427412:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201595.427632:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559686272 00000100:00100000:2.0:1788201595.427645:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559686272 00002000:00100000:2.0:1788201595.427720:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (697303040->698351615) req@ffff9624ba439880 x1875064559686272/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:716/0 lens 488/0 e 0 to 0 dl 1788201606 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201595.427735:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba439880 with x1875064559686272 ext(697303040->698351615) 00002000:00010000:2.0:1788201595.427743:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba439880 00000100:00100000:2.0:1788201595.427776:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 710 00000100:00100000:2.0:1788201595.427788:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559686272:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201595.448711:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559686272:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20911us (21304us total) trans 30064771711 rc 0/0 00000100:00100000:2.0:1788201595.448727:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 710 00002000:00100000:2.0:1788201595.448742:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (697303040->698351615) req@ffff9624ba439880 x1875064559686272/t30064771711(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:716/0 lens 488/448 e 0 to 0 dl 1788201606 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201595.448754:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba439880 with x1875064559686272 ext(697303040->698351615) 00002000:00010000:2.0:1788201595.448761:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba439880 00000100:00100000:2.0:1788201595.452631:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962381954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570151424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201595.452767:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201595.463813:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570151424 00000100:00100000:1.0:1788201595.463836:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570151424 00000100:00100000:1.0:1788201595.463935:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788201595.463947:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570151424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201595.463999:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201595.464111:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570151424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (11344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.464119:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00010000:00080000:1.0:1788201595.464311:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962381954a80 x1875064570151424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201595.464335:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962381954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570151424:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201595.465821:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201595.584400:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201595.584625:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559686400 00000100:00100000:2.0:1788201595.584639:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559686400 00002000:00100000:2.0:1788201595.584715:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (698351616->699400191) req@ffff96248c9cd880 x1875064559686400/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:716/0 lens 488/0 e 0 to 0 dl 1788201606 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201595.584728:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cd880 with x1875064559686400 ext(698351616->699400191) 00002000:00010000:2.0:1788201595.584736:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cd880 00000100:00100000:2.0:1788201595.584804:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 711 00000100:00100000:2.0:1788201595.584815:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559686400:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201595.606870:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559686400:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22039us (22466us total) trans 30064771712 rc 0/0 00000100:00100000:1.0:1788201595.606889:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 711 00002000:00100000:1.0:1788201595.606906:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (698351616->699400191) req@ffff96248c9cd880 x1875064559686400/t30064771712(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:716/0 lens 488/448 e 0 to 0 dl 1788201606 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201595.606944:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cd880 with x1875064559686400 ext(698351616->699400191) 00002000:00010000:1.0:1788201595.606952:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cd880 00010000:00010000:1.0:1788201595.703194:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201595.793100:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201595.793255:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559686528 00000100:00100000:1.0:1788201595.793266:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559686528 00002000:00100000:1.0:1788201595.793322:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (699400192->700448767) req@ffff9624c1e72680 x1875064559686528/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:716/0 lens 488/0 e 0 to 0 dl 1788201606 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201595.793334:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72680 with x1875064559686528 ext(699400192->700448767) 00002000:00010000:1.0:1788201595.793380:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72680 00000100:00100000:1.0:1788201595.793413:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 712 00000100:00100000:1.0:1788201595.793424:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559686528:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201595.814826:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559686528:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21390us (21722us total) trans 30064771713 rc 0/0 00000100:00100000:1.0:1788201595.814843:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 712 00002000:00100000:1.0:1788201595.814858:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (699400192->700448767) req@ffff9624c1e72680 x1875064559686528/t30064771713(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:716/0 lens 488/448 e 0 to 0 dl 1788201606 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201595.814869:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72680 with x1875064559686528 ext(699400192->700448767) 00002000:00010000:1.0:1788201595.814876:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72680 00000100:00100000:2.0:1788201595.968462:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570151680:0@lo:400:kworker.0 00000100:00100000:2.0:1788201595.968545:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201595.968603:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570152192:0@lo:400:kworker.0 00000100:00100000:2.0:1788201595.968632:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201595.968657:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201595.968663:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570151808:0@lo:400:kworker.0 00000100:00100000:2.0:1788201595.968697:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201595.968735:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570151680 00000100:00100000:2.0:1788201595.968742:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570151680 00000100:00100000:2.0:1788201595.968783:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570152192 00000100:00100000:2.0:1788201595.968786:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570152192 00000100:00100000:2.0:1788201595.968814:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1788201595.968822:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570151680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201595.968875:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570151680:12345-0@lo:400:kworker.0 Request processed in 53us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.968882:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1788201595.968899:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1788201595.968905:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570152192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201595.968927:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570152192:12345-0@lo:400:kworker.0 Request processed in 23us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.968932:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1788201595.968951:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570151808 00000100:00100000:2.0:1788201595.968955:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570151808 00000100:00100000:2.0:1788201595.968993:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788201595.968999:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570151808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201595.969523:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570151808:12345-0@lo:400:kworker.0 Request processed in 523us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.969697:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570151552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.969747:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201595.969779:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570152064:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.969803:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201595.969824:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201595.969830:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570151936:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.969853:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201595.969880:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570152064 00000100:00100000:3.0:1788201595.969884:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570152064 00000100:00100000:3.0:1788201595.969913:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788201595.969919:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570152064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.969957:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570152064:12345-0@lo:400:kworker.0 Request processed in 38us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.969964:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00010000:00080000:3.0:1788201595.970006:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e73b80 x1875064570152064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201595.970048:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570152064:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.970094:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570151936 00000100:00100000:3.0:1788201595.970099:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570151936 00000100:00100000:3.0:1788201595.970124:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1788201595.970131:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570151936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.970164:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570151936:12345-0@lo:400:kworker.0 Request processed in 35us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201595.970170:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00080000:3.0:1788201595.970186:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201595.970192:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201595.970211:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570151936:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.970311:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570151808:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.970323:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570151680:0@lo:400:kworker.0 00000100:00100000:3.0:1788201595.970332:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570152192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201595.970696:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570151552 00000100:00100000:0.0:1788201595.970701:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570151552 00000100:00100000:0.0:1788201595.970738:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1788201595.970746:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570151552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201595.970797:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570151552:12345-0@lo:400:kworker.0 Request processed in 51us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.970803:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1788201595.970847:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570151552:0@lo:400:kworker.0 00000100:00100000:2.0:1788201595.971381:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788201596.025308:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201596.028601:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559686656 00000100:00100000:1.0:1788201596.029103:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559686656 00002000:00100000:1.0:1788201596.029170:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (700448768->701497343) req@ffff9624c1e72d80 x1875064559686656/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/0 e 0 to 0 dl 1788201607 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201596.029184:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72d80 with x1875064559686656 ext(700448768->701497343) 00002000:00010000:1.0:1788201596.029206:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72d80 00000100:00100000:1.0:1788201596.029259:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 713 00000100:00100000:1.0:1788201596.029270:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559686656:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201596.057170:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559686656:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27885us (31855us total) trans 30064771714 rc 0/0 00000100:00100000:0.0:1788201596.057201:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 713 00002000:00100000:0.0:1788201596.057222:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (700448768->701497343) req@ffff9624c1e72d80 x1875064559686656/t30064771714(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/448 e 0 to 0 dl 1788201607 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201596.057234:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72d80 with x1875064559686656 ext(700448768->701497343) 00002000:00010000:0.0:1788201596.057240:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72d80 00000100:00100000:1.0:1788201596.192889:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201596.192987:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559686784 00000100:00100000:2.0:1788201596.192998:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559686784 00002000:00100000:2.0:1788201596.193055:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (701497344->702545919) req@ffff962381954a80 x1875064559686784/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/0 e 0 to 0 dl 1788201607 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201596.193067:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954a80 with x1875064559686784 ext(701497344->702545919) 00002000:00010000:2.0:1788201596.193074:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954a80 00000100:00100000:2.0:1788201596.193109:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 714 00000100:00100000:2.0:1788201596.193121:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962381954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559686784:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201596.205208:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962381954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559686784:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12074us (12314us total) trans 30064771715 rc 0/0 00000100:00100000:0.0:1788201596.205226:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 714 00002000:00100000:0.0:1788201596.205241:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (701497344->702545919) req@ffff962381954a80 x1875064559686784/t30064771715(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/448 e 0 to 0 dl 1788201607 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201596.205252:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962381954a80 with x1875064559686784 ext(701497344->702545919) 00002000:00010000:0.0:1788201596.205258:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962381954a80 00000100:00100000:3.0:1788201596.267967:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201596.268391:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559686912 00000100:00100000:2.0:1788201596.268404:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559686912 00002000:00100000:2.0:1788201596.268472:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (702545920->703594495) req@ffff96248c9cf100 x1875064559686912/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/0 e 0 to 0 dl 1788201607 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201596.268485:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cf100 with x1875064559686912 ext(702545920->703594495) 00002000:00010000:2.0:1788201596.268491:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cf100 00000100:00100000:2.0:1788201596.268527:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 715 00000100:00100000:2.0:1788201596.268539:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559686912:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201596.285679:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559686912:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17118us (17698us total) trans 30064771716 rc 0/0 00000100:00100000:1.0:1788201596.285696:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 715 00002000:00100000:1.0:1788201596.285734:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (702545920->703594495) req@ffff96248c9cf100 x1875064559686912/t30064771716(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/448 e 0 to 0 dl 1788201607 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201596.285746:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cf100 with x1875064559686912 ext(702545920->703594495) 00002000:00010000:1.0:1788201596.285754:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cf100 00000100:00100000:3.0:1788201596.374050:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201596.374533:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559687040 00000100:00100000:1.0:1788201596.374546:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559687040 00002000:00100000:1.0:1788201596.374603:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (703594496->704643071) req@ffff96248c9cca80 x1875064559687040/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/0 e 0 to 0 dl 1788201607 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201596.374616:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cca80 with x1875064559687040 ext(703594496->704643071) 00002000:00010000:1.0:1788201596.374622:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cca80 00000100:00100000:1.0:1788201596.374657:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 716 00000100:00100000:1.0:1788201596.374703:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559687040:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201596.388095:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2342:x1875064559687040:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13383us (14055us total) trans 30064771717 rc 0/0 00000100:00100000:0.0:1788201596.388112:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 716 00002000:00100000:0.0:1788201596.388127:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (703594496->704643071) req@ffff96248c9cca80 x1875064559687040/t30064771717(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/448 e 0 to 0 dl 1788201607 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201596.388149:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cca80 with x1875064559687040 ext(703594496->704643071) 00002000:00010000:0.0:1788201596.388156:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cca80 00000100:00100000:1.0:1788201596.477700:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201596.477923:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559687168 00000100:00100000:0.0:1788201596.477935:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559687168 00002000:00100000:0.0:1788201596.477995:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (704643072->705691647) req@ffff9624c1e51180 x1875064559687168/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/0 e 0 to 0 dl 1788201607 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201596.478037:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e51180 with x1875064559687168 ext(704643072->705691647) 00002000:00010000:0.0:1788201596.478044:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e51180 00000100:00100000:0.0:1788201596.479132:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 717 00000100:00100000:0.0:1788201596.479147:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559687168:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201596.498841:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2341:x1875064559687168:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19684us (21169us total) trans 30064771718 rc 0/0 00000100:00100000:0.0:1788201596.498856:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 717 00002000:00100000:0.0:1788201596.498872:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (704643072->705691647) req@ffff9624c1e51180 x1875064559687168/t30064771718(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/448 e 0 to 0 dl 1788201607 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201596.498884:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e51180 with x1875064559687168 ext(704643072->705691647) 00002000:00010000:0.0:1788201596.498892:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e51180 00000100:00100000:3.0:1788201596.545975:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201596.546168:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559687296 00000100:00100000:0.0:1788201596.546180:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559687296 00002000:00100000:0.0:1788201596.546232:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (705691648->706740223) req@ffff96248c9cf800 x1875064559687296/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/0 e 0 to 0 dl 1788201607 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201596.546244:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cf800 with x1875064559687296 ext(705691648->706740223) 00002000:00010000:0.0:1788201596.546250:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cf800 00000100:00100000:0.0:1788201596.546289:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 718 00000100:00100000:0.0:1788201596.546299:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2342:x1875064559687296:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201596.556737:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2342:x1875064559687296:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10422us (10757us total) trans 30064771719 rc 0/0 00000100:00100000:0.0:1788201596.556752:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 718 00002000:00100000:0.0:1788201596.556780:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (705691648->706740223) req@ffff96248c9cf800 x1875064559687296/t30064771719(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/448 e 0 to 0 dl 1788201607 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201596.556790:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cf800 with x1875064559687296 ext(705691648->706740223) 00002000:00010000:0.0:1788201596.556796:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cf800 00000100:00100000:2.0:1788201596.624532:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201596.624775:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559687424 00000100:00100000:1.0:1788201596.624792:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559687424 00002000:00100000:1.0:1788201596.624860:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (706740224->707788799) req@ffff9624c1e71180 x1875064559687424/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/0 e 0 to 0 dl 1788201607 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201596.624894:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71180 with x1875064559687424 ext(706740224->707788799) 00002000:00010000:1.0:1788201596.624901:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71180 00000100:00100000:1.0:1788201596.624944:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 719 00000100:00100000:1.0:1788201596.624956:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559687424:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201596.651565:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559687424:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26582us (27020us total) trans 30064771720 rc 0/0 00000100:00100000:3.0:1788201596.651585:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 719 00002000:00100000:3.0:1788201596.651600:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (706740224->707788799) req@ffff9624c1e71180 x1875064559687424/t30064771720(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/448 e 0 to 0 dl 1788201607 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201596.651613:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71180 with x1875064559687424 ext(706740224->707788799) 00002000:00010000:3.0:1788201596.651650:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71180 00010000:00010000:1.0:1788201596.726734:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201596.828274:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201596.828434:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559687552 00000100:00100000:0.0:1788201596.828447:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559687552 00002000:00100000:0.0:1788201596.828514:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (707788800->708837375) req@ffff9624c1e52a00 x1875064559687552/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/0 e 0 to 0 dl 1788201607 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201596.828528:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e52a00 with x1875064559687552 ext(707788800->708837375) 00002000:00010000:0.0:1788201596.828535:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e52a00 00000100:00100000:0.0:1788201596.828579:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 720 00000100:00100000:0.0:1788201596.828590:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559687552:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201596.862488:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559687552:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33883us (34213us total) trans 30064771721 rc 0/0 00000100:00100000:2.0:1788201596.862528:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 720 00002000:00100000:2.0:1788201596.862553:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (707788800->708837375) req@ffff9624c1e52a00 x1875064559687552/t30064771721(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:717/0 lens 488/448 e 0 to 0 dl 1788201607 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201596.862567:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e52a00 with x1875064559687552 ext(707788800->708837375) 00002000:00010000:2.0:1788201596.862575:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e52a00 00000100:00100000:2.0:1788201597.030431:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201597.031128:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559687680 00000100:00100000:0.0:1788201597.031140:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559687680 00002000:00100000:0.0:1788201597.031230:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (708837376->709885951) req@ffff9624c1e71c00 x1875064559687680/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:718/0 lens 488/0 e 0 to 0 dl 1788201608 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201597.031246:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71c00 with x1875064559687680 ext(708837376->709885951) 00002000:00010000:0.0:1788201597.031254:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71c00 00000100:00080000:3.0:1788201597.031378:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201597.034797:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 721 00000100:00100000:0.0:1788201597.034834:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2341:x1875064559687680:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201597.061503:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2341:x1875064559687680:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26672us (31069us total) trans 30064771722 rc 0/0 00000100:00100000:1.0:1788201597.061521:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 721 00002000:00100000:1.0:1788201597.061536:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (708837376->709885951) req@ffff9624c1e71c00 x1875064559687680/t30064771722(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:718/0 lens 488/448 e 0 to 0 dl 1788201608 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201597.063166:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71c00 with x1875064559687680 ext(708837376->709885951) 00002000:00010000:1.0:1788201597.063175:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71c00 00000100:00100000:3.0:1788201597.163928:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201597.167245:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559687808 00000100:00100000:2.0:1788201597.167268:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559687808 00002000:00100000:2.0:1788201597.167379:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (709885952->710934527) req@ffff96248c9cfb80 x1875064559687808/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:718/0 lens 488/0 e 0 to 0 dl 1788201608 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201597.167394:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cfb80 with x1875064559687808 ext(709885952->710934527) 00002000:00010000:2.0:1788201597.167401:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cfb80 00000100:00100000:2.0:1788201597.167527:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 722 00000100:00100000:2.0:1788201597.167539:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559687808:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201597.187617:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559687808:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20059us (23683us total) trans 30064771723 rc 0/0 00000100:00100000:0.0:1788201597.187635:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 722 00002000:00100000:0.0:1788201597.187979:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (709885952->710934527) req@ffff96248c9cfb80 x1875064559687808/t30064771723(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:718/0 lens 488/448 e 0 to 0 dl 1788201608 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201597.188010:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9cfb80 with x1875064559687808 ext(709885952->710934527) 00002000:00010000:0.0:1788201597.188018:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9cfb80 00000100:00100000:3.0:1788201597.257565:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201597.262225:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559687936 00000100:00100000:1.0:1788201597.262245:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559687936 00002000:00100000:1.0:1788201597.262320:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (710934528->711983103) req@ffff96248cc95880 x1875064559687936/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:718/0 lens 488/0 e 0 to 0 dl 1788201608 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201597.262332:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc95880 with x1875064559687936 ext(710934528->711983103) 00002000:00010000:1.0:1788201597.262356:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc95880 00000100:00100000:1.0:1788201597.262456:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 723 00000100:00100000:1.0:1788201597.262468:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559687936:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201597.280015:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559687936:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17534us (22665us total) trans 30064771724 rc 0/0 00000100:00100000:1.0:1788201597.280047:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 723 00002000:00100000:1.0:1788201597.280062:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (710934528->711983103) req@ffff96248cc95880 x1875064559687936/t30064771724(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:718/0 lens 488/448 e 0 to 0 dl 1788201608 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201597.280074:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc95880 with x1875064559687936 ext(710934528->711983103) 00002000:00010000:1.0:1788201597.280081:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc95880 00000100:00100000:3.0:1788201597.434042:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201597.434461:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559688064 00000100:00100000:0.0:1788201597.434473:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559688064 00002000:00100000:0.0:1788201597.434541:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (711983104->713031679) req@ffff96248cc96a00 x1875064559688064/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:718/0 lens 488/0 e 0 to 0 dl 1788201608 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201597.434556:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc96a00 with x1875064559688064 ext(711983104->713031679) 00002000:00010000:0.0:1788201597.434563:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc96a00 00000100:00100000:0.0:1788201597.434614:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 724 00000100:00100000:0.0:1788201597.434627:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559688064:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201597.467630:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559688064:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32980us (33577us total) trans 30064771725 rc 0/0 00000100:00100000:0.0:1788201597.467657:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 724 00002000:00100000:0.0:1788201597.467676:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (711983104->713031679) req@ffff96248cc96a00 x1875064559688064/t30064771725(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:718/0 lens 488/448 e 0 to 0 dl 1788201608 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201597.467687:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc96a00 with x1875064559688064 ext(711983104->713031679) 00002000:00010000:0.0:1788201597.467694:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc96a00 00010000:00010000:0.0:1788201597.751305:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201597.771181:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201597.771279:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559688192 00000100:00100000:0.0:1788201597.771296:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559688192 00002000:00100000:0.0:1788201597.771403:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (713031680->714080255) req@ffff96248cc95180 x1875064559688192/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:718/0 lens 488/0 e 0 to 0 dl 1788201608 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201597.771417:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc95180 with x1875064559688192 ext(713031680->714080255) 00002000:00010000:0.0:1788201597.771443:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc95180 00000100:00100000:0.0:1788201597.771498:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 725 00000100:00100000:0.0:1788201597.771510:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559688192:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201597.825588:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559688192:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 54063us (54404us total) trans 30064771726 rc 0/0 00000100:00100000:1.0:1788201597.825605:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 725 00002000:00100000:1.0:1788201597.825621:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (713031680->714080255) req@ffff96248cc95180 x1875064559688192/t30064771726(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:718/0 lens 488/448 e 0 to 0 dl 1788201608 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201597.825633:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc95180 with x1875064559688192 ext(713031680->714080255) 00002000:00010000:1.0:1788201597.825651:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc95180 00000100:00100000:3.0:1788201597.917222:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201597.917444:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559688320 00000100:00100000:2.0:1788201597.917457:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559688320 00002000:00100000:2.0:1788201597.917527:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (714080256->715128831) req@ffff96248cc94700 x1875064559688320/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:718/0 lens 488/0 e 0 to 0 dl 1788201608 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201597.917542:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc94700 with x1875064559688320 ext(714080256->715128831) 00002000:00010000:2.0:1788201597.917549:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc94700 00000100:00100000:2.0:1788201597.917590:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 726 00000100:00100000:2.0:1788201597.917601:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2342:x1875064559688320:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201597.932995:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2342:x1875064559688320:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15376us (15773us total) trans 30064771727 rc 0/0 00000100:00100000:1.0:1788201597.933013:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 726 00002000:00100000:1.0:1788201597.933029:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (714080256->715128831) req@ffff96248cc94700 x1875064559688320/t30064771727(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:718/0 lens 488/448 e 0 to 0 dl 1788201608 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201597.935720:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc94700 with x1875064559688320 ext(714080256->715128831) 00002000:00010000:1.0:1788201597.935734:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc94700 00000100:00100000:1.0:1788201598.008050:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570152320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201598.008162:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201598.008256:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570152320 00000100:00100000:3.0:1788201598.008269:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570152320 00000100:00100000:3.0:1788201598.008378:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00080000:1.0:1788201598.008386:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201598.008391:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570152320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201598.008427:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 573767680 pending 46006272 free 3172990976 avail 3170893824 00000100:00100000:3.0:1788201598.011016:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570152320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2613us (2839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.011034:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788201598.017841:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570152320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201598.047182:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201598.053019:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559688448 00000100:00100000:3.0:1788201598.053039:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559688448 00002000:00100000:3.0:1788201598.054297:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (715128832->716177407) req@ffff9624c1e73100 x1875064559688448/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:719/0 lens 488/0 e 0 to 0 dl 1788201609 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201598.054315:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73100 with x1875064559688448 ext(715128832->716177407) 00002000:00010000:3.0:1788201598.054325:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73100 00000100:00100000:3.0:1788201598.054407:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 727 00000100:00100000:3.0:1788201598.054425:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2344:x1875064559688448:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201598.080284:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2344:x1875064559688448:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25857us (33172us total) trans 30064771728 rc 0/0 00000100:00100000:2.0:1788201598.080297:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 727 00002000:00100000:2.0:1788201598.080310:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (715128832->716177407) req@ffff9624c1e73100 x1875064559688448/t30064771728(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:719/0 lens 488/448 e 0 to 0 dl 1788201609 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201598.080322:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73100 with x1875064559688448 ext(715128832->716177407) 00002000:00010000:2.0:1788201598.080328:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73100 00000100:00100000:2.0:1788201598.262830:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201598.263080:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559688576 00000100:00100000:0.0:1788201598.263092:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559688576 00002000:00100000:0.0:1788201598.263147:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (716177408->717225983) req@ffff9624c1e70a80 x1875064559688576/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:719/0 lens 488/0 e 0 to 0 dl 1788201609 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201598.263159:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70a80 with x1875064559688576 ext(716177408->717225983) 00002000:00010000:0.0:1788201598.263165:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70a80 00000100:00100000:0.0:1788201598.263376:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 728 00000100:00100000:0.0:1788201598.263387:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2343:x1875064559688576:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201598.283502:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2343:x1875064559688576:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20105us (20670us total) trans 30064771729 rc 0/0 00000100:00100000:0.0:1788201598.283517:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 728 00002000:00100000:0.0:1788201598.283531:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (716177408->717225983) req@ffff9624c1e70a80 x1875064559688576/t30064771729(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:719/0 lens 488/448 e 0 to 0 dl 1788201609 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201598.283542:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70a80 with x1875064559688576 ext(716177408->717225983) 00002000:00010000:0.0:1788201598.283549:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70a80 00000100:00100000:2.0:1788201598.449954:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201598.450090:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559688704 00000100:00100000:1.0:1788201598.450101:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559688704 00002000:00100000:1.0:1788201598.450150:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (717225984->718274559) req@ffff9624c1e73b80 x1875064559688704/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:719/0 lens 488/0 e 0 to 0 dl 1788201609 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201598.450162:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73b80 with x1875064559688704 ext(717225984->718274559) 00002000:00010000:1.0:1788201598.450168:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73b80 00000100:00100000:1.0:1788201598.450200:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 729 00000100:00100000:1.0:1788201598.450209:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2341:x1875064559688704:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201598.460856:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2341:x1875064559688704:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10635us (10898us total) trans 30064771730 rc 0/0 00000100:00100000:1.0:1788201598.460870:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 729 00002000:00100000:1.0:1788201598.460882:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (717225984->718274559) req@ffff9624c1e73b80 x1875064559688704/t30064771730(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:719/0 lens 488/448 e 0 to 0 dl 1788201609 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201598.460893:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73b80 with x1875064559688704 ext(717225984->718274559) 00002000:00010000:1.0:1788201598.460899:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73b80 00000100:00100000:3.0:1788201598.681611:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201598.681782:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559688832 00000100:00100000:1.0:1788201598.681793:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559688832 00002000:00100000:1.0:1788201598.681856:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (718274560->719323135) req@ffff96248cc97480 x1875064559688832/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:719/0 lens 488/0 e 0 to 0 dl 1788201609 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201598.681870:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97480 with x1875064559688832 ext(718274560->719323135) 00002000:00010000:1.0:1788201598.681877:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97480 00000100:00100000:1.0:1788201598.681920:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 730 00000100:00100000:1.0:1788201598.681931:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2342:x1875064559688832:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201598.693808:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2342:x1875064559688832:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11860us (12195us total) trans 30064771731 rc 0/0 00000100:00100000:1.0:1788201598.693840:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 730 00002000:00100000:1.0:1788201598.693859:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (718274560->719323135) req@ffff96248cc97480 x1875064559688832/t30064771731(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:719/0 lens 488/448 e 0 to 0 dl 1788201609 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201598.693871:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97480 with x1875064559688832 ext(718274560->719323135) 00002000:00010000:1.0:1788201598.693879:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97480 00000001:00080000:2.0:1788201598.701556:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771729 is committed 00000001:00080000:3.0:1788201598.702328:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771730 is committed 00010000:00010000:1.0:1788201598.774775:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201598.853492:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201598.854204:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559688960 00000100:00100000:2.0:1788201598.854219:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559688960 00002000:00100000:2.0:1788201598.854290:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (719323136->720371711) req@ffff9624ba43b800 x1875064559688960/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:719/0 lens 488/0 e 0 to 0 dl 1788201609 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201598.854303:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43b800 with x1875064559688960 ext(719323136->720371711) 00002000:00010000:2.0:1788201598.854310:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43b800 00000100:00100000:2.0:1788201598.854381:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 731 00000100:00100000:2.0:1788201598.854393:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559688960:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201598.889586:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559688960:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35175us (36093us total) trans 30064771732 rc 0/0 00000100:00100000:2.0:1788201598.889607:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 731 00002000:00100000:2.0:1788201598.889638:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (719323136->720371711) req@ffff9624ba43b800 x1875064559688960/t30064771732(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:719/0 lens 488/448 e 0 to 0 dl 1788201609 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201598.889651:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43b800 with x1875064559688960 ext(719323136->720371711) 00002000:00010000:2.0:1788201598.889686:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43b800 00000100:00100000:1.0:1788201598.988755:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201598.996219:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559689088 00000100:00100000:3.0:1788201598.996275:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559689088 00002000:00100000:3.0:1788201598.996384:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (720371712->721420287) req@ffff9624c1e50a80 x1875064559689088/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:719/0 lens 488/0 e 0 to 0 dl 1788201609 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201598.996474:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e50a80 with x1875064559689088 ext(720371712->721420287) 00002000:00010000:3.0:1788201598.996485:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e50a80 00000100:00100000:3.0:1788201598.996539:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 732 00000100:00100000:3.0:1788201598.996552:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559689088:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201599.019067:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559689088:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22498us (30308us total) trans 30064771733 rc 0/0 00000100:00100000:2.0:1788201599.019085:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 732 00002000:00100000:2.0:1788201599.019113:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (720371712->721420287) req@ffff9624c1e50a80 x1875064559689088/t30064771733(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:719/0 lens 488/448 e 0 to 0 dl 1788201609 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201599.019126:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e50a80 with x1875064559689088 ext(720371712->721420287) 00002000:00010000:2.0:1788201599.019136:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e50a80 00000100:00100000:1.0:1788201599.192995:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201599.193332:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559689216 00000100:00100000:0.0:1788201599.193391:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559689216 00002000:00100000:0.0:1788201599.193578:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (721420288->722468863) req@ffff9624c1e53b80 x1875064559689216/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:720/0 lens 488/0 e 0 to 0 dl 1788201610 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201599.193625:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e53b80 with x1875064559689216 ext(721420288->722468863) 00002000:00010000:0.0:1788201599.193634:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e53b80 00000100:00100000:0.0:1788201599.193675:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 733 00000100:00100000:0.0:1788201599.193697:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559689216:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201599.195793:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201599.223813:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559689216:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30111us (30816us total) trans 30064771734 rc 0/0 00000100:00100000:2.0:1788201599.223832:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 733 00002000:00100000:2.0:1788201599.224578:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (721420288->722468863) req@ffff9624c1e53b80 x1875064559689216/t30064771734(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:720/0 lens 488/448 e 0 to 0 dl 1788201610 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201599.224592:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e53b80 with x1875064559689216 ext(721420288->722468863) 00002000:00010000:2.0:1788201599.224601:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e53b80 00000100:00100000:0.0:1788201599.412201:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201599.416265:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559689344 00000100:00100000:1.0:1788201599.416286:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559689344 00002000:00100000:1.0:1788201599.416448:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (722468864->723517439) req@ffff9624ba438000 x1875064559689344/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:720/0 lens 488/0 e 0 to 0 dl 1788201610 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201599.416464:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba438000 with x1875064559689344 ext(722468864->723517439) 00002000:00010000:1.0:1788201599.416628:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba438000 00000100:00100000:1.0:1788201599.416677:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 734 00000100:00100000:1.0:1788201599.416690:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559689344:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201599.435312:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559689344:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18605us (23107us total) trans 30064771735 rc 0/0 00000100:00100000:1.0:1788201599.435332:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 734 00002000:00100000:1.0:1788201599.435362:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (722468864->723517439) req@ffff9624ba438000 x1875064559689344/t30064771735(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:720/0 lens 488/448 e 0 to 0 dl 1788201610 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201599.435374:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba438000 with x1875064559689344 ext(722468864->723517439) 00002000:00010000:1.0:1788201599.435402:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba438000 00000100:00100000:3.0:1788201599.585222:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201599.586650:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559689472 00000100:00100000:2.0:1788201599.586664:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559689472 00002000:00100000:2.0:1788201599.586740:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (723517440->724566015) req@ffff96248cc97800 x1875064559689472/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:720/0 lens 488/0 e 0 to 0 dl 1788201610 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201599.586753:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97800 with x1875064559689472 ext(723517440->724566015) 00002000:00010000:2.0:1788201599.586760:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97800 00000100:00100000:2.0:1788201599.586810:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 735 00000100:00100000:2.0:1788201599.586822:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559689472:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201599.627813:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559689472:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 40975us (42588us total) trans 30064771736 rc 0/0 00000100:00100000:1.0:1788201599.627836:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 735 00002000:00100000:1.0:1788201599.627855:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (723517440->724566015) req@ffff96248cc97800 x1875064559689472/t30064771736(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:720/0 lens 488/448 e 0 to 0 dl 1788201610 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201599.627867:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97800 with x1875064559689472 ext(723517440->724566015) 00002000:00010000:1.0:1788201599.627874:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97800 00000100:00100000:3.0:1788201599.796127:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201599.796184:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201599.797740:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559689728 00000100:00100000:1.0:1788201599.797764:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559689728 00000100:00100000:1.0:1788201599.797884:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 423 00000100:00100000:1.0:1788201599.797897:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559689728:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201599.798003:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559689728:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 109us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201599.798011:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 423 00000100:00100000:0.0:1788201599.798261:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559689600 00000100:00100000:0.0:1788201599.798267:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559689600 00000100:00100000:0.0:1788201599.798305:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 554 00000100:00100000:0.0:1788201599.798312:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559689600:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201599.798383:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559689600:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 31us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201599.798390:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 554 00000100:00080000:1.0:1788201599.799504:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201599.804136:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201599.948756:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201599.948883:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559689856 00000100:00100000:0.0:1788201599.948896:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559689856 00002000:00100000:0.0:1788201599.948967:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (724566016->725614591) req@ffff9624ba859880 x1875064559689856/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:720/0 lens 488/0 e 0 to 0 dl 1788201610 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201599.948980:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba859880 with x1875064559689856 ext(724566016->725614591) 00002000:00010000:0.0:1788201599.948987:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba859880 00000100:00100000:0.0:1788201599.949030:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 736 00000100:00100000:0.0:1788201599.949042:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559689856:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201599.980712:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559689856:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31653us (31952us total) trans 30064771737 rc 0/0 00000100:00100000:0.0:1788201599.980732:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 736 00002000:00100000:0.0:1788201599.980767:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (724566016->725614591) req@ffff9624ba859880 x1875064559689856/t30064771737(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:720/0 lens 488/448 e 0 to 0 dl 1788201610 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201599.980780:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba859880 with x1875064559689856 ext(724566016->725614591) 00002000:00010000:0.0:1788201599.980787:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba859880 00000100:00100000:2.0:1788201600.194063:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201600.198906:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559689984 00000100:00100000:0.0:1788201600.198925:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559689984 00002000:00100000:0.0:1788201600.198990:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (725614592->726663167) req@ffff9624ba85b100 x1875064559689984/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:721/0 lens 488/0 e 0 to 0 dl 1788201611 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201600.199003:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85b100 with x1875064559689984 ext(725614592->726663167) 00002000:00010000:0.0:1788201600.199008:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85b100 00000100:00100000:0.0:1788201600.199129:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 737 00000100:00100000:0.0:1788201600.199141:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559689984:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201600.213409:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559689984:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14259us (19346us total) trans 30064771738 rc 0/0 00000100:00100000:0.0:1788201600.213421:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 737 00002000:00100000:0.0:1788201600.213434:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (725614592->726663167) req@ffff9624ba85b100 x1875064559689984/t30064771738(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:721/0 lens 488/448 e 0 to 0 dl 1788201611 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201600.213446:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85b100 with x1875064559689984 ext(725614592->726663167) 00002000:00010000:0.0:1788201600.213452:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85b100 00000100:00100000:2.0:1788201600.422860:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201600.422929:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559690112 00000100:00100000:1.0:1788201600.422938:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559690112 00002000:00100000:1.0:1788201600.422985:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (726663168->727711743) req@ffff9624ba85a680 x1875064559690112/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:721/0 lens 488/0 e 0 to 0 dl 1788201611 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201600.422993:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85a680 with x1875064559690112 ext(726663168->727711743) 00002000:00010000:1.0:1788201600.422997:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85a680 00000100:00100000:1.0:1788201600.423025:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 738 00000100:00100000:1.0:1788201600.423035:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559690112:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201600.432312:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559690112:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9267us (9447us total) trans 30064771739 rc 0/0 00000100:00100000:1.0:1788201600.432363:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 738 00002000:00100000:1.0:1788201600.432382:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (726663168->727711743) req@ffff9624ba85a680 x1875064559690112/t30064771739(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:721/0 lens 488/448 e 0 to 0 dl 1788201611 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201600.432390:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85a680 with x1875064559690112 ext(726663168->727711743) 00002000:00010000:1.0:1788201600.432395:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85a680 00000100:00100000:3.0:1788201600.568299:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570152448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201600.568412:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201600.568639:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570152448 00000100:00100000:2.0:1788201600.568648:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570152448 00000100:00100000:2.0:1788201600.568732:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788201600.568744:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570152448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201600.568781:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201600.568829:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570152448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201600.568836:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00010000:00080000:3.0:1788201600.569033:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e52300 x1875064570152448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201600.569053:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570152448:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201600.571773:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201600.612604:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201600.612941:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559690240 00000100:00100000:1.0:1788201600.612953:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559690240 00002000:00100000:1.0:1788201600.613010:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (727711744->728760319) req@ffff9624ba85aa00 x1875064559690240/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:721/0 lens 488/0 e 0 to 0 dl 1788201611 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201600.613022:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85aa00 with x1875064559690240 ext(727711744->728760319) 00002000:00010000:1.0:1788201600.613029:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85aa00 00000100:00100000:1.0:1788201600.613160:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 739 00000100:00100000:1.0:1788201600.613250:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559690240:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201600.647940:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559690240:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34758us (35347us total) trans 30064771740 rc 0/0 00000100:00100000:1.0:1788201600.647955:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 739 00002000:00100000:1.0:1788201600.647968:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (727711744->728760319) req@ffff9624ba85aa00 x1875064559690240/t30064771740(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:721/0 lens 488/448 e 0 to 0 dl 1788201611 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201600.647980:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85aa00 with x1875064559690240 ext(727711744->728760319) 00002000:00010000:1.0:1788201600.647987:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85aa00 00000100:00100000:2.0:1788201600.729135:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201600.729281:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559690368 00000100:00100000:0.0:1788201600.729293:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559690368 00002000:00100000:0.0:1788201600.729387:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (728760320->729808895) req@ffff9624b9de9500 x1875064559690368/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:721/0 lens 488/0 e 0 to 0 dl 1788201611 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201600.729400:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de9500 with x1875064559690368 ext(728760320->729808895) 00002000:00010000:0.0:1788201600.729421:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de9500 00000100:00100000:0.0:1788201600.729458:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 740 00000100:00100000:0.0:1788201600.729469:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559690368:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201600.745957:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559690368:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16478us (16821us total) trans 30064771741 rc 0/0 00000100:00100000:0.0:1788201600.745971:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 740 00002000:00100000:0.0:1788201600.745985:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (728760320->729808895) req@ffff9624b9de9500 x1875064559690368/t30064771741(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:721/0 lens 488/448 e 0 to 0 dl 1788201611 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201600.745996:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de9500 with x1875064559690368 ext(728760320->729808895) 00002000:00010000:0.0:1788201600.746003:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de9500 00010000:00010000:0.0:1788201600.823626:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201600.897035:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201600.897169:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559690496 00000100:00100000:1.0:1788201600.897189:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559690496 00002000:00100000:1.0:1788201600.897260:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (729808896->730857471) req@ffff9624b9deb480 x1875064559690496/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:721/0 lens 488/0 e 0 to 0 dl 1788201611 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201600.897272:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9deb480 with x1875064559690496 ext(729808896->730857471) 00002000:00010000:1.0:1788201600.897277:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9deb480 00000100:00100000:1.0:1788201600.897308:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 741 00000100:00100000:1.0:1788201600.897315:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559690496:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201600.913096:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559690496:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15769us (16059us total) trans 30064771742 rc 0/0 00000100:00100000:0.0:1788201600.913110:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 741 00002000:00100000:0.0:1788201600.913124:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (729808896->730857471) req@ffff9624b9deb480 x1875064559690496/t30064771742(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:721/0 lens 488/448 e 0 to 0 dl 1788201611 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201600.913134:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9deb480 with x1875064559690496 ext(729808896->730857471) 00002000:00010000:0.0:1788201600.913141:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9deb480 00000100:00100000:3.0:1788201601.079607:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570152960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.079688:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201601.079768:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788201601.079774:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570152576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.079803:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201601.079825:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570153088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.079848:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201601.079879:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570152960 00000100:00100000:3.0:1788201601.079886:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570152960 00000100:00100000:1.0:1788201601.079940:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570152576 00000100:00100000:1.0:1788201601.079945:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570152576 00000100:00100000:1.0:1788201601.079987:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:3.0:1788201601.079987:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1788201601.079994:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570152576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.079995:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570152960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.080047:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570152576:12345-0@lo:400:kworker.0 Request processed in 48us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201601.080056:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1788201601.080082:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570152704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.080113:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201601.080135:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570153216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.080157:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201601.080188:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201601.080213:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570152832:0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.080238:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201601.080280:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570152704 00000100:00100000:0.0:1788201601.080284:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570152704 00000100:00100000:0.0:1788201601.080314:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570153216 00000100:00100000:0.0:1788201601.080317:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570153216 00000100:00100000:0.0:1788201601.080331:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1788201601.080336:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570152704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.080397:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570152704:12345-0@lo:400:kworker.0 Request processed in 60us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.080404:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1788201601.080418:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1788201601.080425:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570153216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.080451:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570153216:12345-0@lo:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.080458:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1788201601.080499:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570152704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.080510:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570153216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.081721:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570153088 00000100:00100000:0.0:1788201601.081729:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570153088 00000100:00100000:0.0:1788201601.081764:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570152832 00000100:00100000:0.0:1788201601.081767:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570152832 00000100:00100000:0.0:1788201601.081791:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788201601.081799:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570153088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201601.081943:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00080000:1.0:1788201601.081952:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201601.081952:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570152832:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788201601.081957:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201601.082004:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570152832:12345-0@lo:400:kworker.0 Request processed in 53us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201601.082010:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788201601.082049:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570152832:0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.089047:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570152960:12345-0@lo:400:kworker.0 Request processed in 9039us (9345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201601.089079:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1788201601.091708:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570153088:12345-0@lo:400:kworker.0 Request processed in 9892us (11841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.091723:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788201601.092698:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570152576:0@lo:400:kworker.0 00010000:00080000:1.0:1788201601.092729:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9dea300 x1875064570153088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201601.092742:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570153088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.092758:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570152960:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.137526:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201601.142967:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559690624 00000100:00100000:2.0:1788201601.142984:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559690624 00002000:00100000:2.0:1788201601.143137:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (730857472->731906047) req@ffff9624c1e51f80 x1875064559690624/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:722/0 lens 488/0 e 0 to 0 dl 1788201612 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201601.143150:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e51f80 with x1875064559690624 ext(730857472->731906047) 00002000:00010000:2.0:1788201601.143156:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e51f80 00000100:00100000:2.0:1788201601.143213:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 742 00000100:00100000:2.0:1788201601.143224:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2341:x1875064559690624:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201601.147782:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201601.159958:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559690624:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16724us (22434us total) trans 30064771743 rc 0/0 00000100:00100000:2.0:1788201601.159972:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 742 00002000:00100000:2.0:1788201601.159985:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (730857472->731906047) req@ffff9624c1e51f80 x1875064559690624/t30064771743(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:722/0 lens 488/448 e 0 to 0 dl 1788201612 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201601.159995:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e51f80 with x1875064559690624 ext(730857472->731906047) 00002000:00010000:2.0:1788201601.160001:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e51f80 00000100:00100000:1.0:1788201601.346181:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201601.346391:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559690752 00000100:00100000:3.0:1788201601.346401:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559690752 00002000:00100000:3.0:1788201601.346565:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (731906048->732954623) req@ffff9624c1e53480 x1875064559690752/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:722/0 lens 488/0 e 0 to 0 dl 1788201612 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201601.346585:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e53480 with x1875064559690752 ext(731906048->732954623) 00002000:00010000:3.0:1788201601.346592:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e53480 00000100:00100000:3.0:1788201601.346626:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 743 00000100:00100000:3.0:1788201601.346636:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559690752:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201601.374333:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559690752:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27687us (28151us total) trans 30064771744 rc 0/0 00000100:00100000:3.0:1788201601.374386:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 743 00002000:00100000:3.0:1788201601.374400:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (731906048->732954623) req@ffff9624c1e53480 x1875064559690752/t30064771744(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:722/0 lens 488/448 e 0 to 0 dl 1788201612 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201601.374411:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e53480 with x1875064559690752 ext(731906048->732954623) 00002000:00010000:3.0:1788201601.374418:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e53480 00000100:00100000:0.0:1788201601.558156:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201601.558271:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559690880 00000100:00100000:2.0:1788201601.558282:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559690880 00002000:00100000:2.0:1788201601.558336:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (732954624->734003199) req@ffff9624ba43a300 x1875064559690880/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:722/0 lens 488/0 e 0 to 0 dl 1788201612 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201601.558388:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43a300 with x1875064559690880 ext(732954624->734003199) 00002000:00010000:2.0:1788201601.558394:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43a300 00000100:00100000:2.0:1788201601.558433:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 744 00000100:00100000:2.0:1788201601.558445:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559690880:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201601.582499:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559690880:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24047us (24344us total) trans 30064771745 rc 0/0 00000100:00100000:2.0:1788201601.582515:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 744 00002000:00100000:2.0:1788201601.582528:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (732954624->734003199) req@ffff9624ba43a300 x1875064559690880/t30064771745(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:722/0 lens 488/448 e 0 to 0 dl 1788201612 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201601.582540:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43a300 with x1875064559690880 ext(732954624->734003199) 00002000:00010000:2.0:1788201601.582559:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43a300 00000100:00100000:3.0:1788201601.781166:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201601.781432:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559691008 00000100:00100000:0.0:1788201601.781505:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559691008 00002000:00100000:0.0:1788201601.781563:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (734003200->735051775) req@ffff96248cc94a80 x1875064559691008/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:722/0 lens 488/0 e 0 to 0 dl 1788201612 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201601.781586:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc94a80 with x1875064559691008 ext(734003200->735051775) 00002000:00010000:0.0:1788201601.781592:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc94a80 00000100:00100000:0.0:1788201601.781663:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 745 00000100:00100000:0.0:1788201601.781674:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559691008:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201601.794635:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559691008:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12952us (13467us total) trans 30064771746 rc 0/0 00000100:00100000:0.0:1788201601.794651:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 745 00002000:00100000:0.0:1788201601.794665:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (734003200->735051775) req@ffff96248cc94a80 x1875064559691008/t30064771746(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:722/0 lens 488/448 e 0 to 0 dl 1788201612 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201601.794677:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc94a80 with x1875064559691008 ext(734003200->735051775) 00002000:00010000:0.0:1788201601.794683:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc94a80 00010000:00010000:1.0:1788201601.848389:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201602.081014:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201602.081691:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559691136 00000100:00100000:1.0:1788201602.081705:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559691136 00002000:00100000:1.0:1788201602.081766:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (735051776->736100351) req@ffff9624bfd9a680 x1875064559691136/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:723/0 lens 488/0 e 0 to 0 dl 1788201613 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201602.081778:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9a680 with x1875064559691136 ext(735051776->736100351) 00002000:00010000:1.0:1788201602.081783:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9a680 00000100:00100000:1.0:1788201602.081818:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 746 00000100:00100000:1.0:1788201602.081829:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559691136:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201602.107865:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559691136:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26025us (26848us total) trans 30064771747 rc 0/0 00000100:00100000:3.0:1788201602.107880:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 746 00002000:00100000:3.0:1788201602.107909:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (735051776->736100351) req@ffff9624bfd9a680 x1875064559691136/t30064771747(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:723/0 lens 488/448 e 0 to 0 dl 1788201613 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201602.107917:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9a680 with x1875064559691136 ext(735051776->736100351) 00002000:00010000:3.0:1788201602.107922:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9a680 00000100:00100000:2.0:1788201602.465721:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201602.465866:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559691264 00000100:00100000:3.0:1788201602.465878:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559691264 00002000:00100000:3.0:1788201602.465935:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (736100352->737148927) req@ffff9624bfd9bb80 x1875064559691264/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:723/0 lens 488/0 e 0 to 0 dl 1788201613 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201602.465946:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9bb80 with x1875064559691264 ext(736100352->737148927) 00002000:00010000:3.0:1788201602.465952:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9bb80 00000100:00100000:3.0:1788201602.465983:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 747 00000100:00100000:3.0:1788201602.465993:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559691264:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201602.486192:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559691264:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20191us (20473us total) trans 30064771748 rc 0/0 00000100:00100000:3.0:1788201602.486204:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 747 00002000:00100000:3.0:1788201602.486281:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (736100352->737148927) req@ffff9624bfd9bb80 x1875064559691264/t30064771748(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:723/0 lens 488/448 e 0 to 0 dl 1788201613 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201602.486292:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9bb80 with x1875064559691264 ext(736100352->737148927) 00002000:00010000:3.0:1788201602.486299:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9bb80 00000100:00100000:0.0:1788201602.736151:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201602.736230:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559691392 00000100:00100000:2.0:1788201602.736243:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559691392 00002000:00100000:2.0:1788201602.736299:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (737148928->738197503) req@ffff9624ba43aa00 x1875064559691392/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:723/0 lens 488/0 e 0 to 0 dl 1788201613 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201602.736311:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43aa00 with x1875064559691392 ext(737148928->738197503) 00002000:00010000:2.0:1788201602.736317:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43aa00 00000100:00100000:2.0:1788201602.736393:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 748 00000100:00100000:2.0:1788201602.736404:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559691392:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201602.763240:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559691392:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26825us (27089us total) trans 30064771749 rc 0/0 00000100:00100000:2.0:1788201602.763254:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 748 00002000:00100000:2.0:1788201602.763269:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (737148928->738197503) req@ffff9624ba43aa00 x1875064559691392/t30064771749(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:723/0 lens 488/448 e 0 to 0 dl 1788201613 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201602.763280:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43aa00 with x1875064559691392 ext(737148928->738197503) 00002000:00010000:2.0:1788201602.763286:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43aa00 00010000:00010000:2.0:1788201602.870641:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201602.989393:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201602.989591:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559691520 00000100:00100000:1.0:1788201602.989603:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559691520 00002000:00100000:1.0:1788201602.989664:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (738197504->739246079) req@ffff96248cc97b80 x1875064559691520/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:723/0 lens 488/0 e 0 to 0 dl 1788201613 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201602.989675:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97b80 with x1875064559691520 ext(738197504->739246079) 00002000:00010000:1.0:1788201602.989681:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97b80 00000100:00100000:1.0:1788201602.989717:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 749 00000100:00100000:1.0:1788201602.989727:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559691520:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201603.017647:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559691520:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27910us (28300us total) trans 30064771750 rc 0/0 00000100:00100000:1.0:1788201603.017665:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 749 00002000:00100000:1.0:1788201603.017679:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (738197504->739246079) req@ffff96248cc97b80 x1875064559691520/t30064771750(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:723/0 lens 488/448 e 0 to 0 dl 1788201613 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201603.017689:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc97b80 with x1875064559691520 ext(738197504->739246079) 00002000:00010000:1.0:1788201603.017695:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc97b80 00000100:00100000:3.0:1788201603.127574:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cc96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570153344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201603.127646:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201603.127725:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570153344 00000100:00100000:3.0:1788201603.127733:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570153344 00000100:00100000:3.0:1788201603.127812:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788201603.127823:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570153344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201603.127845:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 561971200 pending 34078720 free 3141533696 avail 3139436544 00000100:00100000:3.0:1788201603.127933:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570153344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201603.127941:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:3.0:1788201603.127967:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201603.128005:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cc96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570153344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201603.322040:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201603.322154:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559691648 00000100:00100000:1.0:1788201603.322174:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559691648 00002000:00100000:1.0:1788201603.322246:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (739246080->740294655) req@ffff96248cc96d80 x1875064559691648/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:724/0 lens 488/0 e 0 to 0 dl 1788201614 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201603.322258:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc96d80 with x1875064559691648 ext(739246080->740294655) 00002000:00010000:1.0:1788201603.322263:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc96d80 00000100:00100000:1.0:1788201603.322298:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 750 00000100:00100000:1.0:1788201603.322309:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559691648:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201603.322786:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201603.357184:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559691648:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34867us (35145us total) trans 30064771751 rc 0/0 00000100:00100000:1.0:1788201603.357200:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 750 00002000:00100000:1.0:1788201603.357215:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (739246080->740294655) req@ffff96248cc96d80 x1875064559691648/t30064771751(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:724/0 lens 488/448 e 0 to 0 dl 1788201614 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201603.357226:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc96d80 with x1875064559691648 ext(739246080->740294655) 00002000:00010000:1.0:1788201603.357233:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc96d80 00000100:00100000:3.0:1788201603.625656:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201603.625835:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559691776 00000100:00100000:1.0:1788201603.625847:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559691776 00002000:00100000:1.0:1788201603.626021:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (740294656->741343231) req@ffff96248cc96300 x1875064559691776/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:724/0 lens 488/0 e 0 to 0 dl 1788201614 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201603.626034:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc96300 with x1875064559691776 ext(740294656->741343231) 00002000:00010000:1.0:1788201603.626042:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc96300 00000100:00100000:1.0:1788201603.626089:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 751 00000100:00100000:1.0:1788201603.626100:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2342:x1875064559691776:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201603.663231:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559691776:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37115us (37569us total) trans 30064771752 rc 0/0 00000100:00100000:2.0:1788201603.663254:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 751 00002000:00100000:2.0:1788201603.663271:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (740294656->741343231) req@ffff96248cc96300 x1875064559691776/t30064771752(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:724/0 lens 488/448 e 0 to 0 dl 1788201614 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201603.663322:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cc96300 with x1875064559691776 ext(740294656->741343231) 00002000:00010000:2.0:1788201603.663330:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cc96300 00000100:00100000:2.0:1788201603.789719:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201603.790134:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559691904 00000100:00100000:0.0:1788201603.790145:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559691904 00002000:00100000:0.0:1788201603.790201:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (741343232->742391807) req@ffff9624bfd99880 x1875064559691904/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:724/0 lens 488/0 e 0 to 0 dl 1788201614 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201603.790213:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99880 with x1875064559691904 ext(741343232->742391807) 00002000:00010000:0.0:1788201603.790219:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99880 00000100:00100000:0.0:1788201603.790248:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 752 00000100:00100000:0.0:1788201603.790259:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2341:x1875064559691904:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201603.798922:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2341:x1875064559691904:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8652us (9202us total) trans 30064771753 rc 0/0 00000100:00100000:0.0:1788201603.798935:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 752 00002000:00100000:0.0:1788201603.798949:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (741343232->742391807) req@ffff9624bfd99880 x1875064559691904/t30064771753(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:724/0 lens 488/448 e 0 to 0 dl 1788201614 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201603.798960:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99880 with x1875064559691904 ext(741343232->742391807) 00002000:00010000:0.0:1788201603.798966:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99880 00000001:00080000:2.0:1788201603.843668:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771746 is committed 00000001:00080000:2.0:1788201603.843709:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771751 is committed 00010000:00010000:0.0:1788201603.895042:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201604.185959:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201604.186125:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559692032 00000100:00100000:1.0:1788201604.186137:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559692032 00002000:00100000:1.0:1788201604.186207:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (742391808->743440383) req@ffff9624ba438e00 x1875064559692032/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:725/0 lens 488/0 e 0 to 0 dl 1788201615 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201604.186220:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba438e00 with x1875064559692032 ext(742391808->743440383) 00002000:00010000:1.0:1788201604.186225:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba438e00 00000100:00100000:1.0:1788201604.186272:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 753 00000100:00100000:1.0:1788201604.186282:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559692032:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201604.208453:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559692032:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22154us (22488us total) trans 30064771754 rc 0/0 00000100:00100000:1.0:1788201604.208473:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 753 00002000:00100000:1.0:1788201604.208489:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (742391808->743440383) req@ffff9624ba438e00 x1875064559692032/t30064771754(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:725/0 lens 488/448 e 0 to 0 dl 1788201615 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201604.208502:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba438e00 with x1875064559692032 ext(742391808->743440383) 00002000:00010000:1.0:1788201604.208509:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba438e00 00000100:00100000:3.0:1788201604.428758:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201604.428882:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559692160 00000100:00100000:0.0:1788201604.428894:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559692160 00002000:00100000:0.0:1788201604.428956:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (743440384->744488959) req@ffff9623812a4a80 x1875064559692160/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:725/0 lens 488/0 e 0 to 0 dl 1788201615 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201604.428969:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a4a80 with x1875064559692160 ext(743440384->744488959) 00002000:00010000:0.0:1788201604.428976:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a4a80 00000100:00100000:0.0:1788201604.429028:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 754 00000100:00100000:0.0:1788201604.429038:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559692160:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201604.457744:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559692160:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28692us (28985us total) trans 30064771755 rc 0/0 00000100:00100000:1.0:1788201604.457761:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 754 00002000:00100000:1.0:1788201604.457777:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (743440384->744488959) req@ffff9623812a4a80 x1875064559692160/t30064771755(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:725/0 lens 488/448 e 0 to 0 dl 1788201615 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201604.457789:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a4a80 with x1875064559692160 ext(743440384->744488959) 00002000:00010000:1.0:1788201604.457796:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a4a80 00000100:00100000:0.0:1788201604.682263:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201604.687242:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559692288 00000100:00100000:3.0:1788201604.687263:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559692288 00002000:00100000:3.0:1788201604.687365:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (744488960->745537535) req@ffff9624b9de8380 x1875064559692288/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:725/0 lens 488/0 e 0 to 0 dl 1788201615 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201604.687379:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de8380 with x1875064559692288 ext(744488960->745537535) 00002000:00010000:3.0:1788201604.687386:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de8380 00000100:00100000:3.0:1788201604.687423:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 755 00000100:00100000:3.0:1788201604.687434:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559692288:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201604.707422:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559692288:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19972us (25156us total) trans 30064771756 rc 0/0 00000100:00100000:3.0:1788201604.707441:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 755 00002000:00100000:3.0:1788201604.707456:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (744488960->745537535) req@ffff9624b9de8380 x1875064559692288/t30064771756(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:725/0 lens 488/448 e 0 to 0 dl 1788201615 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201604.707492:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de8380 with x1875064559692288 ext(744488960->745537535) 00002000:00010000:3.0:1788201604.707499:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de8380 00000100:00100000:0.0:1788201604.916699:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201604.916758:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201604.916907:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559692544 00000100:00100000:1.0:1788201604.916917:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559692544 00000100:00100000:1.0:1788201604.917010:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 427 00000100:00100000:1.0:1788201604.917022:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559692544:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201604.917134:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559692544:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 114us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201604.917143:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 427 00000100:00080000:3.0:1788201604.918018:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788201604.918953:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201604.919424:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559692416 00000100:00100000:2.0:1788201604.919436:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559692416 00000100:00100000:2.0:1788201604.919506:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 556 00000100:00100000:2.0:1788201604.919526:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559692416:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201604.919619:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559692416:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 105us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201604.919627:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 556 00000100:00100000:0.0:1788201604.957089:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201604.957265:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559692672 00000100:00100000:2.0:1788201604.957277:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559692672 00002000:00100000:2.0:1788201604.957386:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (745537536->746586111) req@ffff9624b9de8700 x1875064559692672/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:725/0 lens 488/0 e 0 to 0 dl 1788201615 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201604.957398:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de8700 with x1875064559692672 ext(745537536->746586111) 00002000:00010000:2.0:1788201604.957836:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de8700 00000100:00100000:2.0:1788201604.957925:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 756 00000100:00100000:2.0:1788201604.957937:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559692672:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201604.972259:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559692672:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14316us (15171us total) trans 30064771757 rc 0/0 00000100:00100000:2.0:1788201604.972269:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 756 00002000:00100000:2.0:1788201604.972280:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (745537536->746586111) req@ffff9624b9de8700 x1875064559692672/t30064771757(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:725/0 lens 488/448 e 0 to 0 dl 1788201615 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201604.976716:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de8700 with x1875064559692672 ext(745537536->746586111) 00002000:00010000:2.0:1788201604.976729:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de8700 00000100:00100000:0.0:1788201605.184830:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201605.184934:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559692800 00000100:00100000:1.0:1788201605.184950:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559692800 00002000:00100000:1.0:1788201605.185045:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (746586112->747634687) req@ffff9624b9dead80 x1875064559692800/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:726/0 lens 488/0 e 0 to 0 dl 1788201616 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201605.185059:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9dead80 with x1875064559692800 ext(746586112->747634687) 00002000:00010000:1.0:1788201605.185065:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9dead80 00000100:00100000:1.0:1788201605.185104:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 757 00000100:00100000:1.0:1788201605.185116:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559692800:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201605.185493:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201605.219139:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559692800:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34010us (34304us total) trans 30064771758 rc 0/0 00000100:00100000:1.0:1788201605.219157:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 757 00002000:00100000:1.0:1788201605.219172:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (746586112->747634687) req@ffff9624b9dead80 x1875064559692800/t30064771758(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:726/0 lens 488/448 e 0 to 0 dl 1788201616 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201605.219184:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9dead80 with x1875064559692800 ext(746586112->747634687) 00002000:00010000:1.0:1788201605.219193:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9dead80 00000100:00100000:2.0:1788201605.377234:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201605.383022:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559692928 00000100:00100000:1.0:1788201605.383043:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559692928 00002000:00100000:1.0:1788201605.383123:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (747634688->748683263) req@ffff9624bfd9aa00 x1875064559692928/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:726/0 lens 488/0 e 0 to 0 dl 1788201616 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201605.383136:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9aa00 with x1875064559692928 ext(747634688->748683263) 00002000:00010000:1.0:1788201605.383161:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9aa00 00000100:00100000:1.0:1788201605.383209:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 758 00000100:00100000:1.0:1788201605.383221:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559692928:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201605.394592:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559692928:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11356us (17356us total) trans 30064771759 rc 0/0 00000100:00100000:1.0:1788201605.394610:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 758 00002000:00100000:1.0:1788201605.394626:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (747634688->748683263) req@ffff9624bfd9aa00 x1875064559692928/t30064771759(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:726/0 lens 488/448 e 0 to 0 dl 1788201616 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201605.394639:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9aa00 with x1875064559692928 ext(747634688->748683263) 00002000:00010000:1.0:1788201605.394646:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9aa00 00000100:00100000:3.0:1788201605.544653:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201605.544815:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559693056 00000100:00100000:2.0:1788201605.544826:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559693056 00002000:00100000:2.0:1788201605.544886:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (748683264->749731839) req@ffff9623812a6300 x1875064559693056/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:726/0 lens 488/0 e 0 to 0 dl 1788201616 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201605.544899:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a6300 with x1875064559693056 ext(748683264->749731839) 00002000:00010000:2.0:1788201605.544906:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a6300 00000100:00100000:2.0:1788201605.544947:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 759 00000100:00100000:2.0:1788201605.544957:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559693056:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201605.574941:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559693056:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29964us (30280us total) trans 30064771760 rc 0/0 00000100:00100000:3.0:1788201605.574964:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 759 00002000:00100000:3.0:1788201605.574983:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (748683264->749731839) req@ffff9623812a6300 x1875064559693056/t30064771760(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:726/0 lens 488/448 e 0 to 0 dl 1788201616 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201605.575004:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a6300 with x1875064559693056 ext(748683264->749731839) 00002000:00010000:3.0:1788201605.575011:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a6300 00000100:00100000:2.0:1788201605.647463:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201605.647667:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559693184 00000100:00100000:0.0:1788201605.647679:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559693184 00002000:00100000:0.0:1788201605.647742:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (749731840->750780415) req@ffff9624bfd99180 x1875064559693184/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:726/0 lens 488/0 e 0 to 0 dl 1788201616 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201605.647771:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99180 with x1875064559693184 ext(749731840->750780415) 00002000:00010000:0.0:1788201605.647778:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99180 00000100:00100000:0.0:1788201605.647882:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 760 00000100:00100000:0.0:1788201605.647894:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559693184:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201605.654934:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559693184:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 7027us (7471us total) trans 30064771761 rc 0/0 00000100:00100000:2.0:1788201605.654950:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 760 00002000:00100000:2.0:1788201605.654965:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (749731840->750780415) req@ffff9624bfd99180 x1875064559693184/t30064771761(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:726/0 lens 488/448 e 0 to 0 dl 1788201616 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201605.654977:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99180 with x1875064559693184 ext(749731840->750780415) 00002000:00010000:2.0:1788201605.654985:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99180 00000100:00100000:3.0:1788201605.687697:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570153472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201605.687790:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201605.692639:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570153472 00000100:00100000:1.0:1788201605.692658:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570153472 00000100:00100000:0.0:1788201605.695378:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788201605.695394:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570153472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201605.695445:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201605.695564:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570153472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (7773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201605.695572:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00010000:00080000:1.0:1788201605.696908:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e53800 x1875064570153472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201605.696937:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570153472:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201605.699378:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201605.745837:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201605.747607:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559693312 00000100:00100000:1.0:1788201605.747624:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559693312 00002000:00100000:1.0:1788201605.747699:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (750780416->751828991) req@ffff9623812a7b80 x1875064559693312/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:726/0 lens 488/0 e 0 to 0 dl 1788201616 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201605.747714:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a7b80 with x1875064559693312 ext(750780416->751828991) 00002000:00010000:1.0:1788201605.747720:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a7b80 00000100:00100000:1.0:1788201605.747762:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 761 00000100:00100000:1.0:1788201605.747772:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559693312:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201605.767279:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559693312:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19488us (21452us total) trans 30064771762 rc 0/0 00000100:00100000:1.0:1788201605.767449:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 761 00002000:00100000:1.0:1788201605.767469:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (750780416->751828991) req@ffff9623812a7b80 x1875064559693312/t30064771762(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:726/0 lens 488/448 e 0 to 0 dl 1788201616 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201605.767481:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a7b80 with x1875064559693312 ext(750780416->751828991) 00002000:00010000:1.0:1788201605.767489:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a7b80 00010000:00010000:2.0:1788201605.948512:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201605.983460:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201605.983594:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559693440 00000100:00100000:1.0:1788201605.983605:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559693440 00002000:00100000:1.0:1788201605.983669:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (751828992->752877567) req@ffff9623812a4380 x1875064559693440/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:726/0 lens 488/0 e 0 to 0 dl 1788201616 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201605.983681:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a4380 with x1875064559693440 ext(751828992->752877567) 00002000:00010000:1.0:1788201605.983687:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a4380 00000100:00100000:1.0:1788201605.983728:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 762 00000100:00100000:1.0:1788201605.983739:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559693440:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201606.008178:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559693440:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24425us (24718us total) trans 30064771763 rc 0/0 00000100:00100000:1.0:1788201606.008195:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 762 00002000:00100000:1.0:1788201606.008209:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (751828992->752877567) req@ffff9623812a4380 x1875064559693440/t30064771763(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:726/0 lens 488/448 e 0 to 0 dl 1788201616 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201606.008222:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a4380 with x1875064559693440 ext(751828992->752877567) 00002000:00010000:1.0:1788201606.008228:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a4380 00000100:00100000:3.0:1788201606.111719:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201606.111868:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559693568 00000100:00100000:2.0:1788201606.111880:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559693568 00002000:00100000:2.0:1788201606.111938:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (752877568->753926143) req@ffff9623812a4700 x1875064559693568/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:727/0 lens 488/0 e 0 to 0 dl 1788201617 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201606.112103:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a4700 with x1875064559693568 ext(752877568->753926143) 00002000:00010000:2.0:1788201606.112111:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a4700 00000100:00100000:2.0:1788201606.112151:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 763 00000100:00100000:2.0:1788201606.112162:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623812a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559693568:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201606.166383:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623812a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559693568:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 54205us (54661us total) trans 30064771764 rc 0/0 00000100:00100000:2.0:1788201606.166402:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 763 00002000:00100000:2.0:1788201606.166417:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (752877568->753926143) req@ffff9623812a4700 x1875064559693568/t30064771764(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:727/0 lens 488/448 e 0 to 0 dl 1788201617 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201606.166430:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623812a4700 with x1875064559693568 ext(752877568->753926143) 00002000:00010000:2.0:1788201606.166437:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623812a4700 00000100:00100000:0.0:1788201606.200240:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570153856:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.200335:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201606.200417:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788201606.200423:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570153728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.200450:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201606.200466:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570154240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.200484:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201606.200606:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570153600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201606.200646:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201606.200680:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570154112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201606.200703:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201606.200722:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201606.200726:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bb8b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570153984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201606.200767:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201606.200796:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570153728 00000100:00100000:3.0:1788201606.200803:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570153728 00000100:00100000:3.0:1788201606.200860:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570154240 00000100:00100000:3.0:1788201606.200863:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570154240 00000100:00100000:3.0:1788201606.200885:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570153984 00000100:00100000:3.0:1788201606.200887:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570153984 00000100:00100000:3.0:1788201606.200902:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1788201606.200911:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570153728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201606.200963:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570153728:12345-0@lo:400:kworker.0 Request processed in 53us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.200970:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1788201606.201002:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1788201606.201008:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570154240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201606.201031:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570154240:12345-0@lo:400:kworker.0 Request processed in 24us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.201037:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1788201606.201047:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1788201606.201051:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570153984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201606.201075:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570153984:12345-0@lo:400:kworker.0 Request processed in 24us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.201080:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1788201606.201113:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570153984:0@lo:400:kworker.0 00000100:00080000:3.0:1788201606.201133:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201606.201167:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570153856 00000100:00100000:3.0:1788201606.201170:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570153856 00000100:00100000:3.0:1788201606.201197:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570154112 00000100:00100000:3.0:1788201606.201205:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570154112 00000100:00100000:3.0:1788201606.201223:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788201606.201228:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570153856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201606.201256:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570153856:12345-0@lo:400:kworker.0 Request processed in 28us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.201262:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788201606.201282:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788201606.201289:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570154112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201606.201316:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570154112:12345-0@lo:400:kworker.0 Request processed in 28us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.201322:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00010000:00080000:3.0:1788201606.201362:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bb8ba680 x1875064570154112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201606.201375:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570154112:0@lo:400:kworker.0 00000100:00080000:3.0:1788201606.201387:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201606.203524:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570153600 00000100:00100000:2.0:1788201606.203540:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570153600 00000100:00100000:2.0:1788201606.203607:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:2.0:1788201606.203616:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570153600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201606.203700:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570153600:12345-0@lo:400:kworker.0 Request processed in 85us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201606.203707:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1788201606.204079:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570153600:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.204223:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570153728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.204239:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570154240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.204250:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bb8bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570153856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201606.372252:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201606.372338:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559693696 00000100:00100000:2.0:1788201606.372381:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559693696 00002000:00100000:2.0:1788201606.372462:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (753926144->754974719) req@ffff9624ba43f100 x1875064559693696/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:727/0 lens 488/0 e 0 to 0 dl 1788201617 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201606.372476:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43f100 with x1875064559693696 ext(753926144->754974719) 00002000:00010000:2.0:1788201606.372511:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43f100 00000100:00100000:2.0:1788201606.372555:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 764 00000100:00100000:2.0:1788201606.372565:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559693696:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201606.387934:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559693696:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15353us (15679us total) trans 30064771765 rc 0/0 00000100:00100000:1.0:1788201606.387972:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 764 00002000:00100000:1.0:1788201606.387990:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (753926144->754974719) req@ffff9624ba43f100 x1875064559693696/t30064771765(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:727/0 lens 488/448 e 0 to 0 dl 1788201617 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201606.388002:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43f100 with x1875064559693696 ext(753926144->754974719) 00002000:00010000:1.0:1788201606.388009:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43f100 00000100:00100000:0.0:1788201606.708913:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201606.709041:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559693824 00000100:00100000:1.0:1788201606.709052:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559693824 00002000:00100000:1.0:1788201606.709109:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (754974720->756023295) req@ffff9624bb8bb800 x1875064559693824/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:727/0 lens 488/0 e 0 to 0 dl 1788201617 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201606.709122:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8bb800 with x1875064559693824 ext(754974720->756023295) 00002000:00010000:1.0:1788201606.709128:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8bb800 00000100:00100000:1.0:1788201606.709166:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 765 00000100:00100000:1.0:1788201606.709175:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559693824:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201606.730637:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559693824:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21445us (21721us total) trans 30064771766 rc 0/0 00000100:00100000:1.0:1788201606.730655:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 765 00002000:00100000:1.0:1788201606.730670:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (754974720->756023295) req@ffff9624bb8bb800 x1875064559693824/t30064771766(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:727/0 lens 488/448 e 0 to 0 dl 1788201617 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201606.730682:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8bb800 with x1875064559693824 ext(754974720->756023295) 00002000:00010000:1.0:1788201606.730690:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8bb800 00010000:00010000:0.0:1788201606.966727:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201606.984838:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201606.984954:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559693952 00000100:00100000:1.0:1788201606.984966:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559693952 00002000:00100000:1.0:1788201606.985024:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (756023296->757071871) req@ffff9624ba43f480 x1875064559693952/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:727/0 lens 488/0 e 0 to 0 dl 1788201617 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201606.985054:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43f480 with x1875064559693952 ext(756023296->757071871) 00002000:00010000:1.0:1788201606.985061:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43f480 00000100:00100000:1.0:1788201606.985103:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 766 00000100:00100000:1.0:1788201606.985113:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559693952:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201607.007746:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559693952:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22615us (22903us total) trans 30064771767 rc 0/0 00000100:00100000:1.0:1788201607.007767:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 766 00002000:00100000:1.0:1788201607.007787:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (756023296->757071871) req@ffff9624ba43f480 x1875064559693952/t30064771767(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:727/0 lens 488/448 e 0 to 0 dl 1788201617 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201607.007800:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43f480 with x1875064559693952 ext(756023296->757071871) 00002000:00010000:1.0:1788201607.007808:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43f480 00000100:00100000:0.0:1788201607.261858:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201607.262091:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559694080 00000100:00100000:2.0:1788201607.262101:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559694080 00002000:00100000:2.0:1788201607.262210:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (757071872->758120447) req@ffff9624bb8b8e00 x1875064559694080/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:728/0 lens 488/0 e 0 to 0 dl 1788201618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201607.262224:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b8e00 with x1875064559694080 ext(757071872->758120447) 00002000:00010000:2.0:1788201607.262230:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b8e00 00000100:00100000:1.0:1788201607.262381:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 767 00000100:00100000:1.0:1788201607.262394:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559694080:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201607.265445:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201607.290589:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559694080:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28183us (28730us total) trans 30064771768 rc 0/0 00000100:00100000:1.0:1788201607.290607:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 767 00002000:00100000:1.0:1788201607.290622:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (757071872->758120447) req@ffff9624bb8b8e00 x1875064559694080/t30064771768(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:728/0 lens 488/448 e 0 to 0 dl 1788201618 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201607.290635:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b8e00 with x1875064559694080 ext(757071872->758120447) 00002000:00010000:1.0:1788201607.290642:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b8e00 00000100:00100000:3.0:1788201607.522134:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201607.522547:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559694208 00000100:00100000:2.0:1788201607.522559:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559694208 00002000:00100000:2.0:1788201607.522616:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (758120448->759169023) req@ffff9624ba43fb80 x1875064559694208/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:728/0 lens 488/0 e 0 to 0 dl 1788201618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201607.522628:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43fb80 with x1875064559694208 ext(758120448->759169023) 00002000:00010000:2.0:1788201607.522633:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43fb80 00000100:00100000:2.0:1788201607.522674:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 768 00000100:00100000:2.0:1788201607.522685:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559694208:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201607.534666:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559694208:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11970us (12530us total) trans 30064771769 rc 0/0 00000100:00100000:2.0:1788201607.534682:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 768 00002000:00100000:2.0:1788201607.534697:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (758120448->759169023) req@ffff9624ba43fb80 x1875064559694208/t30064771769(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:728/0 lens 488/448 e 0 to 0 dl 1788201618 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201607.534708:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43fb80 with x1875064559694208 ext(758120448->759169023) 00002000:00010000:2.0:1788201607.534715:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43fb80 00000100:00100000:3.0:1788201607.738627:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201607.738716:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559694336 00000100:00100000:2.0:1788201607.738749:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559694336 00002000:00100000:2.0:1788201607.738940:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (759169024->760217599) req@ffff9624b9de8e00 x1875064559694336/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:728/0 lens 488/0 e 0 to 0 dl 1788201618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201607.738953:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de8e00 with x1875064559694336 ext(759169024->760217599) 00002000:00010000:2.0:1788201607.738960:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de8e00 00000100:00100000:2.0:1788201607.739001:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 769 00000100:00100000:2.0:1788201607.739014:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559694336:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201607.776676:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559694336:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37646us (38045us total) trans 30064771770 rc 0/0 00000100:00100000:2.0:1788201607.776693:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 769 00002000:00100000:2.0:1788201607.776710:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (759169024->760217599) req@ffff9624b9de8e00 x1875064559694336/t30064771770(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:728/0 lens 488/448 e 0 to 0 dl 1788201618 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201607.776739:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9de8e00 with x1875064559694336 ext(759169024->760217599) 00002000:00010000:2.0:1788201607.776746:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9de8e00 00000100:00100000:3.0:1788201607.930367:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201607.930549:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559694464 00000100:00100000:1.0:1788201607.930581:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559694464 00002000:00100000:1.0:1788201607.930647:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (760217600->761266175) req@ffff9624b9d27100 x1875064559694464/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:728/0 lens 488/0 e 0 to 0 dl 1788201618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201607.930662:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27100 with x1875064559694464 ext(760217600->761266175) 00002000:00010000:1.0:1788201607.930669:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27100 00000100:00100000:1.0:1788201607.930718:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 770 00000100:00100000:1.0:1788201607.930729:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2341:x1875064559694464:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201607.953061:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2341:x1875064559694464:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22314us (22715us total) trans 30064771771 rc 0/0 00000100:00100000:1.0:1788201607.953077:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 770 00002000:00100000:1.0:1788201607.953092:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (760217600->761266175) req@ffff9624b9d27100 x1875064559694464/t30064771771(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:728/0 lens 488/448 e 0 to 0 dl 1788201618 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201607.953104:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27100 with x1875064559694464 ext(760217600->761266175) 00002000:00010000:1.0:1788201607.953111:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27100 00010000:00010000:1.0:1788201607.990661:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201608.032570:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201608.032748:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559694592 00000100:00100000:1.0:1788201608.032761:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559694592 00002000:00100000:1.0:1788201608.032828:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (761266176->762314751) req@ffff9624b9d27b80 x1875064559694592/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:729/0 lens 488/0 e 0 to 0 dl 1788201619 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201608.032839:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27b80 with x1875064559694592 ext(761266176->762314751) 00002000:00010000:1.0:1788201608.032845:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27b80 00000100:00100000:1.0:1788201608.032883:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 771 00000100:00100000:1.0:1788201608.032893:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2342:x1875064559694592:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201608.046877:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2342:x1875064559694592:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13974us (14308us total) trans 30064771772 rc 0/0 00000100:00100000:1.0:1788201608.046903:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 771 00002000:00100000:1.0:1788201608.046917:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (761266176->762314751) req@ffff9624b9d27b80 x1875064559694592/t30064771772(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:729/0 lens 488/448 e 0 to 0 dl 1788201619 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201608.046929:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27b80 with x1875064559694592 ext(761266176->762314751) 00002000:00010000:1.0:1788201608.046935:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27b80 00000100:00100000:0.0:1788201608.246581:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570154368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201608.246663:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201608.246725:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570154368 00000100:00100000:3.0:1788201608.246734:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570154368 00000100:00100000:3.0:1788201608.246806:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788201608.246831:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570154368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201608.246852:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 563806208 pending 35782656 free 3119513600 avail 3117416448 00000100:00100000:3.0:1788201608.246900:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570154368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201608.246907:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788201608.247025:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570154368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201608.247077:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201608.302125:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201608.302586:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559694720 00000100:00100000:2.0:1788201608.302597:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559694720 00002000:00100000:2.0:1788201608.302656:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (762314752->763363327) req@ffff9624b9d24700 x1875064559694720/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:729/0 lens 488/0 e 0 to 0 dl 1788201619 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201608.302668:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24700 with x1875064559694720 ext(762314752->763363327) 00002000:00010000:2.0:1788201608.302675:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24700 00000100:00100000:2.0:1788201608.302918:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 772 00000100:00100000:2.0:1788201608.302930:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2342:x1875064559694720:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201608.325223:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559694720:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22285us (23099us total) trans 30064771773 rc 0/0 00000100:00100000:2.0:1788201608.325262:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 772 00002000:00100000:2.0:1788201608.325277:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (762314752->763363327) req@ffff9624b9d24700 x1875064559694720/t30064771773(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:729/0 lens 488/448 e 0 to 0 dl 1788201619 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201608.325287:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24700 with x1875064559694720 ext(762314752->763363327) 00002000:00010000:2.0:1788201608.325293:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24700 00000100:00100000:0.0:1788201608.654114:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201608.654234:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559694848 00000100:00100000:2.0:1788201608.654254:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559694848 00002000:00100000:2.0:1788201608.654312:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (763363328->764411903) req@ffff9624bb8b8000 x1875064559694848/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:729/0 lens 488/0 e 0 to 0 dl 1788201619 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201608.654325:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b8000 with x1875064559694848 ext(763363328->764411903) 00002000:00010000:2.0:1788201608.654331:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b8000 00000100:00100000:2.0:1788201608.654408:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 773 00000100:00100000:2.0:1788201608.654419:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559694848:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201608.684808:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559694848:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30378us (30693us total) trans 30064771774 rc 0/0 00000100:00100000:2.0:1788201608.684823:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 773 00002000:00100000:2.0:1788201608.684838:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (763363328->764411903) req@ffff9624bb8b8000 x1875064559694848/t30064771774(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:729/0 lens 488/448 e 0 to 0 dl 1788201619 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201608.684848:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b8000 with x1875064559694848 ext(763363328->764411903) 00002000:00010000:2.0:1788201608.684855:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b8000 00000001:00080000:2.0:1788201608.879770:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771753 is committed 00000001:00080000:2.0:1788201608.879793:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771772 is committed 00000001:00080000:2.0:1788201608.879843:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771774 is committed 00000100:00100000:2.0:1788201608.920753:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201608.921767:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559694976 00000100:00100000:1.0:1788201608.921830:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559694976 00002000:00100000:2.0:1788201608.922072:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (764411904->765460479) req@ffff9624bfd98700 x1875064559694976/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:729/0 lens 488/0 e 0 to 0 dl 1788201619 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201608.922090:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98700 with x1875064559694976 ext(764411904->765460479) 00002000:00010000:2.0:1788201608.922097:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98700 00000100:00100000:2.0:1788201608.922153:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 774 00000100:00100000:2.0:1788201608.922164:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559694976:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201608.942906:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559694976:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20733us (22153us total) trans 30064771775 rc 0/0 00000100:00100000:1.0:1788201608.942921:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 774 00002000:00100000:1.0:1788201608.942934:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (764411904->765460479) req@ffff9624bfd98700 x1875064559694976/t30064771775(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:729/0 lens 488/448 e 0 to 0 dl 1788201619 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201608.942945:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98700 with x1875064559694976 ext(764411904->765460479) 00002000:00010000:1.0:1788201608.942952:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98700 00010000:00010000:2.0:1788201609.018076:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201609.125663:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201609.125810:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559695104 00000100:00100000:1.0:1788201609.125822:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559695104 00002000:00100000:1.0:1788201609.125911:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (765460480->766509055) req@ffff9624bb8b9c00 x1875064559695104/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:730/0 lens 488/0 e 0 to 0 dl 1788201620 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201609.125923:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b9c00 with x1875064559695104 ext(765460480->766509055) 00002000:00010000:1.0:1788201609.125929:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b9c00 00000100:00080000:3.0:1788201609.126037:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201609.126141:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 775 00000100:00100000:1.0:1788201609.126153:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559695104:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201609.137479:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559695104:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11309us (11807us total) trans 30064771776 rc 0/0 00000100:00100000:1.0:1788201609.137494:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 775 00002000:00100000:1.0:1788201609.137509:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (765460480->766509055) req@ffff9624bb8b9c00 x1875064559695104/t30064771776(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:730/0 lens 488/448 e 0 to 0 dl 1788201620 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201609.137521:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b9c00 with x1875064559695104 ext(765460480->766509055) 00002000:00010000:1.0:1788201609.137527:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b9c00 00000100:00100000:0.0:1788201609.365258:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201609.365418:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559695232 00000100:00100000:3.0:1788201609.365430:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559695232 00002000:00100000:3.0:1788201609.365528:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (766509056->767557631) req@ffff9624bb8b8380 x1875064559695232/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:730/0 lens 488/0 e 0 to 0 dl 1788201620 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201609.365543:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b8380 with x1875064559695232 ext(766509056->767557631) 00002000:00010000:3.0:1788201609.365550:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b8380 00000100:00100000:3.0:1788201609.365594:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 776 00000100:00100000:3.0:1788201609.365606:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559695232:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201609.387730:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559695232:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22114us (22477us total) trans 30064771777 rc 0/0 00000100:00100000:2.0:1788201609.387744:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 776 00002000:00100000:2.0:1788201609.387757:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (766509056->767557631) req@ffff9624bb8b8380 x1875064559695232/t30064771777(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:730/0 lens 488/448 e 0 to 0 dl 1788201620 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201609.387768:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b8380 with x1875064559695232 ext(766509056->767557631) 00002000:00010000:2.0:1788201609.387774:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b8380 00000100:00100000:0.0:1788201609.580871:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201609.580980:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559695360 00000100:00100000:2.0:1788201609.580993:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559695360 00002000:00100000:2.0:1788201609.581050:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (767557632->768606207) req@ffff9624bb8ba300 x1875064559695360/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:730/0 lens 488/0 e 0 to 0 dl 1788201620 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201609.581061:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8ba300 with x1875064559695360 ext(767557632->768606207) 00002000:00010000:2.0:1788201609.581068:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8ba300 00000100:00100000:2.0:1788201609.581104:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 777 00000100:00100000:2.0:1788201609.581115:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559695360:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201609.615079:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559695360:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33953us (34206us total) trans 30064771778 rc 0/0 00000100:00100000:2.0:1788201609.615111:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 777 00002000:00100000:2.0:1788201609.615127:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (767557632->768606207) req@ffff9624bb8ba300 x1875064559695360/t30064771778(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:730/0 lens 488/448 e 0 to 0 dl 1788201620 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201609.615137:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8ba300 with x1875064559695360 ext(767557632->768606207) 00002000:00010000:2.0:1788201609.615143:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8ba300 00000100:00100000:0.0:1788201609.807416:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201609.807519:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559695488 00000100:00100000:1.0:1788201609.807530:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559695488 00002000:00100000:1.0:1788201609.807580:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (768606208->769654783) req@ffff9624bb8ba680 x1875064559695488/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:730/0 lens 488/0 e 0 to 0 dl 1788201620 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201609.807589:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8ba680 with x1875064559695488 ext(768606208->769654783) 00002000:00010000:1.0:1788201609.807593:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8ba680 00000100:00100000:1.0:1788201609.807624:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 778 00000100:00100000:1.0:1788201609.807634:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2341:x1875064559695488:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201609.820435:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559695488:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12780us (13008us total) trans 30064771779 rc 0/0 00000100:00100000:1.0:1788201609.820453:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 778 00002000:00100000:1.0:1788201609.820467:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (768606208->769654783) req@ffff9624bb8ba680 x1875064559695488/t30064771779(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:730/0 lens 488/448 e 0 to 0 dl 1788201620 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201609.820479:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8ba680 with x1875064559695488 ext(768606208->769654783) 00002000:00010000:1.0:1788201609.820486:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8ba680 00000100:00100000:0.0:1788201610.017647:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201610.018008:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559695616 00000100:00100000:1.0:1788201610.018034:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559695616 00002000:00100000:1.0:1788201610.018091:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (769654784->770703359) req@ffff9624bb8b9880 x1875064559695616/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:731/0 lens 488/0 e 0 to 0 dl 1788201621 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201610.018099:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b9880 with x1875064559695616 ext(769654784->770703359) 00002000:00010000:1.0:1788201610.018104:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b9880 00000100:00100000:1.0:1788201610.018132:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 779 00000100:00100000:1.0:1788201610.018142:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bb8b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559695616:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201610.023291:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bb8b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559695616:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 5138us (5640us total) trans 30064771780 rc 0/0 00000100:00100000:1.0:1788201610.023307:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 779 00002000:00100000:1.0:1788201610.023321:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (769654784->770703359) req@ffff9624bb8b9880 x1875064559695616/t30064771780(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:731/0 lens 488/448 e 0 to 0 dl 1788201621 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201610.023332:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bb8b9880 with x1875064559695616 ext(769654784->770703359) 00002000:00010000:1.0:1788201610.023337:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bb8b9880 00000100:00100000:2.0:1788201610.034066:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201610.034117:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201610.034258:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559695872 00000100:00100000:3.0:1788201610.034269:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559695872 00000100:00100000:3.0:1788201610.034378:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 431 00000100:00100000:3.0:1788201610.034389:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559695872:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201610.034495:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559695872:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 108us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201610.034504:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 431 00000100:00100000:0.0:1788201610.034675:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559695744 00000100:00100000:0.0:1788201610.034679:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559695744 00000100:00100000:0.0:1788201610.034716:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 558 00000100:00100000:0.0:1788201610.034724:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559695744:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201610.034760:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559695744:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 37us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201610.034767:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 558 00000100:00080000:1.0:1788201610.034998:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201610.038713:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201610.435548:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201610.435717:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559696000 00000100:00100000:0.0:1788201610.435728:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559696000 00002000:00100000:0.0:1788201610.435782:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (770703360->771751935) req@ffff9624bfd99500 x1875064559696000/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:731/0 lens 488/0 e 0 to 0 dl 1788201621 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201610.435794:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99500 with x1875064559696000 ext(770703360->771751935) 00002000:00010000:0.0:1788201610.435800:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99500 00000100:00100000:0.0:1788201610.435835:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 780 00000100:00100000:0.0:1788201610.435847:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559696000:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201610.461087:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559696000:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25229us (25536us total) trans 30064771781 rc 0/0 00000100:00100000:1.0:1788201610.461103:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 780 00002000:00100000:1.0:1788201610.461120:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (770703360->771751935) req@ffff9624bfd99500 x1875064559696000/t30064771781(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:731/0 lens 488/448 e 0 to 0 dl 1788201621 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201610.461131:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99500 with x1875064559696000 ext(770703360->771751935) 00002000:00010000:1.0:1788201610.461137:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99500 00000100:00100000:0.0:1788201610.766307:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201610.771387:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559696128 00000100:00100000:2.0:1788201610.771437:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559696128 00002000:00100000:2.0:1788201610.771531:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (771751936->772800511) req@ffff9624b9d69880 x1875064559696128/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:731/0 lens 488/0 e 0 to 0 dl 1788201621 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201610.771546:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d69880 with x1875064559696128 ext(771751936->772800511) 00002000:00010000:2.0:1788201610.771554:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d69880 00000100:00100000:2.0:1788201610.771604:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 781 00000100:00100000:2.0:1788201610.771615:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559696128:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201610.795753:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559696128:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24129us (29463us total) trans 30064771782 rc 0/0 00000100:00100000:2.0:1788201610.795768:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 781 00002000:00100000:2.0:1788201610.795782:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (771751936->772800511) req@ffff9624b9d69880 x1875064559696128/t30064771782(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:731/0 lens 488/448 e 0 to 0 dl 1788201621 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201610.795793:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d69880 with x1875064559696128 ext(771751936->772800511) 00002000:00010000:2.0:1788201610.795799:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d69880 00000100:00100000:3.0:1788201610.808163:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201610.808203:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570154496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201610.808279:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201610.808480:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570154496 00000100:00100000:0.0:1788201610.808491:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570154496 00000100:00100000:0.0:1788201610.808576:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788201610.808589:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570154496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201610.808630:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201610.808681:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570154496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201610.808691:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00010000:00080000:3.0:1788201610.809001:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624c1e53800 x1875064570154496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201610.809020:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201610.809025:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570154496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201611.050038:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201611.050138:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559696256 00000100:00100000:1.0:1788201611.050176:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559696256 00002000:00100000:1.0:1788201611.050257:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (772800512->773849087) req@ffff9624bfd98380 x1875064559696256/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:732/0 lens 488/0 e 0 to 0 dl 1788201622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201611.050269:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98380 with x1875064559696256 ext(772800512->773849087) 00002000:00010000:1.0:1788201611.050274:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98380 00000100:00100000:1.0:1788201611.050309:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 782 00000100:00100000:1.0:1788201611.050319:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559696256:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201611.050735:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201611.063619:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201611.077191:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559696256:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26863us (27150us total) trans 30064771783 rc 0/0 00000100:00100000:3.0:1788201611.077207:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 782 00002000:00100000:3.0:1788201611.077222:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (772800512->773849087) req@ffff9624bfd98380 x1875064559696256/t30064771783(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:732/0 lens 488/448 e 0 to 0 dl 1788201622 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201611.077235:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98380 with x1875064559696256 ext(772800512->773849087) 00002000:00010000:3.0:1788201611.077241:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98380 00000100:00100000:0.0:1788201611.319214:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570154752:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.319286:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201611.319377:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570155264:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.319409:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201611.319438:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201611.319444:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570154880:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.319470:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201611.319761:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570154624:0@lo:400:kworker.0 00000100:00100000:2.0:1788201611.319798:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201611.319831:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570155136:0@lo:400:kworker.0 00000100:00100000:2.0:1788201611.319852:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201611.319868:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201611.319874:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570155008:0@lo:400:kworker.0 00000100:00100000:2.0:1788201611.319893:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201611.319919:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570154752 00000100:00100000:2.0:1788201611.319927:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570154752 00000100:00100000:2.0:1788201611.319970:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570155264 00000100:00100000:2.0:1788201611.319973:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570155264 00000100:00100000:2.0:1788201611.319991:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570155008 00000100:00100000:2.0:1788201611.319993:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570155008 00000100:00100000:2.0:1788201611.320008:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1788201611.320015:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570154752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201611.320069:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570154752:12345-0@lo:400:kworker.0 Request processed in 53us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201611.320076:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1788201611.320092:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1788201611.320098:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570155264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201611.320123:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570155264:12345-0@lo:400:kworker.0 Request processed in 25us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201611.320129:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1788201611.320139:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1788201611.320145:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570155008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201611.320171:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570155008:12345-0@lo:400:kworker.0 Request processed in 27us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201611.320192:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1788201611.320236:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570154752:0@lo:400:kworker.0 00000100:00100000:2.0:1788201611.320248:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570155264:0@lo:400:kworker.0 00000100:00100000:2.0:1788201611.320278:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570155008:0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.320409:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570154624 00000100:00100000:1.0:1788201611.320414:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570154624 00000100:00100000:1.0:1788201611.320450:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:1.0:1788201611.320458:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570154624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.320494:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248503d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570154624:12345-0@lo:400:kworker.0 Request processed in 38us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201611.320500:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1788201611.321449:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570154624:0@lo:400:kworker.0 00000100:00100000:3.0:1788201611.321605:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570154880 00000100:00100000:3.0:1788201611.321611:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570154880 00000100:00100000:3.0:1788201611.321652:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570155136 00000100:00100000:3.0:1788201611.321656:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570155136 00000100:00100000:3.0:1788201611.321675:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788201611.321683:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570154880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201611.321745:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570154880:12345-0@lo:400:kworker.0 Request processed in 63us (2273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201611.321751:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788201611.321768:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788201611.321774:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570155136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201611.321809:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570155136:12345-0@lo:400:kworker.0 Request processed in 35us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201611.321815:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00080000:3.0:1788201611.321835:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201611.321850:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788201611.321873:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9d68700 x1875064570155136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201611.321886:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570155136:0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.321967:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570154880:0@lo:400:kworker.0 00000100:00100000:2.0:1788201611.554518:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201611.555677:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559696384 00000100:00100000:1.0:1788201611.555700:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559696384 00002000:00100000:1.0:1788201611.555757:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (773849088->774897663) req@ffff9624bfd9b800 x1875064559696384/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:732/0 lens 488/0 e 0 to 0 dl 1788201622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201611.555768:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9b800 with x1875064559696384 ext(773849088->774897663) 00002000:00010000:1.0:1788201611.555772:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9b800 00000100:00100000:1.0:1788201611.555816:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 783 00000100:00100000:1.0:1788201611.555826:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559696384:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201611.589128:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559696384:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33289us (34606us total) trans 30064771784 rc 0/0 00000100:00100000:1.0:1788201611.589140:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 783 00002000:00100000:1.0:1788201611.589151:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (773849088->774897663) req@ffff9624bfd9b800 x1875064559696384/t30064771784(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:732/0 lens 488/448 e 0 to 0 dl 1788201622 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201611.589159:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9b800 with x1875064559696384 ext(773849088->774897663) 00002000:00010000:1.0:1788201611.589164:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9b800 00000100:00100000:2.0:1788201611.671131:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201611.672335:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559696512 00000100:00100000:0.0:1788201611.672380:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559696512 00002000:00100000:0.0:1788201611.672455:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (774897664->775946239) req@ffff9624bfd98000 x1875064559696512/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:732/0 lens 488/0 e 0 to 0 dl 1788201622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201611.672467:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98000 with x1875064559696512 ext(774897664->775946239) 00002000:00010000:0.0:1788201611.672473:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98000 00000100:00100000:0.0:1788201611.672510:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 784 00000100:00100000:0.0:1788201611.672522:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559696512:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201611.696263:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559696512:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23730us (25129us total) trans 30064771785 rc 0/0 00000100:00100000:0.0:1788201611.696296:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 784 00002000:00100000:0.0:1788201611.696331:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (774897664->775946239) req@ffff9624bfd98000 x1875064559696512/t30064771785(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:732/0 lens 488/448 e 0 to 0 dl 1788201622 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201611.696360:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98000 with x1875064559696512 ext(774897664->775946239) 00002000:00010000:0.0:1788201611.696378:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98000 00000100:00100000:1.0:1788201611.810409:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201611.810498:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559696640 00000100:00100000:2.0:1788201611.810510:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559696640 00002000:00100000:2.0:1788201611.810567:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (775946240->776994815) req@ffff9624c1e50e00 x1875064559696640/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:732/0 lens 488/0 e 0 to 0 dl 1788201622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201611.810577:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e50e00 with x1875064559696640 ext(775946240->776994815) 00002000:00010000:2.0:1788201611.810583:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e50e00 00000100:00100000:2.0:1788201611.810622:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 785 00000100:00100000:2.0:1788201611.810632:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559696640:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201611.834235:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559696640:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23590us (23830us total) trans 30064771786 rc 0/0 00000100:00100000:1.0:1788201611.834251:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 785 00002000:00100000:1.0:1788201611.834268:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (775946240->776994815) req@ffff9624c1e50e00 x1875064559696640/t30064771786(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:732/0 lens 488/448 e 0 to 0 dl 1788201622 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201611.834279:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e50e00 with x1875064559696640 ext(775946240->776994815) 00002000:00010000:1.0:1788201611.834287:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e50e00 00000100:00100000:0.0:1788201612.023104:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201612.023202:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559696768 00000100:00100000:3.0:1788201612.023214:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559696768 00002000:00100000:3.0:1788201612.023270:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (776994816->778043391) req@ffff9624b9d6b480 x1875064559696768/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:733/0 lens 488/0 e 0 to 0 dl 1788201623 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201612.023283:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6b480 with x1875064559696768 ext(776994816->778043391) 00002000:00010000:3.0:1788201612.023289:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6b480 00000100:00100000:3.0:1788201612.023333:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 786 00000100:00100000:3.0:1788201612.023363:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2341:x1875064559696768:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201612.057717:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559696768:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34363us (34611us total) trans 30064771787 rc 0/0 00000100:00100000:0.0:1788201612.057735:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 786 00002000:00100000:0.0:1788201612.057748:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (776994816->778043391) req@ffff9624b9d6b480 x1875064559696768/t30064771787(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:733/0 lens 488/448 e 0 to 0 dl 1788201623 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201612.057760:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6b480 with x1875064559696768 ext(776994816->778043391) 00002000:00010000:0.0:1788201612.057766:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6b480 00010000:00010000:2.0:1788201612.086784:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201612.301728:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201612.301839:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559696896 00000100:00100000:0.0:1788201612.301851:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559696896 00002000:00100000:0.0:1788201612.301921:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (778043392->779091967) req@ffff9624c1e52680 x1875064559696896/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:733/0 lens 488/0 e 0 to 0 dl 1788201623 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201612.301934:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e52680 with x1875064559696896 ext(778043392->779091967) 00002000:00010000:0.0:1788201612.301940:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e52680 00000100:00100000:0.0:1788201612.301982:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 787 00000100:00100000:0.0:1788201612.301993:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559696896:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201612.327094:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559696896:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25093us (25366us total) trans 30064771788 rc 0/0 00000100:00100000:0.0:1788201612.327127:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 787 00002000:00100000:0.0:1788201612.327141:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (778043392->779091967) req@ffff9624c1e52680 x1875064559696896/t30064771788(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:733/0 lens 488/448 e 0 to 0 dl 1788201623 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201612.327151:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e52680 with x1875064559696896 ext(778043392->779091967) 00002000:00010000:0.0:1788201612.327158:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e52680 00000100:00100000:2.0:1788201612.781141:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201612.781239:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559697024 00000100:00100000:0.0:1788201612.781250:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559697024 00002000:00100000:0.0:1788201612.781316:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (779091968->780140543) req@ffff9624bfd9ad80 x1875064559697024/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:733/0 lens 488/0 e 0 to 0 dl 1788201623 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201612.781329:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ad80 with x1875064559697024 ext(779091968->780140543) 00002000:00010000:0.0:1788201612.781334:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ad80 00000100:00100000:0.0:1788201612.781416:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 788 00000100:00100000:0.0:1788201612.781428:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559697024:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201612.805812:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559697024:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24373us (24667us total) trans 30064771789 rc 0/0 00000100:00100000:0.0:1788201612.805828:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 788 00002000:00100000:0.0:1788201612.805842:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (779091968->780140543) req@ffff9624bfd9ad80 x1875064559697024/t30064771789(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:733/0 lens 488/448 e 0 to 0 dl 1788201623 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201612.805853:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ad80 with x1875064559697024 ext(779091968->780140543) 00002000:00010000:0.0:1788201612.805860:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ad80 00010000:00010000:0.0:1788201613.110953:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201613.142242:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201613.142747:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559697152 00000100:00100000:3.0:1788201613.142761:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559697152 00002000:00100000:3.0:1788201613.142836:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (780140544->781189119) req@ffff9624bfd99c00 x1875064559697152/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:734/0 lens 488/0 e 0 to 0 dl 1788201624 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201613.142849:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99c00 with x1875064559697152 ext(780140544->781189119) 00002000:00010000:3.0:1788201613.142867:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99c00 00000100:00100000:3.0:1788201613.142905:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 789 00000100:00100000:3.0:1788201613.142918:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559697152:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201613.143691:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201613.198744:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559697152:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 55818us (56504us total) trans 30064771790 rc 0/0 00000100:00100000:2.0:1788201613.198757:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 789 00002000:00100000:2.0:1788201613.198768:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (780140544->781189119) req@ffff9624bfd99c00 x1875064559697152/t30064771790(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:734/0 lens 488/448 e 0 to 0 dl 1788201624 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201613.198793:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd99c00 with x1875064559697152 ext(780140544->781189119) 00002000:00010000:2.0:1788201613.198799:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd99c00 00000100:00100000:1.0:1788201613.367256:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201613.367304:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570155392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201613.367440:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201613.367709:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570155392 00000100:00100000:3.0:1788201613.367720:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570155392 00000100:00100000:3.0:1788201613.367803:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788201613.367816:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570155392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201613.367862:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 555024384 pending 27262976 free 3095396352 avail 3093299200 00000100:00100000:3.0:1788201613.367916:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570155392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.367924:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:2.0:1788201613.367996:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201613.368223:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570155392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201613.618304:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201613.618499:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559697280 00000100:00100000:0.0:1788201613.618512:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559697280 00002000:00100000:0.0:1788201613.618583:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (781189120->782237695) req@ffff9624c1e51c00 x1875064559697280/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:734/0 lens 488/0 e 0 to 0 dl 1788201624 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201613.618595:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e51c00 with x1875064559697280 ext(781189120->782237695) 00002000:00010000:0.0:1788201613.618601:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e51c00 00000100:00100000:0.0:1788201613.618638:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 790 00000100:00100000:0.0:1788201613.618648:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559697280:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201613.670610:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559697280:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 47491us (47844us total) trans 30064771791 rc 0/0 00000100:00100000:0.0:1788201613.670637:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 790 00002000:00100000:0.0:1788201613.670657:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (781189120->782237695) req@ffff9624c1e51c00 x1875064559697280/t30064771791(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:734/0 lens 488/448 e 0 to 0 dl 1788201624 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201613.670668:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e51c00 with x1875064559697280 ext(781189120->782237695) 00002000:00010000:0.0:1788201613.670675:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e51c00 00000100:00100000:2.0:1788201614.014111:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201614.014311:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559697408 00000100:00100000:0.0:1788201614.014322:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559697408 00002000:00100000:0.0:1788201614.018718:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (782237696->783286271) req@ffff9624bfd98e00 x1875064559697408/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:735/0 lens 488/0 e 0 to 0 dl 1788201625 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201614.018736:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98e00 with x1875064559697408 ext(782237696->783286271) 00002000:00010000:0.0:1788201614.018746:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98e00 00000100:00100000:0.0:1788201614.018803:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 791 00000100:00100000:0.0:1788201614.018825:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559697408:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201614.041855:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559697408:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23030us (27743us total) trans 30064771792 rc 0/0 00000100:00100000:0.0:1788201614.041885:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 791 00002000:00100000:0.0:1788201614.041900:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (782237696->783286271) req@ffff9624bfd98e00 x1875064559697408/t30064771792(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:735/0 lens 488/448 e 0 to 0 dl 1788201625 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201614.041911:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd98e00 with x1875064559697408 ext(782237696->783286271) 00002000:00010000:0.0:1788201614.041918:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd98e00 00000001:00080000:2.0:1788201614.125841:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771791 is committed 00010000:00010000:1.0:1788201614.134964:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201614.418996:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201614.419098:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559697536 00000100:00100000:1.0:1788201614.419109:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559697536 00002000:00100000:1.0:1788201614.419190:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (783286272->784334847) req@ffff9624c1c24000 x1875064559697536/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:735/0 lens 488/0 e 0 to 0 dl 1788201625 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201614.419201:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c24000 with x1875064559697536 ext(783286272->784334847) 00002000:00010000:1.0:1788201614.419207:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c24000 00000100:00100000:1.0:1788201614.419245:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 792 00000100:00100000:1.0:1788201614.419264:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559697536:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201614.442889:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559697536:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23623us (23891us total) trans 30064771793 rc 0/0 00000100:00100000:0.0:1788201614.442905:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 792 00002000:00100000:0.0:1788201614.442920:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (783286272->784334847) req@ffff9624c1c24000 x1875064559697536/t30064771793(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:735/0 lens 488/448 e 0 to 0 dl 1788201625 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201614.442931:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c24000 with x1875064559697536 ext(783286272->784334847) 00002000:00010000:0.0:1788201614.442937:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c24000 00000100:00100000:3.0:1788201614.609486:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201614.609602:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559697664 00000100:00100000:2.0:1788201614.609614:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559697664 00002000:00100000:2.0:1788201614.609666:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (784334848->785383423) req@ffff9624b9d25500 x1875064559697664/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:735/0 lens 488/0 e 0 to 0 dl 1788201625 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201614.609675:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25500 with x1875064559697664 ext(784334848->785383423) 00002000:00010000:2.0:1788201614.609681:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25500 00000100:00100000:2.0:1788201614.609710:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 793 00000100:00100000:2.0:1788201614.609720:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559697664:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201614.627916:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559697664:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18186us (18429us total) trans 30064771794 rc 0/0 00000100:00100000:2.0:1788201614.627930:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 793 00002000:00100000:2.0:1788201614.627945:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (784334848->785383423) req@ffff9624b9d25500 x1875064559697664/t30064771794(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:735/0 lens 488/448 e 0 to 0 dl 1788201625 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201614.627955:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25500 with x1875064559697664 ext(784334848->785383423) 00002000:00010000:2.0:1788201614.627962:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25500 00000100:00100000:0.0:1788201614.907652:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201614.908087:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559697792 00000100:00100000:2.0:1788201614.908099:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559697792 00002000:00100000:2.0:1788201614.908173:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (785383424->786431999) req@ffff9624b9d6b800 x1875064559697792/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:735/0 lens 488/0 e 0 to 0 dl 1788201625 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201614.908184:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6b800 with x1875064559697792 ext(785383424->786431999) 00002000:00010000:2.0:1788201614.908190:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6b800 00000100:00100000:2.0:1788201614.908231:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 794 00000100:00100000:2.0:1788201614.908242:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559697792:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201614.939529:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559697792:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31276us (31879us total) trans 30064771795 rc 0/0 00000100:00100000:2.0:1788201614.939544:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 794 00002000:00100000:2.0:1788201614.939559:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (785383424->786431999) req@ffff9624b9d6b800 x1875064559697792/t30064771795(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:735/0 lens 488/448 e 0 to 0 dl 1788201625 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201614.939571:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6b800 with x1875064559697792 ext(785383424->786431999) 00002000:00010000:2.0:1788201614.939577:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6b800 00010000:00010000:2.0:1788201615.162531:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201615.162714:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201615.162744:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201615.162772:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201615.162800:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559698048 00000100:00100000:1.0:1788201615.162810:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559698048 00000100:00100000:1.0:1788201615.162885:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 435 00000100:00100000:1.0:1788201615.162898:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559698048:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201615.162977:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559698048:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 82us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201615.162984:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 435 00000100:00080000:1.0:1788201615.163005:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201615.163469:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559697920 00000100:00100000:3.0:1788201615.163476:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559697920 00000100:00100000:3.0:1788201615.163515:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 560 00000100:00100000:3.0:1788201615.163532:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559697920:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201615.163565:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559697920:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 42us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201615.163574:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 560 00000100:00100000:3.0:1788201615.163606:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559698176 00000100:00100000:3.0:1788201615.163610:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559698176 00000100:00100000:3.0:1788201615.163663:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 254 00000100:00100000:3.0:1788201615.163671:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559698176:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201615.163697:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559698176:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 27us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201615.163703:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 254 00000100:00080000:2.0:1788201615.164441:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201615.245038:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201615.245150:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559698304 00000100:00100000:0.0:1788201615.245164:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559698304 00002000:00100000:0.0:1788201615.245221:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (786432000->787480575) req@ffff9624c1c26a00 x1875064559698304/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:736/0 lens 488/0 e 0 to 0 dl 1788201626 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201615.245233:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c26a00 with x1875064559698304 ext(786432000->787480575) 00002000:00010000:0.0:1788201615.245238:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c26a00 00000100:00100000:0.0:1788201615.245273:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 795 00000100:00100000:0.0:1788201615.245282:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559698304:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201615.274962:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559698304:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29668us (29922us total) trans 30064771796 rc 0/0 00000100:00100000:0.0:1788201615.274994:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 795 00002000:00100000:0.0:1788201615.275008:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (786432000->787480575) req@ffff9624c1c26a00 x1875064559698304/t30064771796(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:736/0 lens 488/448 e 0 to 0 dl 1788201626 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201615.275019:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c26a00 with x1875064559698304 ext(786432000->787480575) 00002000:00010000:0.0:1788201615.275025:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c26a00 00000100:00100000:2.0:1788201615.525146:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201615.525309:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559698432 00000100:00100000:0.0:1788201615.525321:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559698432 00002000:00100000:0.0:1788201615.525412:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (787480576->788529151) req@ffff9624c1c24380 x1875064559698432/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:736/0 lens 488/0 e 0 to 0 dl 1788201626 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201615.525424:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c24380 with x1875064559698432 ext(787480576->788529151) 00002000:00010000:0.0:1788201615.525440:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c24380 00000100:00100000:0.0:1788201615.525476:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 796 00000100:00100000:0.0:1788201615.525486:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559698432:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201615.543756:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559698432:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18257us (18607us total) trans 30064771797 rc 0/0 00000100:00100000:0.0:1788201615.543774:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 796 00002000:00100000:0.0:1788201615.543793:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (787480576->788529151) req@ffff9624c1c24380 x1875064559698432/t30064771797(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:736/0 lens 488/448 e 0 to 0 dl 1788201626 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201615.543805:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c24380 with x1875064559698432 ext(787480576->788529151) 00002000:00010000:0.0:1788201615.543812:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c24380 00000100:00100000:1.0:1788201615.825000:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201615.825336:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559698560 00000100:00100000:2.0:1788201615.825377:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559698560 00002000:00100000:2.0:1788201615.825435:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (788529152->789577727) req@ffff9624c1e52300 x1875064559698560/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:736/0 lens 488/0 e 0 to 0 dl 1788201626 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201615.825500:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e52300 with x1875064559698560 ext(788529152->789577727) 00002000:00010000:2.0:1788201615.825507:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e52300 00000100:00100000:2.0:1788201615.825601:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 797 00000100:00100000:2.0:1788201615.825612:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559698560:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201615.843520:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559698560:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17898us (18521us total) trans 30064771798 rc 0/0 00000100:00100000:2.0:1788201615.843535:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 797 00002000:00100000:2.0:1788201615.843548:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (788529152->789577727) req@ffff9624c1e52300 x1875064559698560/t30064771798(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:736/0 lens 488/448 e 0 to 0 dl 1788201626 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201615.843558:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e52300 with x1875064559698560 ext(788529152->789577727) 00002000:00010000:2.0:1788201615.843565:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e52300 00000100:00100000:3.0:1788201615.926771:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201615.926800:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570155520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201615.926880:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201615.927100:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570155520 00000100:00100000:0.0:1788201615.927111:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570155520 00000100:00100000:0.0:1788201615.927179:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788201615.927203:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570155520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201615.927252:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201615.927334:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570155520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201615.927363:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00010000:00080000:0.0:1788201615.927405:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd9e680 x1875064570155520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201631 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201615.927426:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570155520:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201615.929529:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201616.186398:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201616.245503:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201616.245658:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559698688 00000100:00100000:2.0:1788201616.245675:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559698688 00002000:00100000:2.0:1788201616.245726:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (789577728->790626303) req@ffff9624b9d25f80 x1875064559698688/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:737/0 lens 488/0 e 0 to 0 dl 1788201627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201616.245738:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25f80 with x1875064559698688 ext(789577728->790626303) 00002000:00010000:2.0:1788201616.245743:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25f80 00000100:00100000:2.0:1788201616.245772:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 798 00000100:00100000:2.0:1788201616.245781:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559698688:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201616.280591:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559698688:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34798us (35084us total) trans 30064771799 rc 0/0 00000100:00100000:2.0:1788201616.280605:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 798 00002000:00100000:2.0:1788201616.280618:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (789577728->790626303) req@ffff9624b9d25f80 x1875064559698688/t30064771799(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:737/0 lens 488/448 e 0 to 0 dl 1788201627 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201616.280630:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25f80 with x1875064559698688 ext(789577728->790626303) 00002000:00010000:2.0:1788201616.280636:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25f80 00000100:00100000:0.0:1788201616.438613:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570156032:0@lo:400:kworker.0 00000100:00100000:0.0:1788201616.438686:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201616.438745:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201616.438752:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570155648:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.438768:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570155776:0@lo:400:kworker.0 00000100:00100000:0.0:1788201616.438780:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201616.438801:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570156160:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.438807:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201616.438823:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.438825:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570156288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.438844:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201616.438845:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570155904:0@lo:400:kworker.0 00000100:00100000:0.0:1788201616.438866:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201616.438895:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570156032 00000100:00100000:1.0:1788201616.438896:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570155776 00000100:00100000:0.0:1788201616.438902:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570156032 00000100:00100000:1.0:1788201616.438902:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570155776 00000100:00100000:3.0:1788201616.438943:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570156288 00000100:00100000:3.0:1788201616.438950:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570156288 00000100:00100000:0.0:1788201616.439007:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1788201616.439019:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570156032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201616.439076:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570156032:12345-0@lo:400:kworker.0 Request processed in 59us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201616.439083:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1788201616.439147:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570155648 00000100:00100000:2.0:1788201616.439157:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570155648 00000100:00100000:2.0:1788201616.439188:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:2.0:1788201616.439194:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570155648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.439228:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570155648:12345-0@lo:400:kworker.0 Request processed in 35us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.439233:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:2.0:1788201616.439282:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570156160 00000100:00100000:2.0:1788201616.439286:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570156160 00000100:00100000:2.0:1788201616.439308:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570155904 00000100:00100000:2.0:1788201616.439338:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570155904 00000100:00100000:2.0:1788201616.439386:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788201616.439393:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570156160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.439426:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570156160:12345-0@lo:400:kworker.0 Request processed in 34us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.439433:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788201616.439444:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788201616.439450:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570155904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.439480:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570155904:12345-0@lo:400:kworker.0 Request processed in 30us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.439486:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788201616.439940:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570155904:0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.439974:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570155648:0@lo:400:kworker.0 00010000:00080000:2.0:1788201616.439986:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624b9d6bb80 x1875064570156160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201616.439997:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570156160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.440021:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570156032:0@lo:400:kworker.0 00000100:00080000:2.0:1788201616.440051:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201616.440056:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201616.448429:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1788201616.448453:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570155776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.448561:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570155776:12345-0@lo:400:kworker.0 Request processed in 121us (9752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201616.448568:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1788201616.448631:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570155776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201616.450808:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1788201616.450850:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570156288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201616.451048:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570156288:12345-0@lo:400:kworker.0 Request processed in 209us (12202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201616.451057:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1788201616.452516:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570156288:0@lo:400:kworker.0 00000100:00100000:0.0:1788201616.592787:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201616.592914:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559698816 00000100:00100000:2.0:1788201616.592931:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559698816 00002000:00100000:2.0:1788201616.593037:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (790626304->791674879) req@ffff9624b9d68a80 x1875064559698816/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:737/0 lens 488/0 e 0 to 0 dl 1788201627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201616.593052:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68a80 with x1875064559698816 ext(790626304->791674879) 00002000:00010000:2.0:1788201616.593058:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68a80 00000100:00100000:2.0:1788201616.593106:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 799 00000100:00100000:2.0:1788201616.593119:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559698816:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201616.624179:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559698816:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31046us (31387us total) trans 30064771800 rc 0/0 00000100:00100000:2.0:1788201616.624196:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 799 00002000:00100000:2.0:1788201616.624211:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (790626304->791674879) req@ffff9624b9d68a80 x1875064559698816/t30064771800(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:737/0 lens 488/448 e 0 to 0 dl 1788201627 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201616.624223:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68a80 with x1875064559698816 ext(790626304->791674879) 00002000:00010000:2.0:1788201616.624230:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68a80 00000100:00100000:0.0:1788201616.767529:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201616.767655:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559698944 00000100:00100000:1.0:1788201616.767668:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559698944 00002000:00100000:1.0:1788201616.767730:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (791674880->792723455) req@ffff9624b9d68700 x1875064559698944/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:737/0 lens 488/0 e 0 to 0 dl 1788201627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201616.767745:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68700 with x1875064559698944 ext(791674880->792723455) 00002000:00010000:1.0:1788201616.767751:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68700 00000100:00100000:1.0:1788201616.767795:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 800 00000100:00100000:1.0:1788201616.767805:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559698944:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201616.782254:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559698944:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14434us (14724us total) trans 30064771801 rc 0/0 00000100:00100000:1.0:1788201616.782273:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 800 00002000:00100000:1.0:1788201616.782288:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (791674880->792723455) req@ffff9624b9d68700 x1875064559698944/t30064771801(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:737/0 lens 488/448 e 0 to 0 dl 1788201627 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201616.787816:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68700 with x1875064559698944 ext(791674880->792723455) 00002000:00010000:1.0:1788201616.787831:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68700 00000100:00100000:3.0:1788201617.171174:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201617.171455:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559699072 00000100:00100000:2.0:1788201617.171490:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559699072 00002000:00100000:2.0:1788201617.171578:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (792723456->793772031) req@ffff9624b9d27480 x1875064559699072/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:738/0 lens 488/0 e 0 to 0 dl 1788201628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201617.171590:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27480 with x1875064559699072 ext(792723456->793772031) 00002000:00010000:2.0:1788201617.171609:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27480 00000100:00100000:2.0:1788201617.171646:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 801 00000100:00100000:2.0:1788201617.171656:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559699072:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201617.171949:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201617.220787:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201617.232664:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559699072:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 60997us (61487us total) trans 30064771802 rc 0/0 00000100:00100000:2.0:1788201617.232679:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 801 00002000:00100000:2.0:1788201617.232693:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (792723456->793772031) req@ffff9624b9d27480 x1875064559699072/t30064771802(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:738/0 lens 488/448 e 0 to 0 dl 1788201628 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201617.232705:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27480 with x1875064559699072 ext(792723456->793772031) 00002000:00010000:2.0:1788201617.232711:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27480 00000100:00100000:0.0:1788201617.551415:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201617.551532:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559699200 00000100:00100000:2.0:1788201617.551543:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559699200 00002000:00100000:2.0:1788201617.551595:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (793772032->794820607) req@ffff9624b9d68e00 x1875064559699200/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:738/0 lens 488/0 e 0 to 0 dl 1788201628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201617.551617:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68e00 with x1875064559699200 ext(793772032->794820607) 00002000:00010000:2.0:1788201617.551623:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68e00 00000100:00100000:2.0:1788201617.551648:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 802 00000100:00100000:2.0:1788201617.551657:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559699200:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201617.570031:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2341:x1875064559699200:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18363us (18615us total) trans 30064771803 rc 0/0 00000100:00100000:2.0:1788201617.570046:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 802 00002000:00100000:2.0:1788201617.570060:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (793772032->794820607) req@ffff9624b9d68e00 x1875064559699200/t30064771803(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:738/0 lens 488/448 e 0 to 0 dl 1788201628 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201617.570090:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68e00 with x1875064559699200 ext(793772032->794820607) 00002000:00010000:2.0:1788201617.570096:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68e00 00000100:00100000:3.0:1788201617.844645:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201617.844848:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559699328 00000100:00100000:2.0:1788201617.844872:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559699328 00002000:00100000:2.0:1788201617.844930:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (794820608->795869183) req@ffff9624b9d27800 x1875064559699328/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:738/0 lens 488/0 e 0 to 0 dl 1788201628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201617.844941:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27800 with x1875064559699328 ext(794820608->795869183) 00002000:00010000:2.0:1788201617.844947:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27800 00000100:00100000:2.0:1788201617.844981:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 803 00000100:00100000:2.0:1788201617.844991:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559699328:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201617.885815:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559699328:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39294us (39648us total) trans 30064771804 rc 0/0 00000100:00100000:1.0:1788201617.886202:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 803 00002000:00100000:1.0:1788201617.886223:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (794820608->795869183) req@ffff9624b9d27800 x1875064559699328/t30064771804(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:738/0 lens 488/448 e 0 to 0 dl 1788201628 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201617.886235:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27800 with x1875064559699328 ext(794820608->795869183) 00002000:00010000:1.0:1788201617.886243:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27800 00000100:00100000:0.0:1788201618.176018:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201618.176108:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559699456 00000100:00100000:1.0:1788201618.176119:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559699456 00002000:00100000:1.0:1788201618.176177:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (795869184->796917759) req@ffff9624b9d6ad80 x1875064559699456/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:739/0 lens 488/0 e 0 to 0 dl 1788201629 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201618.176190:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6ad80 with x1875064559699456 ext(795869184->796917759) 00002000:00010000:1.0:1788201618.176195:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6ad80 00000100:00100000:1.0:1788201618.176238:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 804 00000100:00100000:1.0:1788201618.176249:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559699456:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201618.207515:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559699456:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31251us (31491us total) trans 30064771805 rc 0/0 00000100:00100000:1.0:1788201618.207533:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 804 00002000:00100000:1.0:1788201618.207547:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (795869184->796917759) req@ffff9624b9d6ad80 x1875064559699456/t30064771805(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:739/0 lens 488/448 e 0 to 0 dl 1788201629 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201618.207559:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6ad80 with x1875064559699456 ext(795869184->796917759) 00002000:00010000:1.0:1788201618.207577:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6ad80 00010000:00010000:2.0:1788201618.231150:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201618.487037:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570156416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201618.487156:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201618.487490:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570156416 00000100:00100000:3.0:1788201618.487501:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570156416 00000100:00100000:3.0:1788201618.487577:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788201618.487590:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570156416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201618.487619:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 552402944 pending 23855104 free 3077570560 avail 3075473408 00000100:00100000:3.0:1788201618.487677:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570156416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201618.487685:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1788201618.488013:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201618.488075:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570156416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201618.577966:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201618.578498:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559699584 00000100:00100000:3.0:1788201618.578510:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559699584 00002000:00100000:3.0:1788201618.578782:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (796917760->797966335) req@ffff9624c1c25f80 x1875064559699584/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:739/0 lens 488/0 e 0 to 0 dl 1788201629 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201618.578793:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25f80 with x1875064559699584 ext(796917760->797966335) 00002000:00010000:3.0:1788201618.578800:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25f80 00000100:00100000:3.0:1788201618.578843:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 805 00000100:00100000:3.0:1788201618.578854:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559699584:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201618.607967:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559699584:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29102us (30001us total) trans 30064771806 rc 0/0 00000100:00100000:3.0:1788201618.607981:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 805 00002000:00100000:3.0:1788201618.608010:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (796917760->797966335) req@ffff9624c1c25f80 x1875064559699584/t30064771806(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:739/0 lens 488/448 e 0 to 0 dl 1788201629 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201618.608029:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25f80 with x1875064559699584 ext(796917760->797966335) 00002000:00010000:3.0:1788201618.608036:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25f80 00000100:00100000:0.0:1788201618.748643:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201618.749615:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559699712 00000100:00100000:2.0:1788201618.749630:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559699712 00002000:00100000:2.0:1788201618.749715:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (664543232->798568447) req@ffff9624b9d68000 x1875064559699712/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:739/0 lens 504/0 e 0 to 0 dl 1788201629 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201618.749729:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68000 with x1875064559699712 ext(664543232->798568447) 00002000:00010000:2.0:1788201618.749737:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68000 00000100:00100000:2.0:1788201618.750038:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 806 00000100:00100000:2.0:1788201618.750054:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559699712:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201618.782494:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559699712:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32434us (33853us total) trans 30064771807 rc 0/0 00000100:00100000:2.0:1788201618.782510:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 806 00002000:00100000:2.0:1788201618.782538:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (664543232->798568447) req@ffff9624b9d68000 x1875064559699712/t30064771807(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:739/0 lens 504/448 e 0 to 0 dl 1788201629 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201618.785404:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d68000 with x1875064559699712 ext(664543232->798568447) 00002000:00010000:2.0:1788201618.785413:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d68000 00000001:00080000:0.0:1788201619.205745:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771797 is committed 00000001:00080000:0.0:1788201619.205775:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771805 is committed 00000001:00080000:0.0:1788201619.205791:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771807 is committed 00000100:00100000:1.0:1788201619.207177:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201619.209017:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559699840 00000100:00100000:2.0:1788201619.209032:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559699840 00002000:00100000:2.0:1788201619.209290:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (799014912->800063487) req@ffff9624bfd9f100 x1875064559699840/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/0 e 0 to 0 dl 1788201630 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201619.209303:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9f100 with x1875064559699840 ext(799014912->800063487) 00002000:00010000:2.0:1788201619.209308:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9f100 00000100:00100000:2.0:1788201619.209363:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 807 00000100:00100000:2.0:1788201619.209375:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559699840:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201619.214639:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201619.248608:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559699840:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39225us (41428us total) trans 30064771808 rc 0/0 00000100:00100000:0.0:1788201619.248622:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 807 00002000:00100000:0.0:1788201619.248637:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (799014912->800063487) req@ffff9624bfd9f100 x1875064559699840/t30064771808(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/448 e 0 to 0 dl 1788201630 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201619.248647:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9f100 with x1875064559699840 ext(799014912->800063487) 00002000:00010000:0.0:1788201619.248653:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9f100 00010000:00010000:0.0:1788201619.257425:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201619.423060:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201619.423165:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559699968 00000100:00100000:0.0:1788201619.423176:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559699968 00002000:00100000:0.0:1788201619.423227:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (800063488->801112063) req@ffff9624bfd9ca80 x1875064559699968/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/0 e 0 to 0 dl 1788201630 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201619.423249:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ca80 with x1875064559699968 ext(800063488->801112063) 00002000:00010000:0.0:1788201619.423279:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ca80 00000100:00100000:0.0:1788201619.423401:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 808 00000100:00100000:0.0:1788201619.423412:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559699968:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201619.447514:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559699968:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24089us (24448us total) trans 30064771809 rc 0/0 00000100:00100000:2.0:1788201619.447531:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 808 00002000:00100000:2.0:1788201619.447546:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (800063488->801112063) req@ffff9624bfd9ca80 x1875064559699968/t30064771809(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/448 e 0 to 0 dl 1788201630 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201619.447554:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ca80 with x1875064559699968 ext(800063488->801112063) 00002000:00010000:2.0:1788201619.447560:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ca80 00000100:00100000:1.0:1788201619.547924:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201619.548206:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559700096 00000100:00100000:3.0:1788201619.548218:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559700096 00002000:00100000:3.0:1788201619.548282:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (801112064->802160639) req@ffff9624bfd9fb80 x1875064559700096/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/0 e 0 to 0 dl 1788201630 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201619.548294:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9fb80 with x1875064559700096 ext(801112064->802160639) 00002000:00010000:3.0:1788201619.548300:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9fb80 00000100:00100000:3.0:1788201619.548336:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 809 00000100:00100000:3.0:1788201619.548372:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559700096:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201619.581800:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559700096:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33419us (33874us total) trans 30064771810 rc 0/0 00000100:00100000:2.0:1788201619.581817:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 809 00002000:00100000:2.0:1788201619.581831:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (801112064->802160639) req@ffff9624bfd9fb80 x1875064559700096/t30064771810(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/448 e 0 to 0 dl 1788201630 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201619.581863:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9fb80 with x1875064559700096 ext(801112064->802160639) 00002000:00010000:2.0:1788201619.581869:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9fb80 00000100:00100000:0.0:1788201619.617816:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201619.617957:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559700224 00000100:00100000:2.0:1788201619.617979:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559700224 00002000:00100000:2.0:1788201619.618036:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (802160640->803209215) req@ffff9624b9d6a680 x1875064559700224/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/0 e 0 to 0 dl 1788201630 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201619.618062:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6a680 with x1875064559700224 ext(802160640->803209215) 00002000:00010000:2.0:1788201619.618067:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6a680 00000100:00100000:2.0:1788201619.618099:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 810 00000100:00100000:2.0:1788201619.618108:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559700224:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201619.642396:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559700224:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24278us (24579us total) trans 30064771811 rc 0/0 00000100:00100000:2.0:1788201619.642409:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 810 00002000:00100000:2.0:1788201619.642422:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (802160640->803209215) req@ffff9624b9d6a680 x1875064559700224/t30064771811(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/448 e 0 to 0 dl 1788201630 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201619.642433:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d6a680 with x1875064559700224 ext(802160640->803209215) 00002000:00010000:2.0:1788201619.642439:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d6a680 00000100:00100000:0.0:1788201619.808760:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201619.824220:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559700352 00000100:00100000:1.0:1788201619.824241:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559700352 00002000:00100000:1.0:1788201619.824321:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (803209216->804257791) req@ffff962485687b80 x1875064559700352/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/0 e 0 to 0 dl 1788201630 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201619.824334:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485687b80 with x1875064559700352 ext(803209216->804257791) 00002000:00010000:1.0:1788201619.824340:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485687b80 00000100:00100000:1.0:1788201619.824401:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 811 00000100:00100000:1.0:1788201619.824411:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559700352:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201619.835590:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559700352:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11169us (27097us total) trans 30064771812 rc 0/0 00000100:00100000:2.0:1788201619.835616:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 811 00002000:00100000:2.0:1788201619.835631:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (803209216->804257791) req@ffff962485687b80 x1875064559700352/t30064771812(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/448 e 0 to 0 dl 1788201630 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201619.835663:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485687b80 with x1875064559700352 ext(803209216->804257791) 00002000:00010000:2.0:1788201619.835670:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485687b80 00000100:00100000:3.0:1788201619.875901:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201619.890458:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559700480 00000100:00100000:0.0:1788201619.890476:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559700480 00002000:00100000:0.0:1788201619.890546:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (804257792->805306367) req@ffff9624b9d24e00 x1875064559700480/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/0 e 0 to 0 dl 1788201630 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201619.890558:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24e00 with x1875064559700480 ext(804257792->805306367) 00002000:00010000:0.0:1788201619.890564:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24e00 00000100:00100000:1.0:1788201619.890694:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 812 00000100:00100000:1.0:1788201619.890706:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559700480:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201619.901556:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559700480:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10840us (25653us total) trans 30064771813 rc 0/0 00000100:00100000:3.0:1788201619.901573:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 812 00002000:00100000:3.0:1788201619.901588:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (804257792->805306367) req@ffff9624b9d24e00 x1875064559700480/t30064771813(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/448 e 0 to 0 dl 1788201630 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201619.901600:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24e00 with x1875064559700480 ext(804257792->805306367) 00002000:00010000:3.0:1788201619.901606:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24e00 00000100:00100000:0.0:1788201619.994919:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201619.995089:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559700608 00000100:00100000:2.0:1788201619.995100:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559700608 00002000:00100000:2.0:1788201619.995153:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (805306368->806354943) req@ffff962485684a80 x1875064559700608/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/0 e 0 to 0 dl 1788201630 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201619.995165:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684a80 with x1875064559700608 ext(805306368->806354943) 00002000:00010000:2.0:1788201619.995170:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684a80 00000100:00100000:2.0:1788201619.995208:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 813 00000100:00100000:2.0:1788201619.995218:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559700608:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201620.015009:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559700608:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19777us (20085us total) trans 30064771814 rc 0/0 00000100:00100000:3.0:1788201620.015027:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 813 00002000:00100000:3.0:1788201620.017854:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (805306368->806354943) req@ffff962485684a80 x1875064559700608/t30064771814(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:740/0 lens 488/448 e 0 to 0 dl 1788201630 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201620.017886:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684a80 with x1875064559700608 ext(805306368->806354943) 00002000:00010000:3.0:1788201620.017893:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684a80 00000100:00100000:1.0:1788201620.112044:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201620.112154:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559700736 00000100:00100000:2.0:1788201620.112166:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559700736 00002000:00100000:2.0:1788201620.112222:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (806354944->807403519) req@ffff9624bfd9ea00 x1875064559700736/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:741/0 lens 488/0 e 0 to 0 dl 1788201631 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201620.112234:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ea00 with x1875064559700736 ext(806354944->807403519) 00002000:00010000:2.0:1788201620.112240:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ea00 00000100:00100000:2.0:1788201620.112284:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 814 00000100:00100000:2.0:1788201620.112294:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559700736:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201620.129787:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559700736:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17483us (17743us total) trans 30064771815 rc 0/0 00000100:00100000:2.0:1788201620.129801:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 814 00002000:00100000:2.0:1788201620.129813:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (806354944->807403519) req@ffff9624bfd9ea00 x1875064559700736/t30064771815(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:741/0 lens 488/448 e 0 to 0 dl 1788201631 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201620.129838:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ea00 with x1875064559700736 ext(806354944->807403519) 00002000:00010000:2.0:1788201620.129843:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ea00 00000100:00100000:2.0:1788201620.277630:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201620.277682:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201620.277866:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559700992 00000100:00100000:3.0:1788201620.277877:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559700992 00000100:00100000:3.0:1788201620.277963:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 439 00000100:00100000:3.0:1788201620.277977:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559700992:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201620.278071:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2343:x1875064559700992:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 97us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201620.278079:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 439 00000100:00080000:0.0:1788201620.278239:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201620.278316:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559700864 00000100:00100000:1.0:1788201620.278323:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559700864 00000100:00100000:1.0:1788201620.278417:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 562 00000100:00100000:1.0:1788201620.278425:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559700864:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201620.278452:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559700864:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 30us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201620.278459:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 562 00010000:00010000:1.0:1788201620.279288:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201620.346599:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201620.346772:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559701120 00000100:00100000:2.0:1788201620.346783:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559701120 00002000:00100000:2.0:1788201620.346839:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (807403520->808452095) req@ffff962485685180 x1875064559701120/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:741/0 lens 488/0 e 0 to 0 dl 1788201631 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201620.346850:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485685180 with x1875064559701120 ext(807403520->808452095) 00002000:00010000:2.0:1788201620.346856:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485685180 00000100:00100000:2.0:1788201620.346891:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 815 00000100:00100000:2.0:1788201620.346902:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559701120:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201620.379290:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559701120:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32377us (32691us total) trans 30064771816 rc 0/0 00000100:00100000:2.0:1788201620.379305:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 815 00002000:00100000:2.0:1788201620.379319:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (807403520->808452095) req@ffff962485685180 x1875064559701120/t30064771816(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:741/0 lens 488/448 e 0 to 0 dl 1788201631 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201620.379330:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485685180 with x1875064559701120 ext(807403520->808452095) 00002000:00010000:2.0:1788201620.379335:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485685180 00000100:00100000:1.0:1788201620.453618:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201620.454473:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559701248 00000100:00100000:3.0:1788201620.454487:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559701248 00002000:00100000:3.0:1788201620.454547:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (808452096->809500671) req@ffff9624bfd9d180 x1875064559701248/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:741/0 lens 488/0 e 0 to 0 dl 1788201631 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201620.454558:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9d180 with x1875064559701248 ext(808452096->809500671) 00002000:00010000:3.0:1788201620.454564:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9d180 00000100:00100000:3.0:1788201620.454611:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 816 00000100:00100000:3.0:1788201620.454622:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559701248:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201620.467991:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559701248:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13357us (14370us total) trans 30064771817 rc 0/0 00000100:00100000:3.0:1788201620.468005:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 816 00002000:00100000:3.0:1788201620.468019:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (808452096->809500671) req@ffff9624bfd9d180 x1875064559701248/t30064771817(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:741/0 lens 488/448 e 0 to 0 dl 1788201631 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201620.468030:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9d180 with x1875064559701248 ext(808452096->809500671) 00002000:00010000:3.0:1788201620.468048:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9d180 00000100:00100000:1.0:1788201620.737315:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201620.738014:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559701376 00000100:00100000:3.0:1788201620.738034:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559701376 00002000:00100000:3.0:1788201620.738095:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (809500672->810549247) req@ffff9624bfd9c700 x1875064559701376/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:741/0 lens 488/0 e 0 to 0 dl 1788201631 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201620.738105:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9c700 with x1875064559701376 ext(809500672->810549247) 00002000:00010000:3.0:1788201620.738110:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9c700 00000100:00100000:3.0:1788201620.738144:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 817 00000100:00100000:3.0:1788201620.738152:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559701376:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201620.759729:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559701376:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21567us (22418us total) trans 30064771818 rc 0/0 00000100:00100000:3.0:1788201620.759743:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 817 00002000:00100000:3.0:1788201620.759758:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (809500672->810549247) req@ffff9624bfd9c700 x1875064559701376/t30064771818(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:741/0 lens 488/448 e 0 to 0 dl 1788201631 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201620.759769:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9c700 with x1875064559701376 ext(809500672->810549247) 00002000:00010000:3.0:1788201620.759776:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9c700 00000100:00100000:1.0:1788201620.940719:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201620.943714:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559701504 00000100:00100000:2.0:1788201620.943732:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559701504 00002000:00100000:2.0:1788201620.943802:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (810549248->811597823) req@ffff9624bfd9d500 x1875064559701504/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:741/0 lens 488/0 e 0 to 0 dl 1788201631 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201620.943836:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9d500 with x1875064559701504 ext(810549248->811597823) 00002000:00010000:2.0:1788201620.943842:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9d500 00000100:00100000:2.0:1788201620.943969:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 818 00000100:00100000:2.0:1788201620.943982:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559701504:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201620.970060:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559701504:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26067us (29338us total) trans 30064771819 rc 0/0 00000100:00100000:3.0:1788201620.970077:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 818 00002000:00100000:3.0:1788201620.970095:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (810549248->811597823) req@ffff9624bfd9d500 x1875064559701504/t30064771819(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:741/0 lens 488/448 e 0 to 0 dl 1788201631 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201620.970106:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9d500 with x1875064559701504 ext(810549248->811597823) 00002000:00010000:3.0:1788201620.970113:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9d500 00000100:00100000:2.0:1788201621.047087:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570156544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201621.047161:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201621.047310:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570156544 00000100:00100000:3.0:1788201621.047335:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570156544 00000100:00100000:3.0:1788201621.047430:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788201621.047442:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570156544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201621.047478:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201621.047530:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570156544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201621.047537:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00010000:00080000:3.0:1788201621.047596:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624bfd9df80 x1875064570156544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201621.047617:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570156544:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201621.047871:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201621.224178:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201621.224382:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559701632 00000100:00100000:2.0:1788201621.224393:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559701632 00002000:00100000:2.0:1788201621.224468:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (811597824->812646399) req@ffff9624b9d25c00 x1875064559701632/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:742/0 lens 488/0 e 0 to 0 dl 1788201632 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201621.224479:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25c00 with x1875064559701632 ext(811597824->812646399) 00002000:00010000:2.0:1788201621.224485:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25c00 00000100:00100000:2.0:1788201621.224518:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 819 00000100:00100000:2.0:1788201621.224528:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559701632:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201621.225413:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201621.245833:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559701632:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21294us (21656us total) trans 30064771820 rc 0/0 00000100:00100000:2.0:1788201621.245849:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 819 00002000:00100000:2.0:1788201621.245864:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (811597824->812646399) req@ffff9624b9d25c00 x1875064559701632/t30064771820(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:742/0 lens 488/448 e 0 to 0 dl 1788201632 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201621.245875:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25c00 with x1875064559701632 ext(811597824->812646399) 00002000:00010000:2.0:1788201621.245881:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25c00 00010000:00010000:2.0:1788201621.302708:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201621.366716:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201621.366822:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559701760 00000100:00100000:3.0:1788201621.366834:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559701760 00002000:00100000:3.0:1788201621.366894:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (812646400->813694975) req@ffff9624bfd9f480 x1875064559701760/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:742/0 lens 488/0 e 0 to 0 dl 1788201632 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201621.366907:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9f480 with x1875064559701760 ext(812646400->813694975) 00002000:00010000:3.0:1788201621.366914:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9f480 00000100:00100000:3.0:1788201621.366949:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 820 00000100:00100000:3.0:1788201621.366961:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559701760:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201621.382619:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559701760:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15649us (15903us total) trans 30064771821 rc 0/0 00000100:00100000:2.0:1788201621.382633:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 820 00002000:00100000:2.0:1788201621.382647:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (812646400->813694975) req@ffff9624bfd9f480 x1875064559701760/t30064771821(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:742/0 lens 488/448 e 0 to 0 dl 1788201632 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201621.382657:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9f480 with x1875064559701760 ext(812646400->813694975) 00002000:00010000:2.0:1788201621.382664:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9f480 00000100:00100000:0.0:1788201621.559096:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570156928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201621.559107:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570156800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.559185:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570156672:0@lo:400:kworker.0 00000100:00100000:3.0:1788201621.559259:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570157056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201621.559286:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201621.559410:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570156800 00000100:00100000:3.0:1788201621.559419:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570156800 00000100:00100000:3.0:1788201621.559475:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1788201621.559486:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570156800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.573322:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.573423:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570157184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.573462:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.573515:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570156672 00000100:00100000:1.0:1788201621.573522:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570156672 00000100:00100000:1.0:1788201621.573568:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1788201621.573577:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570156672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.573844:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570156672:12345-0@lo:400:kworker.0 Request processed in 267us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201621.573852:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1788201621.573896:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570157184 00000100:00100000:1.0:1788201621.573900:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570157184 00000100:00100000:1.0:1788201621.573938:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1788201621.573945:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570157184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.573977:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570157184:12345-0@lo:400:kworker.0 Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201621.573983:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1788201621.574019:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570156672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.574033:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570157184:0@lo:400:kworker.0 00000100:00080000:1.0:1788201621.574053:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201621.574377:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.574413:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570157056 00000100:00100000:1.0:1788201621.574417:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570157056 00000100:00100000:1.0:1788201621.574441:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1788201621.574447:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570157056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.574502:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570157056:12345-0@lo:400:kworker.0 Request processed in 55us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201621.574510:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1788201621.574538:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570157056:0@lo:400:kworker.0 00000100:00080000:1.0:1788201621.574551:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201621.578573:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570156800:12345-0@lo:400:kworker.0 Request processed in 19077us (19278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201621.578602:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1788201621.583651:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201621.585799:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570156800:0@lo:400:kworker.0 00000100:00100000:3.0:1788201621.586835:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570156928 00000100:00100000:3.0:1788201621.586845:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570156928 00000100:00100000:2.0:1788201621.586989:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788201621.587002:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570156928:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788201621.587059:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201621.587157:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570156928:12345-0@lo:400:kworker.0 Request processed in 157us (3513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201621.587303:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570156928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201621.590326:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788201621.713950:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201621.714155:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559701888 00000100:00100000:3.0:1788201621.714167:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559701888 00002000:00100000:3.0:1788201621.714241:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (813694976->814743551) req@ffff9624bfd9ce00 x1875064559701888/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:742/0 lens 488/0 e 0 to 0 dl 1788201632 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201621.714251:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ce00 with x1875064559701888 ext(813694976->814743551) 00002000:00010000:3.0:1788201621.714256:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ce00 00000100:00100000:3.0:1788201621.714295:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 821 00000100:00100000:3.0:1788201621.714305:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559701888:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201621.734165:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559701888:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19848us (20213us total) trans 30064771822 rc 0/0 00000100:00100000:3.0:1788201621.734182:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 821 00002000:00100000:3.0:1788201621.734195:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (813694976->814743551) req@ffff9624bfd9ce00 x1875064559701888/t30064771822(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:742/0 lens 488/448 e 0 to 0 dl 1788201632 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201621.734207:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9ce00 with x1875064559701888 ext(813694976->814743551) 00002000:00010000:3.0:1788201621.734213:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9ce00 00000100:00100000:0.0:1788201621.961819:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201621.961985:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559702016 00000100:00100000:2.0:1788201621.961997:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559702016 00002000:00100000:2.0:1788201621.962062:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (814743552->815792127) req@ffff962485685500 x1875064559702016/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:742/0 lens 488/0 e 0 to 0 dl 1788201632 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201621.962073:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485685500 with x1875064559702016 ext(814743552->815792127) 00002000:00010000:2.0:1788201621.962079:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485685500 00000100:00100000:2.0:1788201621.962123:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 822 00000100:00100000:2.0:1788201621.962135:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559702016:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201621.981324:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559702016:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19178us (19500us total) trans 30064771823 rc 0/0 00000100:00100000:2.0:1788201621.981382:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 822 00002000:00100000:2.0:1788201621.981399:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (814743552->815792127) req@ffff962485685500 x1875064559702016/t30064771823(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:742/0 lens 488/448 e 0 to 0 dl 1788201632 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201621.981410:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485685500 with x1875064559702016 ext(814743552->815792127) 00002000:00010000:2.0:1788201621.981418:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485685500 00000100:00100000:3.0:1788201622.220862:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201622.222495:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559702144 00000100:00100000:2.0:1788201622.222509:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559702144 00002000:00100000:2.0:1788201622.222572:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (815792128->816840703) req@ffff9624b9d26d80 x1875064559702144/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:743/0 lens 488/0 e 0 to 0 dl 1788201633 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201622.222585:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26d80 with x1875064559702144 ext(815792128->816840703) 00002000:00010000:2.0:1788201622.222591:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26d80 00000100:00100000:2.0:1788201622.222643:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 823 00000100:00100000:2.0:1788201622.222663:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559702144:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201622.266380:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559702144:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 43676us (45484us total) trans 30064771824 rc 0/0 00000100:00100000:2.0:1788201622.266396:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 823 00002000:00100000:2.0:1788201622.266411:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (815792128->816840703) req@ffff9624b9d26d80 x1875064559702144/t30064771824(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:743/0 lens 488/448 e 0 to 0 dl 1788201633 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201622.266421:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26d80 with x1875064559702144 ext(815792128->816840703) 00002000:00010000:2.0:1788201622.266428:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26d80 00010000:00010000:0.0:1788201622.326587:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201622.395550:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201622.395672:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559702272 00000100:00100000:1.0:1788201622.395683:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559702272 00002000:00100000:1.0:1788201622.395758:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (816840704->817889279) req@ffff9624b9d26a00 x1875064559702272/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:743/0 lens 488/0 e 0 to 0 dl 1788201633 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201622.395771:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26a00 with x1875064559702272 ext(816840704->817889279) 00002000:00010000:1.0:1788201622.395778:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26a00 00000100:00100000:1.0:1788201622.395816:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 824 00000100:00100000:1.0:1788201622.395827:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559702272:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201622.507586:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559702272:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 111750us (112036us total) trans 30064771825 rc 0/0 00000100:00100000:1.0:1788201622.507599:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 824 00002000:00100000:1.0:1788201622.507611:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (816840704->817889279) req@ffff9624b9d26a00 x1875064559702272/t30064771825(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:743/0 lens 488/448 e 0 to 0 dl 1788201633 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201622.507620:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26a00 with x1875064559702272 ext(816840704->817889279) 00002000:00010000:1.0:1788201622.507626:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26a00 00000100:00100000:1.0:1788201622.686867:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201622.690150:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559702400 00000100:00100000:3.0:1788201622.690164:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559702400 00002000:00100000:3.0:1788201622.690239:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (817889280->818937855) req@ffff9624bfd9d880 x1875064559702400/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:743/0 lens 488/0 e 0 to 0 dl 1788201633 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201622.690270:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9d880 with x1875064559702400 ext(817889280->818937855) 00002000:00010000:3.0:1788201622.690276:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9d880 00000100:00100000:3.0:1788201622.690322:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 825 00000100:00100000:3.0:1788201622.690332:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2341:x1875064559702400:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201622.732560:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2341:x1875064559702400:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 42218us (45694us total) trans 30064771826 rc 0/0 00000100:00100000:0.0:1788201622.732576:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 825 00002000:00100000:0.0:1788201622.732589:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (817889280->818937855) req@ffff9624bfd9d880 x1875064559702400/t30064771826(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:743/0 lens 488/448 e 0 to 0 dl 1788201633 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201622.732600:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9d880 with x1875064559702400 ext(817889280->818937855) 00002000:00010000:0.0:1788201622.732622:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9d880 00000100:00100000:1.0:1788201622.869619:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201622.870037:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559702528 00000100:00100000:2.0:1788201622.870048:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559702528 00002000:00100000:2.0:1788201622.870098:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (818937856->819986431) req@ffff9624bfd9df80 x1875064559702528/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:743/0 lens 488/0 e 0 to 0 dl 1788201633 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201622.870116:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9df80 with x1875064559702528 ext(818937856->819986431) 00002000:00010000:2.0:1788201622.870121:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9df80 00000100:00100000:2.0:1788201622.870161:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 826 00000100:00100000:2.0:1788201622.870170:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2342:x1875064559702528:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201622.895999:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2342:x1875064559702528:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25811us (26374us total) trans 30064771827 rc 0/0 00000100:00100000:2.0:1788201622.896013:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 826 00002000:00100000:2.0:1788201622.896027:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (818937856->819986431) req@ffff9624bfd9df80 x1875064559702528/t30064771827(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:743/0 lens 488/448 e 0 to 0 dl 1788201633 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201622.896038:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9df80 with x1875064559702528 ext(818937856->819986431) 00002000:00010000:2.0:1788201622.896044:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9df80 00000100:00100000:1.0:1788201623.112929:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201623.113903:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559702656 00000100:00100000:2.0:1788201623.113938:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559702656 00002000:00100000:2.0:1788201623.114044:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (819986432->821035007) req@ffff9624bfd9e680 x1875064559702656/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/0 e 0 to 0 dl 1788201634 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201623.114058:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9e680 with x1875064559702656 ext(819986432->821035007) 00002000:00010000:2.0:1788201623.114064:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9e680 00000100:00100000:2.0:1788201623.114103:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 827 00000100:00100000:2.0:1788201623.114117:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559702656:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201623.114942:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201623.141169:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559702656:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27045us (28256us total) trans 30064771828 rc 0/0 00000100:00100000:2.0:1788201623.141182:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 827 00002000:00100000:2.0:1788201623.141221:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (819986432->821035007) req@ffff9624bfd9e680 x1875064559702656/t30064771828(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/448 e 0 to 0 dl 1788201634 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201623.141233:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd9e680 with x1875064559702656 ext(819986432->821035007) 00002000:00010000:2.0:1788201623.141240:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd9e680 00000100:00100000:3.0:1788201623.205823:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201623.206156:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559702784 00000100:00100000:1.0:1788201623.206168:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559702784 00002000:00100000:1.0:1788201623.206243:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (821035008->822083583) req@ffff9624b9d24000 x1875064559702784/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/0 e 0 to 0 dl 1788201634 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201623.206256:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24000 with x1875064559702784 ext(821035008->822083583) 00002000:00010000:1.0:1788201623.206262:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24000 00000100:00100000:1.0:1788201623.206298:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 828 00000100:00100000:1.0:1788201623.206309:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2342:x1875064559702784:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201623.229142:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559702784:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22820us (23313us total) trans 30064771829 rc 0/0 00000100:00100000:2.0:1788201623.229161:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 828 00002000:00100000:2.0:1788201623.229179:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (821035008->822083583) req@ffff9624b9d24000 x1875064559702784/t30064771829(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/448 e 0 to 0 dl 1788201634 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201623.229190:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24000 with x1875064559702784 ext(821035008->822083583) 00002000:00010000:2.0:1788201623.229210:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24000 00000100:00100000:3.0:1788201623.277261:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201623.277442:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559702912 00000100:00100000:0.0:1788201623.277455:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559702912 00002000:00100000:0.0:1788201623.277511:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (822083584->823132159) req@ffff9624b9d26680 x1875064559702912/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/0 e 0 to 0 dl 1788201634 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201623.277535:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26680 with x1875064559702912 ext(822083584->823132159) 00002000:00010000:0.0:1788201623.277542:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26680 00000100:00100000:0.0:1788201623.277577:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 829 00000100:00100000:0.0:1788201623.277588:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559702912:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201623.297745:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2342:x1875064559702912:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20148us (20484us total) trans 30064771830 rc 0/0 00000100:00100000:2.0:1788201623.297760:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 829 00002000:00100000:2.0:1788201623.297776:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (822083584->823132159) req@ffff9624b9d26680 x1875064559702912/t30064771830(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/448 e 0 to 0 dl 1788201634 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201623.297787:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26680 with x1875064559702912 ext(822083584->823132159) 00002000:00010000:2.0:1788201623.297793:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26680 00010000:00010000:1.0:1788201623.350731:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201623.418707:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201623.418830:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559703040 00000100:00100000:2.0:1788201623.418842:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559703040 00002000:00100000:2.0:1788201623.418906:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (823132160->824180735) req@ffff9624b9d26300 x1875064559703040/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/0 e 0 to 0 dl 1788201634 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201623.418919:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26300 with x1875064559703040 ext(823132160->824180735) 00002000:00010000:2.0:1788201623.418925:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26300 00000100:00100000:2.0:1788201623.418975:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 830 00000100:00100000:2.0:1788201623.418985:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559703040:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201623.454758:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559703040:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35762us (36049us total) trans 30064771831 rc 0/0 00000100:00100000:2.0:1788201623.454774:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 830 00002000:00100000:2.0:1788201623.454787:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (823132160->824180735) req@ffff9624b9d26300 x1875064559703040/t30064771831(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/448 e 0 to 0 dl 1788201634 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201623.454798:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26300 with x1875064559703040 ext(823132160->824180735) 00002000:00010000:2.0:1788201623.454805:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26300 00000100:00100000:2.0:1788201623.569252:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201623.572749:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559703168 00000100:00100000:0.0:1788201623.572766:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559703168 00002000:00100000:0.0:1788201623.572836:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (824180736->825229311) req@ffff9624c1c27100 x1875064559703168/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/0 e 0 to 0 dl 1788201634 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201623.572850:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c27100 with x1875064559703168 ext(824180736->825229311) 00002000:00010000:0.0:1788201623.572857:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c27100 00000100:00100000:0.0:1788201623.572984:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 831 00000100:00100000:0.0:1788201623.572994:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2342:x1875064559703168:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201623.599215:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559703168:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26211us (30013us total) trans 30064771832 rc 0/0 00000100:00100000:0.0:1788201623.599229:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 831 00002000:00100000:0.0:1788201623.599242:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (824180736->825229311) req@ffff9624c1c27100 x1875064559703168/t30064771832(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/448 e 0 to 0 dl 1788201634 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201623.599253:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c27100 with x1875064559703168 ext(824180736->825229311) 00002000:00010000:0.0:1788201623.599258:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c27100 00000100:00100000:0.0:1788201623.606800:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201623.606826:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570157312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201623.606895:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201623.607089:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570157312 00000100:00100000:1.0:1788201623.607098:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570157312 00000100:00100000:1.0:1788201623.607177:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788201623.607198:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570157312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201623.607226:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 570359808 pending 42598400 free 3060793344 avail 3058696192 00000100:00100000:1.0:1788201623.607279:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570157312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201623.607287:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788201623.607366:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570157312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201623.607578:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201623.789758:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201623.790324:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559703296 00000100:00100000:1.0:1788201623.790336:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559703296 00002000:00100000:1.0:1788201623.790425:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (825229312->826277887) req@ffff9624c1c25180 x1875064559703296/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/0 e 0 to 0 dl 1788201634 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201623.790438:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25180 with x1875064559703296 ext(825229312->826277887) 00002000:00010000:1.0:1788201623.790678:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25180 00000100:00100000:1.0:1788201623.790711:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 832 00000100:00100000:1.0:1788201623.790723:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559703296:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201623.828010:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559703296:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37275us (38249us total) trans 30064771833 rc 0/0 00000100:00100000:2.0:1788201623.828029:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 832 00002000:00100000:2.0:1788201623.828044:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (825229312->826277887) req@ffff9624c1c25180 x1875064559703296/t30064771833(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/448 e 0 to 0 dl 1788201634 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201623.828057:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25180 with x1875064559703296 ext(825229312->826277887) 00002000:00010000:2.0:1788201623.828065:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25180 00000100:00100000:2.0:1788201623.972877:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201623.973045:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559703424 00000100:00100000:3.0:1788201623.973058:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559703424 00002000:00100000:3.0:1788201623.973121:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (826277888->827326463) req@ffff9624c1c26300 x1875064559703424/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/0 e 0 to 0 dl 1788201634 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201623.973134:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c26300 with x1875064559703424 ext(826277888->827326463) 00002000:00010000:3.0:1788201623.973140:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c26300 00000100:00100000:3.0:1788201623.973205:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 833 00000100:00100000:3.0:1788201623.973218:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2344:x1875064559703424:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201624.007448:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2344:x1875064559703424:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34214us (34575us total) trans 30064771834 rc 0/0 00000100:00100000:3.0:1788201624.007467:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 833 00002000:00100000:3.0:1788201624.007482:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (826277888->827326463) req@ffff9624c1c26300 x1875064559703424/t30064771834(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:744/0 lens 488/448 e 0 to 0 dl 1788201634 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201624.007494:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c26300 with x1875064559703424 ext(826277888->827326463) 00002000:00010000:3.0:1788201624.007501:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c26300 00000100:00100000:1.0:1788201624.171426:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201624.171552:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559703552 00000100:00100000:2.0:1788201624.171563:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559703552 00002000:00100000:2.0:1788201624.171636:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (827326464->828375039) req@ffff962485681f80 x1875064559703552/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:745/0 lens 488/0 e 0 to 0 dl 1788201635 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201624.171650:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681f80 with x1875064559703552 ext(827326464->828375039) 00002000:00010000:2.0:1788201624.171670:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681f80 00000100:00100000:2.0:1788201624.171713:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 834 00000100:00100000:2.0:1788201624.171723:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2341:x1875064559703552:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201624.195425:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2341:x1875064559703552:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23683us (23989us total) trans 30064771835 rc 0/0 00000100:00100000:3.0:1788201624.195447:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 834 00002000:00100000:3.0:1788201624.195465:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (827326464->828375039) req@ffff962485681f80 x1875064559703552/t30064771835(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:745/0 lens 488/448 e 0 to 0 dl 1788201635 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201624.195477:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681f80 with x1875064559703552 ext(827326464->828375039) 00002000:00010000:3.0:1788201624.195485:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681f80 00000001:00080000:0.0:1788201624.311204:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771832 is committed 00000001:00080000:0.0:1788201624.311247:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771833 is committed 00000001:00080000:0.0:1788201624.311542:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771834 is committed 00010000:00010000:2.0:1788201624.374674:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201624.497874:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201624.498994:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559703680 00000100:00100000:0.0:1788201624.499009:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559703680 00002000:00100000:0.0:1788201624.499072:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (828375040->829423615) req@ffff9624c1c25500 x1875064559703680/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:745/0 lens 488/0 e 0 to 0 dl 1788201635 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201624.499084:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25500 with x1875064559703680 ext(828375040->829423615) 00002000:00010000:0.0:1788201624.499089:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25500 00000100:00100000:0.0:1788201624.499126:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 835 00000100:00100000:0.0:1788201624.499137:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559703680:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201624.511080:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559703680:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11934us (13205us total) trans 30064771836 rc 0/0 00000100:00100000:2.0:1788201624.511094:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 835 00002000:00100000:2.0:1788201624.511107:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (828375040->829423615) req@ffff9624c1c25500 x1875064559703680/t30064771836(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:745/0 lens 488/448 e 0 to 0 dl 1788201635 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201624.511118:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c25500 with x1875064559703680 ext(828375040->829423615) 00002000:00010000:2.0:1788201624.511124:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c25500 00000100:00100000:0.0:1788201624.768854:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201624.768954:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559703808 00000100:00100000:1.0:1788201624.768964:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559703808 00002000:00100000:1.0:1788201624.769018:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (829423616->830472191) req@ffff962485684000 x1875064559703808/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:745/0 lens 488/0 e 0 to 0 dl 1788201635 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201624.769029:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684000 with x1875064559703808 ext(829423616->830472191) 00002000:00010000:1.0:1788201624.769035:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684000 00000100:00100000:1.0:1788201624.769074:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 836 00000100:00100000:1.0:1788201624.769084:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559703808:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201624.786728:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559703808:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17633us (17872us total) trans 30064771837 rc 0/0 00000100:00100000:1.0:1788201624.786743:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 836 00002000:00100000:1.0:1788201624.786756:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (829423616->830472191) req@ffff962485684000 x1875064559703808/t30064771837(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:745/0 lens 488/448 e 0 to 0 dl 1788201635 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201624.786767:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684000 with x1875064559703808 ext(829423616->830472191) 00002000:00010000:1.0:1788201624.786773:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684000 00000100:00100000:2.0:1788201625.055252:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201625.055819:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559703936 00000100:00100000:3.0:1788201625.055829:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559703936 00002000:00100000:3.0:1788201625.055955:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (830472192->831520767) req@ffff9624c1c24700 x1875064559703936/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:746/0 lens 488/0 e 0 to 0 dl 1788201636 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201625.055967:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c24700 with x1875064559703936 ext(830472192->831520767) 00002000:00010000:3.0:1788201625.055974:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c24700 00000100:00100000:3.0:1788201625.056022:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 837 00000100:00100000:3.0:1788201625.056035:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559703936:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201625.061293:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201625.077741:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559703936:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21359us (22148us total) trans 30064771838 rc 0/0 00000100:00100000:3.0:1788201625.077756:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 837 00002000:00100000:3.0:1788201625.077769:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (830472192->831520767) req@ffff9624c1c24700 x1875064559703936/t30064771838(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:746/0 lens 488/448 e 0 to 0 dl 1788201636 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201625.077780:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c24700 with x1875064559703936 ext(830472192->831520767) 00002000:00010000:3.0:1788201625.077785:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c24700 00000100:00100000:2.0:1788201625.262483:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201625.262574:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559704064 00000100:00100000:3.0:1788201625.262585:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559704064 00002000:00100000:3.0:1788201625.262650:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (831520768->832569343) req@ffff9624c1c27b80 x1875064559704064/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:746/0 lens 488/0 e 0 to 0 dl 1788201636 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201625.262661:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c27b80 with x1875064559704064 ext(831520768->832569343) 00002000:00010000:3.0:1788201625.262666:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c27b80 00000100:00100000:3.0:1788201625.262704:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 838 00000100:00100000:3.0:1788201625.262715:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559704064:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201625.287822:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559704064:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25094us (25334us total) trans 30064771839 rc 0/0 00000100:00100000:3.0:1788201625.287837:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 838 00002000:00100000:3.0:1788201625.287851:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (831520768->832569343) req@ffff9624c1c27b80 x1875064559704064/t30064771839(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:746/0 lens 488/448 e 0 to 0 dl 1788201636 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201625.287862:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c27b80 with x1875064559704064 ext(831520768->832569343) 00002000:00010000:3.0:1788201625.287868:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c27b80 00000100:00100000:0.0:1788201625.393536:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201625.393677:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201625.393956:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559704320 00000100:00100000:1.0:1788201625.393968:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559704320 00000100:00100000:1.0:1788201625.394045:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 443 00000100:00100000:1.0:1788201625.394062:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559704320:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201625.394134:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559704320:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 74us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201625.394165:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 443 00000100:00080000:0.0:1788201625.397135:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201625.402037:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559704192 00000100:00100000:3.0:1788201625.402062:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559704192 00000100:00100000:3.0:1788201625.402138:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 564 00000100:00100000:3.0:1788201625.402148:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559704192:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201625.402515:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559704192:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 366us (8988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201625.402524:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 564 00010000:00010000:0.0:1788201625.402658:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201625.494610:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201625.494740:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559704448 00000100:00100000:2.0:1788201625.494752:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559704448 00002000:00100000:2.0:1788201625.494812:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (832569344->833617919) req@ffff962485686680 x1875064559704448/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:746/0 lens 488/0 e 0 to 0 dl 1788201636 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201625.494825:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485686680 with x1875064559704448 ext(832569344->833617919) 00002000:00010000:2.0:1788201625.494832:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485686680 00000100:00100000:2.0:1788201625.494880:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 839 00000100:00100000:2.0:1788201625.494891:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559704448:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201625.522752:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559704448:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27850us (28141us total) trans 30064771840 rc 0/0 00000100:00100000:3.0:1788201625.522765:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 839 00002000:00100000:3.0:1788201625.522779:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (832569344->833617919) req@ffff962485686680 x1875064559704448/t30064771840(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:746/0 lens 488/448 e 0 to 0 dl 1788201636 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201625.522802:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485686680 with x1875064559704448 ext(832569344->833617919) 00002000:00010000:3.0:1788201625.522809:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485686680 00000100:00100000:0.0:1788201625.661926:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201625.662402:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559704576 00000100:00100000:1.0:1788201625.662413:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559704576 00002000:00100000:1.0:1788201625.662473:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (833617920->834666495) req@ffff962485686d80 x1875064559704576/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:746/0 lens 488/0 e 0 to 0 dl 1788201636 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201625.662487:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485686d80 with x1875064559704576 ext(833617920->834666495) 00002000:00010000:1.0:1788201625.662493:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485686d80 00000100:00100000:1.0:1788201625.662529:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 840 00000100:00100000:1.0:1788201625.662540:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559704576:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201625.687558:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559704576:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25005us (25627us total) trans 30064771841 rc 0/0 00000100:00100000:2.0:1788201625.687595:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 840 00002000:00100000:2.0:1788201625.687612:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (833617920->834666495) req@ffff962485686d80 x1875064559704576/t30064771841(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:746/0 lens 488/448 e 0 to 0 dl 1788201636 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201625.687624:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485686d80 with x1875064559704576 ext(833617920->834666495) 00002000:00010000:2.0:1788201625.687630:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485686d80 00000100:00100000:0.0:1788201625.922375:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201625.922575:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559704704 00000100:00100000:3.0:1788201625.922587:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559704704 00002000:00100000:3.0:1788201625.922654:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (834666496->835715071) req@ffff962485687100 x1875064559704704/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:746/0 lens 488/0 e 0 to 0 dl 1788201636 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201625.922665:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485687100 with x1875064559704704 ext(834666496->835715071) 00002000:00010000:3.0:1788201625.922672:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485687100 00000100:00100000:3.0:1788201625.922716:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 841 00000100:00100000:3.0:1788201625.922728:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559704704:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201625.962599:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559704704:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39859us (40249us total) trans 30064771842 rc 0/0 00000100:00100000:3.0:1788201625.962615:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 841 00002000:00100000:3.0:1788201625.962637:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (834666496->835715071) req@ffff962485687100 x1875064559704704/t30064771842(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:746/0 lens 488/448 e 0 to 0 dl 1788201636 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201625.962649:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485687100 with x1875064559704704 ext(834666496->835715071) 00002000:00010000:3.0:1788201625.962655:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485687100 00000100:00100000:2.0:1788201626.167122:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201626.167174:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570157440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201626.167261:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201626.167405:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570157440 00000100:00100000:3.0:1788201626.167415:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570157440 00000100:00100000:3.0:1788201626.167492:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788201626.167503:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570157440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201626.167539:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201626.167592:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570157440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201626.167614:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00010000:00080000:3.0:1788201626.167671:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962485681c00 x1875064570157440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201626.167693:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570157440:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201626.168218:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201626.222332:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201626.222648:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559704832 00000100:00100000:3.0:1788201626.222660:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559704832 00002000:00100000:3.0:1788201626.222717:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (835715072->836763647) req@ffff962485686300 x1875064559704832/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:747/0 lens 488/0 e 0 to 0 dl 1788201637 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201626.222729:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485686300 with x1875064559704832 ext(835715072->836763647) 00002000:00010000:3.0:1788201626.222735:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485686300 00000100:00100000:3.0:1788201626.222774:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 842 00000100:00100000:3.0:1788201626.222784:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559704832:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201626.278213:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559704832:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 55405us (55866us total) trans 30064771843 rc 0/0 00000100:00100000:3.0:1788201626.278229:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 842 00002000:00100000:3.0:1788201626.278244:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (835715072->836763647) req@ffff962485686300 x1875064559704832/t30064771843(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:747/0 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201626.278255:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485686300 with x1875064559704832 ext(835715072->836763647) 00002000:00010000:3.0:1788201626.278261:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485686300 00010000:00010000:1.0:1788201626.422571:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201626.585169:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201626.585292:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559704960 00000100:00100000:2.0:1788201626.585304:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559704960 00002000:00100000:2.0:1788201626.585397:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (836763648->837812223) req@ffff962485683100 x1875064559704960/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:747/0 lens 488/0 e 0 to 0 dl 1788201637 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201626.585408:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683100 with x1875064559704960 ext(836763648->837812223) 00002000:00010000:2.0:1788201626.585414:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683100 00000100:00100000:2.0:1788201626.585449:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 843 00000100:00100000:2.0:1788201626.585460:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559704960:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201626.605265:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559704960:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19796us (20096us total) trans 30064771844 rc 0/0 00000100:00100000:2.0:1788201626.607540:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 843 00002000:00100000:2.0:1788201626.607561:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (836763648->837812223) req@ffff962485683100 x1875064559704960/t30064771844(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:747/0 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201626.607573:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683100 with x1875064559704960 ext(836763648->837812223) 00002000:00010000:2.0:1788201626.607579:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683100 00000100:00100000:1.0:1788201626.679183:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570157568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201626.679308:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201626.679434:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570157696:0@lo:400:kworker.0 00000100:00100000:2.0:1788201626.679470:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201626.679532:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570157952:0@lo:400:kworker.0 00000100:00100000:0.0:1788201626.679563:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201626.679673:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570157824:0@lo:400:kworker.0 00000100:00100000:3.0:1788201626.679709:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201626.687204:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570157696 00000100:00100000:0.0:1788201626.687224:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570157696 00000100:00100000:0.0:1788201626.687353:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570157952 00000100:00100000:0.0:1788201626.687359:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570157952 00000100:00100000:0.0:1788201626.687398:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1788201626.687410:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570157696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201626.687503:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570157696:12345-0@lo:400:kworker.0 Request processed in 96us (8032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201626.687510:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1788201626.687525:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1788201626.687533:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570157952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201626.687566:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570157952:12345-0@lo:400:kworker.0 Request processed in 35us (8003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201626.687572:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00080000:0.0:1788201626.687591:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201626.687680:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570158080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201626.687724:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201626.689444:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570157952:0@lo:400:kworker.0 00000100:00100000:0.0:1788201626.689494:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570158080 00000100:00100000:0.0:1788201626.689501:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570158080 00000100:00100000:0.0:1788201626.689559:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1788201626.689567:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570158080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201626.689641:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875064570158080:12345-0@lo:400:kworker.0 Request processed in 75us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201626.689648:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00080000:0.0:1788201626.689667:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201626.689717:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570157568 00000100:00100000:0.0:1788201626.689721:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570157568 00000100:00100000:0.0:1788201626.689742:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1788201626.689747:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570157568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201626.689791:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570157568:12345-0@lo:400:kworker.0 Request processed in 44us (10484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201626.689797:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1788201626.690063:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570157824 00000100:00100000:0.0:1788201626.690068:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570157824 00000100:00100000:0.0:1788201626.690101:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788201626.690107:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570157824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201626.690150:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570157824:12345-0@lo:400:kworker.0 Request processed in 42us (10440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201626.690156:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:0.0:1788201626.690172:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201626.697553:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570157696:0@lo:400:kworker.0 00000100:00100000:3.0:1788201626.698923:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570157824:0@lo:400:kworker.0 00000100:00100000:1.0:1788201626.699792:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875064570158080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201626.699892:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570157568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201626.985412:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201626.985515:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559705088 00000100:00100000:3.0:1788201626.985527:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559705088 00002000:00100000:3.0:1788201626.985599:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (837812224->838860799) req@ffff9624c1c26680 x1875064559705088/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:747/0 lens 488/0 e 0 to 0 dl 1788201637 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201626.985611:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c26680 with x1875064559705088 ext(837812224->838860799) 00002000:00010000:3.0:1788201626.985627:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c26680 00000100:00100000:3.0:1788201626.985664:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 844 00000100:00100000:3.0:1788201626.985674:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559705088:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201627.019137:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559705088:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33445us (33715us total) trans 30064771845 rc 0/0 00000100:00100000:3.0:1788201627.019153:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 844 00002000:00100000:3.0:1788201627.019169:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (837812224->838860799) req@ffff9624c1c26680 x1875064559705088/t30064771845(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:747/0 lens 488/448 e 0 to 0 dl 1788201637 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201627.019180:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1c26680 with x1875064559705088 ext(837812224->838860799) 00002000:00010000:3.0:1788201627.019187:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1c26680 00010000:00010000:2.0:1788201627.447051:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201627.551991:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201627.552087:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559705216 00000100:00100000:3.0:1788201627.552098:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559705216 00002000:00100000:3.0:1788201627.552199:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (838860800->839909375) req@ffff96248c9c4000 x1875064559705216/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:748/0 lens 488/0 e 0 to 0 dl 1788201638 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201627.552211:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4000 with x1875064559705216 ext(838860800->839909375) 00002000:00010000:3.0:1788201627.552217:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4000 00000100:00100000:3.0:1788201627.552251:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 845 00000100:00100000:3.0:1788201627.552262:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559705216:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201627.553441:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201627.594451:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559705216:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 42178us (42458us total) trans 30064771846 rc 0/0 00000100:00100000:2.0:1788201627.594467:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 845 00002000:00100000:2.0:1788201627.594483:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (838860800->839909375) req@ffff96248c9c4000 x1875064559705216/t30064771846(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:748/0 lens 488/448 e 0 to 0 dl 1788201638 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201627.594495:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4000 with x1875064559705216 ext(838860800->839909375) 00002000:00010000:2.0:1788201627.594501:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4000 00000100:00100000:2.0:1788201627.957786:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201627.960449:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559705344 00000100:00100000:3.0:1788201627.960465:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559705344 00002000:00100000:3.0:1788201627.960529:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (839909376->840957951) req@ffff96248c9c4700 x1875064559705344/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:748/0 lens 488/0 e 0 to 0 dl 1788201638 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201627.960541:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4700 with x1875064559705344 ext(839909376->840957951) 00002000:00010000:3.0:1788201627.960547:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4700 00000100:00100000:3.0:1788201627.960594:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 846 00000100:00100000:3.0:1788201627.960604:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559705344:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201627.975947:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559705344:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15333us (18158us total) trans 30064771847 rc 0/0 00000100:00100000:3.0:1788201627.975962:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 846 00002000:00100000:3.0:1788201627.975976:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (839909376->840957951) req@ffff96248c9c4700 x1875064559705344/t30064771847(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:748/0 lens 488/448 e 0 to 0 dl 1788201638 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201627.975986:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4700 with x1875064559705344 ext(839909376->840957951) 00002000:00010000:3.0:1788201627.975990:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4700 00000100:00100000:0.0:1788201628.060747:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201628.061193:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559705472 00000100:00100000:2.0:1788201628.061205:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559705472 00002000:00100000:2.0:1788201628.061257:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (840957952->842006527) req@ffff962485685f80 x1875064559705472/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/0 e 0 to 0 dl 1788201639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201628.061267:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485685f80 with x1875064559705472 ext(840957952->842006527) 00002000:00010000:2.0:1788201628.061272:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485685f80 00000100:00100000:2.0:1788201628.061310:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 847 00000100:00100000:2.0:1788201628.061319:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559705472:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201628.084949:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559705472:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23614us (24195us total) trans 30064771848 rc 0/0 00000100:00100000:3.0:1788201628.084968:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 847 00002000:00100000:3.0:1788201628.084992:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (840957952->842006527) req@ffff962485685f80 x1875064559705472/t30064771848(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/448 e 0 to 0 dl 1788201639 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201628.085003:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485685f80 with x1875064559705472 ext(840957952->842006527) 00002000:00010000:3.0:1788201628.085010:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485685f80 00000100:00100000:1.0:1788201628.207944:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201628.208403:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559705600 00000100:00100000:3.0:1788201628.208431:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559705600 00002000:00100000:3.0:1788201628.208486:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (842006528->843055103) req@ffff962485683b80 x1875064559705600/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/0 e 0 to 0 dl 1788201639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201628.208498:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683b80 with x1875064559705600 ext(842006528->843055103) 00002000:00010000:3.0:1788201628.208504:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683b80 00000100:00100000:3.0:1788201628.208541:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 848 00000100:00100000:3.0:1788201628.208552:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559705600:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201628.231547:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559705600:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22985us (23601us total) trans 30064771849 rc 0/0 00000100:00100000:3.0:1788201628.231574:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 848 00002000:00100000:3.0:1788201628.231588:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (842006528->843055103) req@ffff962485683b80 x1875064559705600/t30064771849(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/448 e 0 to 0 dl 1788201639 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201628.231600:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683b80 with x1875064559705600 ext(842006528->843055103) 00002000:00010000:3.0:1788201628.231607:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683b80 00000100:00100000:2.0:1788201628.331986:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201628.333329:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559705728 00000100:00100000:0.0:1788201628.333353:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559705728 00002000:00100000:0.0:1788201628.333423:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (843055104->844103679) req@ffff96248c9c7100 x1875064559705728/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/0 e 0 to 0 dl 1788201639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201628.333433:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c7100 with x1875064559705728 ext(843055104->844103679) 00002000:00010000:0.0:1788201628.333439:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c7100 00000100:00100000:0.0:1788201628.333470:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 849 00000100:00100000:0.0:1788201628.333478:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559705728:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201628.344478:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559705728:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10988us (12493us total) trans 30064771850 rc 0/0 00000100:00100000:2.0:1788201628.344502:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 849 00002000:00100000:2.0:1788201628.344515:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (843055104->844103679) req@ffff96248c9c7100 x1875064559705728/t30064771850(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/448 e 0 to 0 dl 1788201639 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201628.344525:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c7100 with x1875064559705728 ext(843055104->844103679) 00002000:00010000:2.0:1788201628.344531:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c7100 00000100:00100000:1.0:1788201628.411385:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201628.411454:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559705856 00000100:00100000:2.0:1788201628.411466:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559705856 00002000:00100000:2.0:1788201628.411517:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (844103680->845152255) req@ffff962485681880 x1875064559705856/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/0 e 0 to 0 dl 1788201639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201628.411527:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681880 with x1875064559705856 ext(844103680->845152255) 00002000:00010000:2.0:1788201628.411532:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681880 00000100:00100000:2.0:1788201628.411563:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 850 00000100:00100000:2.0:1788201628.411572:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559705856:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201628.424442:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559705856:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12859us (13053us total) trans 30064771851 rc 0/0 00000100:00100000:2.0:1788201628.424457:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 850 00002000:00100000:2.0:1788201628.424472:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (844103680->845152255) req@ffff962485681880 x1875064559705856/t30064771851(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/448 e 0 to 0 dl 1788201639 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201628.424482:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681880 with x1875064559705856 ext(844103680->845152255) 00002000:00010000:2.0:1788201628.424487:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681880 00010000:00010000:0.0:1788201628.470629:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201628.492586:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201628.492709:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559705984 00000100:00100000:3.0:1788201628.492721:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559705984 00002000:00100000:3.0:1788201628.492775:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (845152256->846200831) req@ffff962485682a00 x1875064559705984/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/0 e 0 to 0 dl 1788201639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201628.492787:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485682a00 with x1875064559705984 ext(845152256->846200831) 00002000:00010000:3.0:1788201628.492792:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485682a00 00000100:00100000:3.0:1788201628.492830:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 851 00000100:00100000:3.0:1788201628.492841:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559705984:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201628.507177:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559705984:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14325us (14588us total) trans 30064771852 rc 0/0 00000100:00100000:3.0:1788201628.507211:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 851 00002000:00100000:3.0:1788201628.507225:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (845152256->846200831) req@ffff962485682a00 x1875064559705984/t30064771852(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/448 e 0 to 0 dl 1788201639 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201628.507235:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485682a00 with x1875064559705984 ext(845152256->846200831) 00002000:00010000:3.0:1788201628.507241:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485682a00 00000100:00100000:0.0:1788201628.560330:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201628.561176:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559706112 00000100:00100000:1.0:1788201628.561187:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559706112 00002000:00100000:1.0:1788201628.561236:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (846200832->847249407) req@ffff962485684700 x1875064559706112/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/0 e 0 to 0 dl 1788201639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201628.561258:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684700 with x1875064559706112 ext(846200832->847249407) 00002000:00010000:1.0:1788201628.561264:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684700 00000100:00100000:1.0:1788201628.561289:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 852 00000100:00100000:1.0:1788201628.561296:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559706112:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201628.568883:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559706112:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 7574us (8554us total) trans 30064771853 rc 0/0 00000100:00100000:3.0:1788201628.568905:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 852 00002000:00100000:3.0:1788201628.568918:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (846200832->847249407) req@ffff962485684700 x1875064559706112/t30064771853(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/448 e 0 to 0 dl 1788201639 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201628.568930:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485684700 with x1875064559706112 ext(846200832->847249407) 00002000:00010000:3.0:1788201628.568937:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485684700 00000100:00100000:0.0:1788201628.661827:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201628.662126:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559706240 00000100:00100000:2.0:1788201628.662137:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559706240 00002000:00100000:2.0:1788201628.662190:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (847249408->848297983) req@ffff9624bfd2f800 x1875064559706240/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/0 e 0 to 0 dl 1788201639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201628.662212:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2f800 with x1875064559706240 ext(847249408->848297983) 00002000:00010000:2.0:1788201628.662218:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2f800 00000100:00100000:2.0:1788201628.662250:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 853 00000100:00100000:2.0:1788201628.662259:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559706240:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201628.680214:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559706240:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17939us (18380us total) trans 30064771854 rc 0/0 00000100:00100000:3.0:1788201628.680232:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 853 00002000:00100000:3.0:1788201628.680248:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (847249408->848297983) req@ffff9624bfd2f800 x1875064559706240/t30064771854(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/448 e 0 to 0 dl 1788201639 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201628.680260:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2f800 with x1875064559706240 ext(847249408->848297983) 00002000:00010000:3.0:1788201628.680268:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2f800 00000100:00100000:1.0:1788201628.726957:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201628.727077:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570158208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201628.727196:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201628.727386:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570158208 00000100:00100000:3.0:1788201628.727398:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570158208 00000100:00100000:3.0:1788201628.727526:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788201628.727539:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570158208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201628.727599:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 562233344 pending 34078720 free 3032481792 avail 3030384640 00000100:00100000:3.0:1788201628.727794:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570158208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201628.727803:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788201628.727946:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570158208:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201628.727999:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201628.732858:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201628.735933:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559706368 00000100:00100000:2.0:1788201628.735951:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559706368 00002000:00100000:2.0:1788201628.736015:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (848297984->849346559) req@ffff962485680700 x1875064559706368/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/0 e 0 to 0 dl 1788201639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201628.736026:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485680700 with x1875064559706368 ext(848297984->849346559) 00002000:00010000:2.0:1788201628.736032:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485680700 00000100:00100000:2.0:1788201628.736070:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 854 00000100:00100000:2.0:1788201628.736081:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559706368:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201628.747726:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559706368:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11635us (14875us total) trans 30064771855 rc 0/0 00000100:00100000:2.0:1788201628.747740:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 854 00002000:00100000:2.0:1788201628.747756:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (848297984->849346559) req@ffff962485680700 x1875064559706368/t30064771855(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/448 e 0 to 0 dl 1788201639 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201628.747767:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485680700 with x1875064559706368 ext(848297984->849346559) 00002000:00010000:2.0:1788201628.747773:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485680700 00000100:00100000:3.0:1788201628.790197:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201628.790307:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559706496 00000100:00100000:2.0:1788201628.790319:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559706496 00002000:00100000:2.0:1788201628.790391:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (849346560->850395135) req@ffff962382b15500 x1875064559706496/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/0 e 0 to 0 dl 1788201639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201628.790419:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15500 with x1875064559706496 ext(849346560->850395135) 00002000:00010000:2.0:1788201628.790424:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15500 00000100:00100000:2.0:1788201628.790456:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 855 00000100:00100000:2.0:1788201628.790464:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2341:x1875064559706496:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201628.799050:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2341:x1875064559706496:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8573us (8850us total) trans 30064771856 rc 0/0 00000100:00100000:2.0:1788201628.799063:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 855 00002000:00100000:2.0:1788201628.799075:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (849346560->850395135) req@ffff962382b15500 x1875064559706496/t30064771856(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/448 e 0 to 0 dl 1788201639 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201628.799085:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15500 with x1875064559706496 ext(849346560->850395135) 00002000:00010000:2.0:1788201628.799091:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15500 00000100:00100000:3.0:1788201628.874769:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201628.874878:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559706624 00000100:00100000:1.0:1788201628.874889:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559706624 00002000:00100000:1.0:1788201628.874941:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (850395136->851443711) req@ffff962382b17480 x1875064559706624/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/0 e 0 to 0 dl 1788201639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201628.874953:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17480 with x1875064559706624 ext(850395136->851443711) 00002000:00010000:1.0:1788201628.874959:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17480 00000100:00100000:1.0:1788201628.874997:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 856 00000100:00100000:1.0:1788201628.875008:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559706624:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201628.888428:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559706624:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13406us (13653us total) trans 30064771857 rc 0/0 00000100:00100000:3.0:1788201628.888445:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 856 00002000:00100000:3.0:1788201628.888461:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (850395136->851443711) req@ffff962382b17480 x1875064559706624/t30064771857(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:749/0 lens 488/448 e 0 to 0 dl 1788201639 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201628.888472:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17480 with x1875064559706624 ext(850395136->851443711) 00002000:00010000:3.0:1788201628.888481:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17480 00000100:00100000:0.0:1788201629.017922:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201629.018010:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559706752 00000100:00100000:3.0:1788201629.018022:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559706752 00002000:00100000:3.0:1788201629.018112:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (851443712->852492287) req@ffff9624bfd2d880 x1875064559706752/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:750/0 lens 488/0 e 0 to 0 dl 1788201640 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201629.018124:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2d880 with x1875064559706752 ext(851443712->852492287) 00000100:00080000:0.0:1788201629.018129:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1788201629.018130:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2d880 00000100:00100000:3.0:1788201629.018170:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 857 00000100:00100000:3.0:1788201629.018182:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559706752:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201629.029976:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559706752:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11787us (12052us total) trans 30064771858 rc 0/0 00000100:00100000:2.0:1788201629.029992:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 857 00002000:00100000:2.0:1788201629.030007:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (851443712->852492287) req@ffff9624bfd2d880 x1875064559706752/t30064771858(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:750/0 lens 488/448 e 0 to 0 dl 1788201640 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201629.030019:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2d880 with x1875064559706752 ext(851443712->852492287) 00002000:00010000:2.0:1788201629.030025:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2d880 00000100:00100000:3.0:1788201629.306787:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201629.306907:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559706880 00000100:00100000:2.0:1788201629.306918:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559706880 00002000:00100000:2.0:1788201629.306970:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (852492288->853540863) req@ffff962382b14000 x1875064559706880/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:750/0 lens 488/0 e 0 to 0 dl 1788201640 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201629.306995:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14000 with x1875064559706880 ext(852492288->853540863) 00002000:00010000:2.0:1788201629.307001:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14000 00000100:00100000:2.0:1788201629.307034:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 858 00000100:00100000:2.0:1788201629.307044:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2342:x1875064559706880:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201629.323219:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559706880:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16162us (16427us total) trans 30064771859 rc 0/0 00000100:00100000:2.0:1788201629.323234:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 858 00002000:00100000:2.0:1788201629.323248:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (852492288->853540863) req@ffff962382b14000 x1875064559706880/t30064771859(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:750/0 lens 488/448 e 0 to 0 dl 1788201640 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201629.323259:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14000 with x1875064559706880 ext(852492288->853540863) 00002000:00010000:2.0:1788201629.323266:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14000 00000001:00080000:0.0:1788201629.324834:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771837 is committed 00000001:00080000:0.0:1788201629.324854:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771858 is committed 00000100:00100000:2.0:1788201629.447286:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201629.447358:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559707008 00000100:00100000:3.0:1788201629.447368:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559707008 00002000:00100000:3.0:1788201629.447425:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (853540864->854589439) req@ffff96248c9c6a00 x1875064559707008/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:750/0 lens 488/0 e 0 to 0 dl 1788201640 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201629.447433:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c6a00 with x1875064559707008 ext(853540864->854589439) 00002000:00010000:3.0:1788201629.447518:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c6a00 00000100:00100000:3.0:1788201629.447545:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 859 00000100:00100000:3.0:1788201629.447556:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559707008:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201629.453211:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559707008:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 5645us (5920us total) trans 30064771860 rc 0/0 00000100:00100000:0.0:1788201629.453226:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 859 00002000:00100000:0.0:1788201629.453238:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (853540864->854589439) req@ffff96248c9c6a00 x1875064559707008/t30064771860(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:750/0 lens 488/448 e 0 to 0 dl 1788201640 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201629.453249:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c6a00 with x1875064559707008 ext(853540864->854589439) 00002000:00010000:0.0:1788201629.453255:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c6a00 00010000:00010000:1.0:1788201629.494542:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201629.568518:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201629.571442:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559707136 00000100:00100000:2.0:1788201629.571458:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559707136 00002000:00100000:2.0:1788201629.571523:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (854589440->855638015) req@ffff962382b14e00 x1875064559707136/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:750/0 lens 488/0 e 0 to 0 dl 1788201640 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201629.571535:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14e00 with x1875064559707136 ext(854589440->855638015) 00002000:00010000:2.0:1788201629.571541:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14e00 00000100:00100000:2.0:1788201629.571661:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 860 00000100:00100000:2.0:1788201629.571672:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559707136:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201629.609653:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559707136:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37970us (41134us total) trans 30064771861 rc 0/0 00000100:00100000:2.0:1788201629.609688:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 860 00002000:00100000:2.0:1788201629.609703:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (854589440->855638015) req@ffff962382b14e00 x1875064559707136/t30064771861(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:750/0 lens 488/448 e 0 to 0 dl 1788201640 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201629.609714:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14e00 with x1875064559707136 ext(854589440->855638015) 00002000:00010000:2.0:1788201629.609721:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14e00 00000100:00100000:3.0:1788201629.812638:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201629.815160:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559707264 00000100:00100000:2.0:1788201629.815175:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559707264 00002000:00100000:2.0:1788201629.815235:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (855638016->856686591) req@ffff962382b16d80 x1875064559707264/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:750/0 lens 488/0 e 0 to 0 dl 1788201640 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201629.815246:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b16d80 with x1875064559707264 ext(855638016->856686591) 00002000:00010000:2.0:1788201629.815251:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b16d80 00000100:00100000:2.0:1788201629.815289:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 861 00000100:00100000:2.0:1788201629.815299:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559707264:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201629.836290:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559707264:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20978us (23649us total) trans 30064771862 rc 0/0 00000100:00100000:2.0:1788201629.836306:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 861 00002000:00100000:2.0:1788201629.836323:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (855638016->856686591) req@ffff962382b16d80 x1875064559707264/t30064771862(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:750/0 lens 488/448 e 0 to 0 dl 1788201640 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201629.836335:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b16d80 with x1875064559707264 ext(855638016->856686591) 00002000:00010000:2.0:1788201629.836356:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b16d80 00000100:00100000:3.0:1788201629.966943:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201629.970386:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559707392 00000100:00100000:0.0:1788201629.970412:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559707392 00002000:00100000:0.0:1788201629.970490:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (856686592->857735167) req@ffff962382b15c00 x1875064559707392/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:750/0 lens 488/0 e 0 to 0 dl 1788201640 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201629.970502:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15c00 with x1875064559707392 ext(856686592->857735167) 00002000:00010000:0.0:1788201629.970508:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15c00 00000100:00100000:0.0:1788201629.970544:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 862 00000100:00100000:0.0:1788201629.970554:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559707392:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201629.981809:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559707392:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11244us (14867us total) trans 30064771863 rc 0/0 00000100:00100000:0.0:1788201629.981824:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 862 00002000:00100000:0.0:1788201629.981837:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (856686592->857735167) req@ffff962382b15c00 x1875064559707392/t30064771863(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:750/0 lens 488/448 e 0 to 0 dl 1788201640 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201629.981849:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15c00 with x1875064559707392 ext(856686592->857735167) 00002000:00010000:0.0:1788201629.981865:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15c00 00000100:00100000:3.0:1788201630.043578:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201630.043672:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559707520 00000100:00100000:0.0:1788201630.043684:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559707520 00002000:00100000:0.0:1788201630.043736:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (857735168->858783743) req@ffff962382b17100 x1875064559707520/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:751/0 lens 488/0 e 0 to 0 dl 1788201641 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201630.043747:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17100 with x1875064559707520 ext(857735168->858783743) 00002000:00010000:0.0:1788201630.043753:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17100 00000100:00100000:0.0:1788201630.043827:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 863 00000100:00100000:0.0:1788201630.043838:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559707520:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201630.056507:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559707520:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12656us (12924us total) trans 30064771864 rc 0/0 00000100:00100000:0.0:1788201630.056524:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 863 00002000:00100000:0.0:1788201630.056540:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (857735168->858783743) req@ffff962382b17100 x1875064559707520/t30064771864(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:751/0 lens 488/448 e 0 to 0 dl 1788201641 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201630.056551:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17100 with x1875064559707520 ext(857735168->858783743) 00002000:00010000:0.0:1788201630.056567:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17100 00000100:00100000:3.0:1788201630.112958:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201630.113320:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559707648 00000100:00100000:2.0:1788201630.113332:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559707648 00002000:00100000:2.0:1788201630.113422:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (858783744->859832319) req@ffff962382b16300 x1875064559707648/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:751/0 lens 488/0 e 0 to 0 dl 1788201641 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201630.113446:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b16300 with x1875064559707648 ext(858783744->859832319) 00002000:00010000:2.0:1788201630.113452:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b16300 00000100:00100000:2.0:1788201630.113480:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 864 00000100:00100000:2.0:1788201630.113490:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559707648:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201630.131160:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559707648:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17659us (18198us total) trans 30064771865 rc 0/0 00000100:00100000:2.0:1788201630.131176:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 864 00002000:00100000:2.0:1788201630.131191:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (858783744->859832319) req@ffff962382b16300 x1875064559707648/t30064771865(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:751/0 lens 488/448 e 0 to 0 dl 1788201641 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201630.131202:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b16300 with x1875064559707648 ext(858783744->859832319) 00002000:00010000:2.0:1788201630.131208:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b16300 00000100:00100000:1.0:1788201630.244746:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201630.244852:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559707776 00000100:00100000:2.0:1788201630.244873:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559707776 00002000:00100000:2.0:1788201630.244928:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (859832320->860880895) req@ffff962485681500 x1875064559707776/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:751/0 lens 488/0 e 0 to 0 dl 1788201641 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201630.244940:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681500 with x1875064559707776 ext(859832320->860880895) 00002000:00010000:2.0:1788201630.244946:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681500 00000100:00100000:2.0:1788201630.244982:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 865 00000100:00100000:2.0:1788201630.244992:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559707776:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201630.263953:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559707776:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18947us (19203us total) trans 30064771866 rc 0/0 00000100:00100000:0.0:1788201630.263970:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 865 00002000:00100000:0.0:1788201630.263987:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (859832320->860880895) req@ffff962485681500 x1875064559707776/t30064771866(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:751/0 lens 488/448 e 0 to 0 dl 1788201641 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201630.263997:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681500 with x1875064559707776 ext(859832320->860880895) 00002000:00010000:0.0:1788201630.264004:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681500 00010000:00010000:2.0:1788201630.518684:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201630.519364:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201630.519426:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201630.519570:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559708032 00000100:00100000:0.0:1788201630.519595:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559708032 00000100:00100000:0.0:1788201630.519683:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 447 00000100:00100000:0.0:1788201630.519695:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559708032:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201630.519780:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559708032:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 87us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201630.519787:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 447 00000100:00080000:2.0:1788201630.519870:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201630.520023:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559707904 00000100:00100000:1.0:1788201630.520028:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559707904 00000100:00100000:1.0:1788201630.520093:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 566 00000100:00100000:1.0:1788201630.520102:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559707904:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201630.520143:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559707904:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 42us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201630.520150:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 566 00000100:00100000:2.0:1788201630.538029:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201630.548145:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559708160 00000100:00100000:0.0:1788201630.548164:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559708160 00002000:00100000:0.0:1788201630.548232:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (860880896->861929471) req@ffff96248c9c4a80 x1875064559708160/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:751/0 lens 488/0 e 0 to 0 dl 1788201641 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201630.548243:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4a80 with x1875064559708160 ext(860880896->861929471) 00002000:00010000:0.0:1788201630.548249:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4a80 00000100:00100000:0.0:1788201630.548289:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 866 00000100:00100000:0.0:1788201630.548300:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559708160:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201630.567276:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559708160:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18966us (29248us total) trans 30064771867 rc 0/0 00000100:00100000:0.0:1788201630.567290:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 866 00002000:00100000:0.0:1788201630.567303:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (860880896->861929471) req@ffff96248c9c4a80 x1875064559708160/t30064771867(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:751/0 lens 488/448 e 0 to 0 dl 1788201641 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201630.567314:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4a80 with x1875064559708160 ext(860880896->861929471) 00002000:00010000:0.0:1788201630.567320:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4a80 00000100:00100000:2.0:1788201630.841996:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201630.842501:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559708288 00000100:00100000:0.0:1788201630.842513:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559708288 00002000:00100000:0.0:1788201630.842570:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (861929472->862978047) req@ffff96248c9c4e00 x1875064559708288/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:751/0 lens 488/0 e 0 to 0 dl 1788201641 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201630.842594:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4e00 with x1875064559708288 ext(861929472->862978047) 00002000:00010000:0.0:1788201630.842600:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4e00 00000100:00100000:0.0:1788201630.842644:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 867 00000100:00100000:0.0:1788201630.842654:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559708288:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201630.881584:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559708288:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 38921us (39588us total) trans 30064771868 rc 0/0 00000100:00100000:0.0:1788201630.881597:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 867 00002000:00100000:0.0:1788201630.881609:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (861929472->862978047) req@ffff96248c9c4e00 x1875064559708288/t30064771868(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:751/0 lens 488/448 e 0 to 0 dl 1788201641 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201630.881620:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4e00 with x1875064559708288 ext(861929472->862978047) 00002000:00010000:0.0:1788201630.881626:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4e00 00000100:00100000:2.0:1788201631.064633:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201631.064737:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559708416 00000100:00100000:3.0:1788201631.064749:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559708416 00002000:00100000:3.0:1788201631.064856:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (862978048->864026623) req@ffff9624c1cc5f80 x1875064559708416/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:752/0 lens 488/0 e 0 to 0 dl 1788201642 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201631.064869:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5f80 with x1875064559708416 ext(862978048->864026623) 00002000:00010000:3.0:1788201631.064873:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5f80 00000100:00100000:3.0:1788201631.064907:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 868 00000100:00100000:3.0:1788201631.064917:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559708416:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201631.078773:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559708416:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13845us (14138us total) trans 30064771869 rc 0/0 00000100:00100000:0.0:1788201631.078788:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 868 00002000:00100000:0.0:1788201631.078802:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (862978048->864026623) req@ffff9624c1cc5f80 x1875064559708416/t30064771869(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:752/0 lens 488/448 e 0 to 0 dl 1788201642 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201631.078813:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5f80 with x1875064559708416 ext(862978048->864026623) 00002000:00010000:0.0:1788201631.078819:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5f80 00000100:00080000:2.0:1788201631.080728:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201631.286601:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570158336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201631.286683:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201631.286819:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570158336 00000100:00100000:1.0:1788201631.286828:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570158336 00000100:00100000:1.0:1788201631.286899:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788201631.286911:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570158336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201631.286951:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201631.287010:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570158336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201631.287018:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00080000:3.0:1788201631.287066:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962382b15880 x1875064570158336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201631.287088:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570158336:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201631.287099:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201631.355822:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201631.355932:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559708544 00000100:00100000:2.0:1788201631.355946:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559708544 00002000:00100000:2.0:1788201631.355999:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (864026624->865075199) req@ffff962485683800 x1875064559708544/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:752/0 lens 488/0 e 0 to 0 dl 1788201642 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201631.356010:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683800 with x1875064559708544 ext(864026624->865075199) 00002000:00010000:2.0:1788201631.356016:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683800 00000100:00100000:2.0:1788201631.356072:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 869 00000100:00100000:2.0:1788201631.356083:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559708544:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201631.385846:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559708544:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29748us (30018us total) trans 30064771870 rc 0/0 00000100:00100000:3.0:1788201631.385861:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 869 00002000:00100000:3.0:1788201631.385875:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (864026624->865075199) req@ffff962485683800 x1875064559708544/t30064771870(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:752/0 lens 488/448 e 0 to 0 dl 1788201642 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201631.385893:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683800 with x1875064559708544 ext(864026624->865075199) 00002000:00010000:3.0:1788201631.385899:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683800 00010000:00010000:0.0:1788201631.542897:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201631.587278:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201631.593554:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559708672 00000100:00100000:0.0:1788201631.593574:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559708672 00002000:00100000:0.0:1788201631.593645:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (865075200->866123775) req@ffff962382b15880 x1875064559708672/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:752/0 lens 488/0 e 0 to 0 dl 1788201642 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201631.593657:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15880 with x1875064559708672 ext(865075200->866123775) 00002000:00010000:0.0:1788201631.593663:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15880 00000100:00100000:0.0:1788201631.593710:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 870 00000100:00100000:0.0:1788201631.593721:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559708672:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201631.639947:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559708672:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 46216us (52668us total) trans 30064771871 rc 0/0 00000100:00100000:0.0:1788201631.639962:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 870 00002000:00100000:0.0:1788201631.639977:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (865075200->866123775) req@ffff962382b15880 x1875064559708672/t30064771871(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:752/0 lens 488/448 e 0 to 0 dl 1788201642 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201631.639995:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15880 with x1875064559708672 ext(865075200->866123775) 00002000:00010000:0.0:1788201631.640003:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15880 00000100:00100000:2.0:1788201631.790281:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201631.792692:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559708800 00000100:00100000:0.0:1788201631.792713:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559708800 00002000:00100000:0.0:1788201631.792782:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (866123776->867172351) req@ffff9624c1cc7800 x1875064559708800/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:752/0 lens 488/0 e 0 to 0 dl 1788201642 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201631.792794:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc7800 with x1875064559708800 ext(866123776->867172351) 00002000:00010000:0.0:1788201631.792800:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc7800 00000100:00100000:0.0:1788201631.792842:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 871 00000100:00100000:0.0:1788201631.792862:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559708800:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201631.798709:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570158592:0@lo:400:kworker.0 00000100:00100000:3.0:1788201631.798782:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201631.798855:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201631.798861:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570158720:0@lo:400:kworker.0 00000100:00100000:3.0:1788201631.798886:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201631.799033:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570158592 00000100:00100000:3.0:1788201631.799043:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570158592 00000100:00100000:3.0:1788201631.799103:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1788201631.799112:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570158592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201631.799165:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875064570158592:12345-0@lo:400:kworker.0 Request processed in 54us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201631.799172:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1788201631.799197:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570158720 00000100:00100000:3.0:1788201631.799201:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570158720 00000100:00100000:3.0:1788201631.799236:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788201631.799242:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570158720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201631.799273:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570158720:12345-0@lo:400:kworker.0 Request processed in 31us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201631.799294:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:3.0:1788201631.799313:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201631.799368:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570158720:0@lo:400:kworker.0 00000100:00100000:3.0:1788201631.799380:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875064570158592:0@lo:400:kworker.0 00000100:00100000:1.0:1788201631.799527:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570158848:0@lo:400:kworker.0 00000100:00100000:1.0:1788201631.799559:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201631.799587:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201631.799594:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570158464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201631.799626:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201631.799646:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570158976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201631.799665:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201631.801039:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570158848 00000100:00100000:3.0:1788201631.801062:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570158848 00000100:00100000:3.0:1788201631.801123:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570158976 00000100:00100000:3.0:1788201631.801126:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570158976 00000100:00100000:3.0:1788201631.801151:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1788201631.801160:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570158848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201631.801235:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875064570158848:12345-0@lo:400:kworker.0 Request processed in 77us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201631.801241:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1788201631.801257:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1788201631.801263:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570158976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201631.801289:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570158976:12345-0@lo:400:kworker.0 Request processed in 27us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201631.801295:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1788201631.801360:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570158976:0@lo:400:kworker.0 00000100:00100000:3.0:1788201631.801374:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875064570158848:0@lo:400:kworker.0 00000100:00100000:0.0:1788201631.802546:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570158464 00000100:00100000:0.0:1788201631.802570:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570158464 00000100:00100000:0.0:1788201631.802623:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00080000:2.0:1788201631.802631:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201631.802633:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570158464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201631.802706:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570158464:12345-0@lo:400:kworker.0 Request processed in 76us (3079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201631.802713:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1788201631.802742:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570158464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201631.824405:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559708800:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31531us (34119us total) trans 30064771872 rc 0/0 00000100:00100000:0.0:1788201631.824421:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 871 00002000:00100000:0.0:1788201631.824438:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (866123776->867172351) req@ffff9624c1cc7800 x1875064559708800/t30064771872(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:752/0 lens 488/448 e 0 to 0 dl 1788201642 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201631.824681:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc7800 with x1875064559708800 ext(866123776->867172351) 00002000:00010000:0.0:1788201631.824690:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc7800 00000100:00100000:1.0:1788201631.923937:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201631.924041:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559708928 00000100:00100000:3.0:1788201631.937071:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559708928 00002000:00100000:2.0:1788201631.942262:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (867172352->868220927) req@ffff962485682d80 x1875064559708928/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:752/0 lens 488/0 e 0 to 0 dl 1788201642 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201631.942278:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485682d80 with x1875064559708928 ext(867172352->868220927) 00002000:00010000:2.0:1788201631.942286:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485682d80 00000100:00100000:2.0:1788201631.942336:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 872 00000100:00100000:2.0:1788201631.942377:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559708928:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201631.973584:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559708928:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31199us (49643us total) trans 30064771873 rc 0/0 00000100:00100000:2.0:1788201631.973598:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 872 00002000:00100000:2.0:1788201631.973612:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (867172352->868220927) req@ffff962485682d80 x1875064559708928/t30064771873(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:752/0 lens 488/448 e 0 to 0 dl 1788201642 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201631.973622:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485682d80 with x1875064559708928 ext(867172352->868220927) 00002000:00010000:2.0:1788201631.973643:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485682d80 00000100:00100000:3.0:1788201632.184263:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201632.184387:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559709056 00000100:00100000:0.0:1788201632.184398:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559709056 00002000:00100000:0.0:1788201632.184448:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (868220928->869269503) req@ffff962485aaf480 x1875064559709056/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/0 e 0 to 0 dl 1788201643 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201632.184460:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaf480 with x1875064559709056 ext(868220928->869269503) 00002000:00010000:0.0:1788201632.184466:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaf480 00000100:00100000:0.0:1788201632.184497:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 873 00000100:00100000:0.0:1788201632.184507:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559709056:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201632.221171:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559709056:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36653us (36906us total) trans 30064771874 rc 0/0 00000100:00100000:0.0:1788201632.221185:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 873 00002000:00100000:0.0:1788201632.221213:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (868220928->869269503) req@ffff962485aaf480 x1875064559709056/t30064771874(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/448 e 0 to 0 dl 1788201643 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201632.221225:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaf480 with x1875064559709056 ext(868220928->869269503) 00002000:00010000:0.0:1788201632.221231:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaf480 00000100:00100000:3.0:1788201632.288664:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201632.288769:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559709184 00000100:00100000:0.0:1788201632.288778:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559709184 00002000:00100000:0.0:1788201632.288836:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (869269504->870318079) req@ffff962485aac000 x1875064559709184/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/0 e 0 to 0 dl 1788201643 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201632.288848:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aac000 with x1875064559709184 ext(869269504->870318079) 00002000:00010000:0.0:1788201632.288853:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aac000 00000100:00100000:0.0:1788201632.288883:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 874 00000100:00100000:0.0:1788201632.288893:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559709184:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201632.302881:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2342:x1875064559709184:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13979us (14228us total) trans 30064771875 rc 0/0 00000100:00100000:3.0:1788201632.302910:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 874 00002000:00100000:3.0:1788201632.302922:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (869269504->870318079) req@ffff962485aac000 x1875064559709184/t30064771875(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/448 e 0 to 0 dl 1788201643 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201632.302933:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aac000 with x1875064559709184 ext(869269504->870318079) 00002000:00010000:3.0:1788201632.302939:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aac000 00000100:00100000:2.0:1788201632.388620:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201632.388819:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559709312 00000100:00100000:3.0:1788201632.388840:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559709312 00002000:00100000:3.0:1788201632.388889:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (870318080->871366655) req@ffff9624c1cc4a80 x1875064559709312/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/0 e 0 to 0 dl 1788201643 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201632.388901:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4a80 with x1875064559709312 ext(870318080->871366655) 00002000:00010000:3.0:1788201632.388906:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4a80 00000100:00100000:3.0:1788201632.388939:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 875 00000100:00100000:3.0:1788201632.388949:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559709312:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201632.403656:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559709312:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14683us (15022us total) trans 30064771876 rc 0/0 00000100:00100000:3.0:1788201632.403671:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 875 00002000:00100000:3.0:1788201632.403684:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (870318080->871366655) req@ffff9624c1cc4a80 x1875064559709312/t30064771876(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/448 e 0 to 0 dl 1788201643 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201632.403695:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4a80 with x1875064559709312 ext(870318080->871366655) 00002000:00010000:3.0:1788201632.403701:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4a80 00000100:00100000:1.0:1788201632.519181:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201632.527299:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559709440 00000100:00100000:2.0:1788201632.527317:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559709440 00002000:00100000:2.0:1788201632.527424:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (871366656->872415231) req@ffff962485681c00 x1875064559709440/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/0 e 0 to 0 dl 1788201643 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201632.527436:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681c00 with x1875064559709440 ext(871366656->872415231) 00002000:00010000:2.0:1788201632.527442:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681c00 00000100:00100000:2.0:1788201632.527610:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 876 00000100:00100000:2.0:1788201632.527621:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559709440:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201632.559542:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559709440:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31912us (40363us total) trans 30064771877 rc 0/0 00000100:00100000:2.0:1788201632.559557:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 876 00002000:00100000:2.0:1788201632.559571:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (871366656->872415231) req@ffff962485681c00 x1875064559709440/t30064771877(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/448 e 0 to 0 dl 1788201643 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201632.559582:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681c00 with x1875064559709440 ext(871366656->872415231) 00002000:00010000:2.0:1788201632.559589:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681c00 00010000:00010000:2.0:1788201632.567639:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201632.636506:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201632.636683:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559709568 00000100:00100000:0.0:1788201632.636695:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559709568 00002000:00100000:0.0:1788201632.636760:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (872415232->873463807) req@ffff9624b9d25880 x1875064559709568/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/0 e 0 to 0 dl 1788201643 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201632.636772:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25880 with x1875064559709568 ext(872415232->873463807) 00002000:00010000:0.0:1788201632.636778:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25880 00000100:00100000:0.0:1788201632.636857:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 877 00000100:00100000:0.0:1788201632.636867:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559709568:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201632.647002:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559709568:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10125us (10495us total) trans 30064771878 rc 0/0 00000100:00100000:0.0:1788201632.647014:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 877 00002000:00100000:0.0:1788201632.647025:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (872415232->873463807) req@ffff9624b9d25880 x1875064559709568/t30064771878(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/448 e 0 to 0 dl 1788201643 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201632.647107:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25880 with x1875064559709568 ext(872415232->873463807) 00002000:00010000:0.0:1788201632.647115:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25880 00000100:00100000:1.0:1788201632.793738:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201632.794003:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559709696 00000100:00100000:3.0:1788201632.794020:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559709696 00002000:00100000:3.0:1788201632.794106:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (873463808->874512383) req@ffff9624b9f68380 x1875064559709696/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/0 e 0 to 0 dl 1788201643 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201632.794136:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68380 with x1875064559709696 ext(873463808->874512383) 00002000:00010000:3.0:1788201632.794144:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68380 00000100:00100000:2.0:1788201632.794415:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 878 00000100:00100000:2.0:1788201632.794432:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559709696:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201632.808940:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559709696:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14497us (15196us total) trans 30064771879 rc 0/0 00000100:00100000:2.0:1788201632.808959:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 878 00002000:00100000:2.0:1788201632.808976:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (873463808->874512383) req@ffff9624b9f68380 x1875064559709696/t30064771879(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/448 e 0 to 0 dl 1788201643 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201632.809006:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68380 with x1875064559709696 ext(873463808->874512383) 00002000:00010000:2.0:1788201632.809014:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68380 00000100:00100000:3.0:1788201632.915940:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201632.918173:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559709824 00000100:00100000:0.0:1788201632.918188:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559709824 00002000:00100000:0.0:1788201632.918243:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (874512384->875560959) req@ffff962485aace00 x1875064559709824/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/0 e 0 to 0 dl 1788201643 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201632.918252:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aace00 with x1875064559709824 ext(874512384->875560959) 00002000:00010000:0.0:1788201632.918257:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aace00 00000100:00100000:0.0:1788201632.918291:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 879 00000100:00100000:0.0:1788201632.918298:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559709824:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201632.934788:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559709824:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16469us (18844us total) trans 30064771880 rc 0/0 00000100:00100000:0.0:1788201632.934805:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 879 00002000:00100000:0.0:1788201632.934823:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (874512384->875560959) req@ffff962485aace00 x1875064559709824/t30064771880(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:753/0 lens 488/448 e 0 to 0 dl 1788201643 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201632.934837:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aace00 with x1875064559709824 ext(874512384->875560959) 00002000:00010000:0.0:1788201632.934845:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aace00 00000100:00100000:1.0:1788201633.102687:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201633.102828:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559709952 00000100:00100000:3.0:1788201633.102842:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559709952 00002000:00100000:3.0:1788201633.102935:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (875560960->876609535) req@ffff9624b9f68e00 x1875064559709952/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/0 e 0 to 0 dl 1788201644 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201633.102950:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68e00 with x1875064559709952 ext(875560960->876609535) 00002000:00010000:3.0:1788201633.102957:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68e00 00000100:00100000:3.0:1788201633.103006:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 880 00000100:00100000:3.0:1788201633.103020:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2341:x1875064559709952:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201633.104611:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201633.123131:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2341:x1875064559709952:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20094us (20440us total) trans 30064771881 rc 0/0 00000100:00100000:3.0:1788201633.123151:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 880 00002000:00100000:3.0:1788201633.123169:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (875560960->876609535) req@ffff9624b9f68e00 x1875064559709952/t30064771881(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/448 e 0 to 0 dl 1788201644 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201633.123181:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68e00 with x1875064559709952 ext(875560960->876609535) 00002000:00010000:3.0:1788201633.123189:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68e00 00000100:00100000:1.0:1788201633.323884:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201633.324079:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559710080 00000100:00100000:3.0:1788201633.324093:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559710080 00002000:00100000:3.0:1788201633.324164:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (876609536->877658111) req@ffff9624b9f6a680 x1875064559710080/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/0 e 0 to 0 dl 1788201644 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201633.324175:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6a680 with x1875064559710080 ext(876609536->877658111) 00002000:00010000:3.0:1788201633.324201:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6a680 00000100:00100000:3.0:1788201633.326798:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 881 00000100:00100000:3.0:1788201633.326844:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559710080:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201633.353179:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559710080:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26317us (29272us total) trans 30064771882 rc 0/0 00000100:00100000:3.0:1788201633.353195:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 881 00002000:00100000:3.0:1788201633.353209:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (876609536->877658111) req@ffff9624b9f6a680 x1875064559710080/t30064771882(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/448 e 0 to 0 dl 1788201644 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201633.353220:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6a680 with x1875064559710080 ext(876609536->877658111) 00002000:00010000:3.0:1788201633.353227:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6a680 00000100:00100000:1.0:1788201633.415235:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201633.415912:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559710208 00000100:00100000:0.0:1788201633.415923:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559710208 00002000:00100000:0.0:1788201633.415978:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (877658112->878706687) req@ffff9624b9f6bb80 x1875064559710208/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/0 e 0 to 0 dl 1788201644 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201633.415989:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6bb80 with x1875064559710208 ext(877658112->878706687) 00002000:00010000:0.0:1788201633.415994:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6bb80 00000100:00100000:0.0:1788201633.416093:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 882 00000100:00100000:0.0:1788201633.416104:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2342:x1875064559710208:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201633.424871:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559710208:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8758us (9633us total) trans 30064771883 rc 0/0 00000100:00100000:0.0:1788201633.424885:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 882 00002000:00100000:0.0:1788201633.424897:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (877658112->878706687) req@ffff9624b9f6bb80 x1875064559710208/t30064771883(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/448 e 0 to 0 dl 1788201644 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201633.424908:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6bb80 with x1875064559710208 ext(877658112->878706687) 00002000:00010000:0.0:1788201633.424914:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6bb80 00000100:00100000:2.0:1788201633.487876:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201633.488047:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559710336 00000100:00100000:0.0:1788201633.488058:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559710336 00002000:00100000:0.0:1788201633.488107:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (878706688->879755263) req@ffff9624c1cc5500 x1875064559710336/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/0 e 0 to 0 dl 1788201644 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201633.488119:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5500 with x1875064559710336 ext(878706688->879755263) 00002000:00010000:0.0:1788201633.488126:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5500 00000100:00100000:0.0:1788201633.488157:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 883 00000100:00100000:0.0:1788201633.488167:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559710336:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201633.504232:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559710336:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16054us (16354us total) trans 30064771884 rc 0/0 00000100:00100000:0.0:1788201633.504245:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 883 00002000:00100000:0.0:1788201633.504259:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (878706688->879755263) req@ffff9624c1cc5500 x1875064559710336/t30064771884(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/448 e 0 to 0 dl 1788201644 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201633.504270:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5500 with x1875064559710336 ext(878706688->879755263) 00002000:00010000:0.0:1788201633.504291:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5500 00010000:00010000:2.0:1788201633.590641:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201633.631589:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201633.631685:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559710464 00000100:00100000:3.0:1788201633.631695:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559710464 00002000:00100000:3.0:1788201633.631747:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (879755264->880803839) req@ffff9624c1cc4700 x1875064559710464/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/0 e 0 to 0 dl 1788201644 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201633.631760:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4700 with x1875064559710464 ext(879755264->880803839) 00002000:00010000:3.0:1788201633.631766:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4700 00000100:00100000:3.0:1788201633.631855:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 884 00000100:00100000:3.0:1788201633.631866:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2341:x1875064559710464:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201633.647126:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2341:x1875064559710464:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15250us (15538us total) trans 30064771885 rc 0/0 00000100:00100000:3.0:1788201633.647140:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 884 00002000:00100000:3.0:1788201633.647153:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (879755264->880803839) req@ffff9624c1cc4700 x1875064559710464/t30064771885(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/448 e 0 to 0 dl 1788201644 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201633.647184:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4700 with x1875064559710464 ext(879755264->880803839) 00002000:00010000:3.0:1788201633.647190:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4700 00000100:00100000:1.0:1788201633.766599:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201633.768980:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559710592 00000100:00100000:3.0:1788201633.768997:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559710592 00002000:00100000:3.0:1788201633.769066:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (880803840->881852415) req@ffff9624b9f6b100 x1875064559710592/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/0 e 0 to 0 dl 1788201644 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201633.769077:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6b100 with x1875064559710592 ext(880803840->881852415) 00002000:00010000:3.0:1788201633.769083:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6b100 00000100:00100000:3.0:1788201633.769125:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 885 00000100:00100000:3.0:1788201633.769136:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2344:x1875064559710592:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201633.796475:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2344:x1875064559710592:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27330us (29877us total) trans 30064771886 rc 0/0 00000100:00100000:3.0:1788201633.796494:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 885 00002000:00100000:3.0:1788201633.796506:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (880803840->881852415) req@ffff9624b9f6b100 x1875064559710592/t30064771886(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/448 e 0 to 0 dl 1788201644 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201633.796517:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6b100 with x1875064559710592 ext(880803840->881852415) 00002000:00010000:3.0:1788201633.796523:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6b100 00000100:00100000:2.0:1788201633.840549:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201633.840673:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559710720 00000100:00100000:0.0:1788201633.840689:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559710720 00002000:00100000:0.0:1788201633.840761:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (881852416->882900991) req@ffff9624c1cc5880 x1875064559710720/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/0 e 0 to 0 dl 1788201644 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201633.840773:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5880 with x1875064559710720 ext(881852416->882900991) 00002000:00010000:0.0:1788201633.840779:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5880 00000100:00100000:0.0:1788201633.840816:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 886 00000100:00100000:0.0:1788201633.840828:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2343:x1875064559710720:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201633.851322:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570159104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201633.851427:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201633.851570:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570159104 00000100:00100000:3.0:1788201633.851579:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570159104 00000100:00100000:3.0:1788201633.851650:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788201633.851662:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570159104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201633.851710:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3407872 granted 578879488 pending 49414144 free 3007315968 avail 3005218816 00000100:00100000:3.0:1788201633.851767:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570159104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201633.851776:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:3.0:1788201633.852004:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201633.852064:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570159104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201633.854410:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2343:x1875064559710720:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13571us (13863us total) trans 30064771887 rc 0/0 00000100:00100000:3.0:1788201633.854426:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 886 00002000:00100000:3.0:1788201633.854442:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (881852416->882900991) req@ffff9624c1cc5880 x1875064559710720/t30064771887(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/448 e 0 to 0 dl 1788201644 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201633.854455:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5880 with x1875064559710720 ext(881852416->882900991) 00002000:00010000:3.0:1788201633.854463:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5880 00000100:00100000:1.0:1788201633.948159:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201633.948314:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559710848 00000100:00100000:0.0:1788201633.948327:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559710848 00002000:00100000:0.0:1788201633.948437:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (882900992->883949567) req@ffff9624b9f69c00 x1875064559710848/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/0 e 0 to 0 dl 1788201644 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201633.948451:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69c00 with x1875064559710848 ext(882900992->883949567) 00002000:00010000:0.0:1788201633.948459:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69c00 00000100:00100000:0.0:1788201633.948546:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 887 00000100:00100000:0.0:1788201633.948558:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2344:x1875064559710848:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201633.964251:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2344:x1875064559710848:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15678us (16090us total) trans 30064771888 rc 0/0 00000100:00100000:0.0:1788201633.964272:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 887 00002000:00100000:0.0:1788201633.964289:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (882900992->883949567) req@ffff9624b9f69c00 x1875064559710848/t30064771888(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:754/0 lens 488/448 e 0 to 0 dl 1788201644 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201633.964303:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69c00 with x1875064559710848 ext(882900992->883949567) 00002000:00010000:0.0:1788201633.964312:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69c00 00000100:00100000:2.0:1788201634.002936:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201634.003067:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559710976 00000100:00100000:3.0:1788201634.003082:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559710976 00002000:00100000:3.0:1788201634.003149:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (883949568->884998143) req@ffff9624c1cc4380 x1875064559710976/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:0/0 lens 488/0 e 0 to 0 dl 1788201645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201634.003163:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4380 with x1875064559710976 ext(883949568->884998143) 00002000:00010000:3.0:1788201634.003169:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4380 00000100:00100000:3.0:1788201634.003209:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 888 00000100:00100000:3.0:1788201634.003220:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2343:x1875064559710976:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201634.018283:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2343:x1875064559710976:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15047us (15346us total) trans 30064771889 rc 0/0 00000100:00100000:0.0:1788201634.018301:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 888 00002000:00100000:0.0:1788201634.018326:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (883949568->884998143) req@ffff9624c1cc4380 x1875064559710976/t30064771889(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:0/0 lens 488/448 e 0 to 0 dl 1788201645 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201634.018361:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4380 with x1875064559710976 ext(883949568->884998143) 00002000:00010000:0.0:1788201634.018369:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4380 00000100:00100000:2.0:1788201634.082950:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201634.083199:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559711104 00000100:00100000:3.0:1788201634.083214:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559711104 00002000:00100000:3.0:1788201634.083286:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (884998144->886046719) req@ffff9624c1cc6300 x1875064559711104/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:0/0 lens 488/0 e 0 to 0 dl 1788201645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201634.083323:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6300 with x1875064559711104 ext(884998144->886046719) 00002000:00010000:3.0:1788201634.083337:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6300 00000100:00100000:3.0:1788201634.083415:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 889 00000100:00100000:3.0:1788201634.083429:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2341:x1875064559711104:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201634.102876:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+70:2341:x1875064559711104:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19435us (19925us total) trans 30064771890 rc 0/0 00000100:00100000:3.0:1788201634.102893:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 889 00002000:00100000:3.0:1788201634.102909:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (884998144->886046719) req@ffff9624c1cc6300 x1875064559711104/t30064771890(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:0/0 lens 488/448 e 0 to 0 dl 1788201645 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201634.102922:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6300 with x1875064559711104 ext(884998144->886046719) 00002000:00010000:3.0:1788201634.102929:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6300 00000100:00100000:2.0:1788201634.156102:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201634.158043:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559711232 00000100:00100000:0.0:1788201634.158070:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559711232 00002000:00100000:0.0:1788201634.158173:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (886046720->887095295) req@ffff9624c1cc7b80 x1875064559711232/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:0/0 lens 488/0 e 0 to 0 dl 1788201645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201634.158185:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc7b80 with x1875064559711232 ext(886046720->887095295) 00002000:00010000:0.0:1788201634.158192:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc7b80 00000100:00100000:0.0:1788201634.158251:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 890 00000100:00100000:0.0:1788201634.158262:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+70:2341:x1875064559711232:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201634.167824:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+72:2341:x1875064559711232:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9546us (11720us total) trans 30064771891 rc 0/0 00000100:00100000:0.0:1788201634.167843:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 890 00002000:00100000:0.0:1788201634.167860:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (886046720->887095295) req@ffff9624c1cc7b80 x1875064559711232/t30064771891(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:0/0 lens 488/448 e 0 to 0 dl 1788201645 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201634.167872:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc7b80 with x1875064559711232 ext(886046720->887095295) 00002000:00010000:0.0:1788201634.167880:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc7b80 00000100:00100000:2.0:1788201634.256757:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201634.256883:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559711360 00000100:00100000:0.0:1788201634.256897:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559711360 00002000:00100000:0.0:1788201634.256994:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (887095296->888143871) req@ffff9624c1cc5c00 x1875064559711360/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:0/0 lens 488/0 e 0 to 0 dl 1788201645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201634.257096:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5c00 with x1875064559711360 ext(887095296->888143871) 00002000:00010000:0.0:1788201634.257104:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5c00 00000100:00100000:0.0:1788201634.257146:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 891 00000100:00100000:0.0:1788201634.257160:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+72:2344:x1875064559711360:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201634.300965:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+74:2344:x1875064559711360:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 43791us (44207us total) trans 30064771892 rc 0/0 00000100:00100000:0.0:1788201634.300983:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 891 00002000:00100000:0.0:1788201634.301000:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (887095296->888143871) req@ffff9624c1cc5c00 x1875064559711360/t30064771892(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:0/0 lens 488/448 e 0 to 0 dl 1788201645 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201634.301021:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5c00 with x1875064559711360 ext(887095296->888143871) 00002000:00010000:0.0:1788201634.301030:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5c00 00000100:00100000:3.0:1788201634.444083:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201634.444255:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559711488 00000100:00100000:2.0:1788201634.444275:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559711488 00002000:00100000:2.0:1788201634.444726:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (888143872->889192447) req@ffff962485aae680 x1875064559711488/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:0/0 lens 488/0 e 0 to 0 dl 1788201645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201634.444739:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aae680 with x1875064559711488 ext(888143872->889192447) 00002000:00010000:2.0:1788201634.444746:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aae680 00000100:00100000:2.0:1788201634.446477:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 892 00000100:00100000:2.0:1788201634.446505:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+74:2342:x1875064559711488:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201634.488288:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+76:2342:x1875064559711488:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 41783us (44209us total) trans 30064771893 rc 0/0 00000100:00100000:3.0:1788201634.488306:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 892 00002000:00100000:3.0:1788201634.488325:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (888143872->889192447) req@ffff962485aae680 x1875064559711488/t30064771893(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:0/0 lens 488/448 e 0 to 0 dl 1788201645 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201634.488337:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aae680 with x1875064559711488 ext(888143872->889192447) 00002000:00010000:3.0:1788201634.488387:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aae680 00000001:00080000:1.0:1788201634.534251:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771892 is committed 00010000:00010000:0.0:1788201634.615451:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201634.716703:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201634.716788:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559711616 00000100:00100000:3.0:1788201634.716797:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559711616 00002000:00100000:3.0:1788201634.716852:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (889192448->890241023) req@ffff9624b9f69880 x1875064559711616/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:0/0 lens 488/0 e 0 to 0 dl 1788201645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201634.716902:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69880 with x1875064559711616 ext(889192448->890241023) 00002000:00010000:3.0:1788201634.716908:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69880 00000100:00100000:3.0:1788201634.716943:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 893 00000100:00100000:3.0:1788201634.716953:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559711616:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201634.747857:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559711616:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28075us (28335us total) trans 30064771894 rc 0/0 00000100:00100000:3.0:1788201634.751368:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 893 00002000:00100000:3.0:1788201634.751391:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (889192448->890241023) req@ffff9624b9f69880 x1875064559711616/t30064771894(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:0/0 lens 488/448 e 0 to 0 dl 1788201645 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201634.751404:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69880 with x1875064559711616 ext(889192448->890241023) 00002000:00010000:3.0:1788201634.751411:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69880 00000100:00100000:1.0:1788201635.055526:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201635.055627:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559711744 00000100:00100000:0.0:1788201635.055637:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559711744 00002000:00100000:0.0:1788201635.055704:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (890241024->891289599) req@ffff9624b9f69f80 x1875064559711744/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:1/0 lens 488/0 e 0 to 0 dl 1788201646 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201635.055716:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69f80 with x1875064559711744 ext(890241024->891289599) 00002000:00010000:0.0:1788201635.055722:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69f80 00000100:00100000:0.0:1788201635.055758:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 894 00000100:00100000:0.0:1788201635.055780:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559711744:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201635.056547:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201635.083515:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559711744:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27736us (27986us total) trans 30064771895 rc 0/0 00000100:00100000:0.0:1788201635.083551:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 894 00002000:00100000:0.0:1788201635.083567:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (890241024->891289599) req@ffff9624b9f69f80 x1875064559711744/t30064771895(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:1/0 lens 488/448 e 0 to 0 dl 1788201646 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201635.083579:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69f80 with x1875064559711744 ext(890241024->891289599) 00002000:00010000:0.0:1788201635.083586:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69f80 00000100:00100000:1.0:1788201635.317889:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201635.318735:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559711872 00000100:00100000:0.0:1788201635.318747:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559711872 00002000:00100000:0.0:1788201635.318800:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (891289600->892338175) req@ffff9624b9f68a80 x1875064559711872/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:1/0 lens 488/0 e 0 to 0 dl 1788201646 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201635.318811:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68a80 with x1875064559711872 ext(891289600->892338175) 00002000:00010000:0.0:1788201635.318816:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68a80 00000100:00100000:0.0:1788201635.318971:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 895 00000100:00100000:0.0:1788201635.319001:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2341:x1875064559711872:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201635.344111:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2341:x1875064559711872:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24869us (25976us total) trans 30064771896 rc 0/0 00000100:00100000:0.0:1788201635.344127:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 895 00002000:00100000:0.0:1788201635.344143:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (891289600->892338175) req@ffff9624b9f68a80 x1875064559711872/t30064771896(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:1/0 lens 488/448 e 0 to 0 dl 1788201646 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201635.344155:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68a80 with x1875064559711872 ext(891289600->892338175) 00002000:00010000:0.0:1788201635.344162:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68a80 00000100:00100000:2.0:1788201635.589169:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201635.594135:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559712000 00000100:00100000:3.0:1788201635.594149:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559712000 00002000:00100000:3.0:1788201635.594710:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (892338176->893386751) req@ffff9624c1cc4e00 x1875064559712000/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:1/0 lens 488/0 e 0 to 0 dl 1788201646 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201635.594722:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4e00 with x1875064559712000 ext(892338176->893386751) 00002000:00010000:3.0:1788201635.594728:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4e00 00000100:00100000:3.0:1788201635.594861:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 896 00000100:00100000:3.0:1788201635.594872:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559712000:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201635.636360:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559712000:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 41455us (47168us total) trans 30064771897 rc 0/0 00000100:00100000:2.0:1788201635.636380:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 896 00002000:00100000:2.0:1788201635.636397:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (892338176->893386751) req@ffff9624c1cc4e00 x1875064559712000/t30064771897(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:1/0 lens 488/448 e 0 to 0 dl 1788201646 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201635.636427:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4e00 with x1875064559712000 ext(892338176->893386751) 00002000:00010000:2.0:1788201635.636434:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4e00 00000100:00100000:3.0:1788201635.641489:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201635.641802:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201635.641861:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559712256 00000100:00100000:3.0:1788201635.641884:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559712256 00010000:00010000:2.0:1788201635.641886:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201635.642143:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201635.642399:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559712128 00000100:00100000:0.0:1788201635.642405:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559712128 00000100:00100000:0.0:1788201635.642460:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 568 00000100:00100000:0.0:1788201635.642476:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559712128:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201635.642556:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2342:x1875064559712128:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 81us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201635.642563:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 568 00000100:00100000:2.0:1788201635.649234:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 451 00000100:00100000:2.0:1788201635.649253:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559712256:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201635.649645:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559712256:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 396us (7853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201635.649653:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 451 00000100:00100000:1.0:1788201635.980274:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201635.980471:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559712384 00000100:00100000:3.0:1788201635.980482:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559712384 00002000:00100000:3.0:1788201635.980533:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (893386752->894435327) req@ffff9624b9f6b800 x1875064559712384/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:1/0 lens 488/0 e 0 to 0 dl 1788201646 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201635.980545:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6b800 with x1875064559712384 ext(893386752->894435327) 00002000:00010000:3.0:1788201635.980550:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6b800 00000100:00100000:3.0:1788201635.980585:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 897 00000100:00100000:3.0:1788201635.980596:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559712384:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201636.033624:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559712384:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 53015us (53345us total) trans 30064771898 rc 0/0 00000100:00100000:3.0:1788201636.033641:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 897 00002000:00100000:3.0:1788201636.033657:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (893386752->894435327) req@ffff9624b9f6b800 x1875064559712384/t30064771898(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:1/0 lens 488/448 e 0 to 0 dl 1788201646 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201636.033668:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6b800 with x1875064559712384 ext(893386752->894435327) 00002000:00010000:3.0:1788201636.033675:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6b800 00000100:00100000:2.0:1788201636.252462:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201636.252542:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559712512 00000100:00100000:0.0:1788201636.252552:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559712512 00002000:00100000:0.0:1788201636.252618:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (894435328->895483903) req@ffff9624c1cc6d80 x1875064559712512/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:2/0 lens 488/0 e 0 to 0 dl 1788201647 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201636.252631:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6d80 with x1875064559712512 ext(894435328->895483903) 00002000:00010000:0.0:1788201636.252636:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6d80 00000100:00100000:0.0:1788201636.252672:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 898 00000100:00100000:0.0:1788201636.252682:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559712512:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201636.297734:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559712512:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 45043us (45284us total) trans 30064771899 rc 0/0 00000100:00100000:0.0:1788201636.297748:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 898 00002000:00100000:0.0:1788201636.297760:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (894435328->895483903) req@ffff9624c1cc6d80 x1875064559712512/t30064771899(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:2/0 lens 488/448 e 0 to 0 dl 1788201647 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201636.297770:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6d80 with x1875064559712512 ext(894435328->895483903) 00002000:00010000:0.0:1788201636.297775:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6d80 00000100:00100000:1.0:1788201636.407113:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201636.407139:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570159232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201636.407213:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201636.407375:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570159232 00000100:00100000:2.0:1788201636.407382:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570159232 00000100:00100000:2.0:1788201636.407436:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788201636.407446:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570159232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201636.407485:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201636.407531:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570159232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201636.407538:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00010000:00080000:1.0:1788201636.407632:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962485aaf100 x1875064570159232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201636.407651:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570159232:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201636.409008:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201636.500712:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201636.500877:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559712640 00000100:00100000:3.0:1788201636.500888:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559712640 00002000:00100000:3.0:1788201636.500942:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (895483904->896532479) req@ffff9624bfd2ca80 x1875064559712640/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:2/0 lens 488/0 e 0 to 0 dl 1788201647 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201636.500955:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2ca80 with x1875064559712640 ext(895483904->896532479) 00002000:00010000:3.0:1788201636.500962:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2ca80 00000100:00100000:3.0:1788201636.501026:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 899 00000100:00100000:3.0:1788201636.501053:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559712640:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201636.525630:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559712640:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24569us (24919us total) trans 30064771900 rc 0/0 00000100:00100000:3.0:1788201636.525644:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 899 00002000:00100000:3.0:1788201636.525656:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (895483904->896532479) req@ffff9624bfd2ca80 x1875064559712640/t30064771900(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:2/0 lens 488/448 e 0 to 0 dl 1788201647 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201636.525666:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2ca80 with x1875064559712640 ext(895483904->896532479) 00002000:00010000:3.0:1788201636.525672:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2ca80 00010000:00010000:2.0:1788201636.664096:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201636.727689:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201636.730637:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559712768 00000100:00100000:2.0:1788201636.730659:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559712768 00002000:00100000:2.0:1788201636.731070:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (896532480->897581055) req@ffff96248cd57100 x1875064559712768/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:2/0 lens 488/0 e 0 to 0 dl 1788201647 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201636.731085:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd57100 with x1875064559712768 ext(896532480->897581055) 00002000:00010000:2.0:1788201636.731093:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd57100 00000100:00100000:2.0:1788201636.731168:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 900 00000100:00100000:2.0:1788201636.731181:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559712768:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201636.756569:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559712768:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25372us (28881us total) trans 30064771901 rc 0/0 00000100:00100000:2.0:1788201636.756589:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 900 00002000:00100000:2.0:1788201636.756606:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (896532480->897581055) req@ffff96248cd57100 x1875064559712768/t30064771901(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:2/0 lens 488/448 e 0 to 0 dl 1788201647 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201636.756619:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd57100 with x1875064559712768 ext(896532480->897581055) 00002000:00010000:2.0:1788201636.756627:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd57100 00000100:00100000:2.0:1788201636.918885:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570159616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201636.919134:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201636.919287:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201636.919294:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570159744:0@lo:400:kworker.0 00000100:00100000:2.0:1788201636.919326:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201636.919414:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570159360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201636.919461:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201636.919497:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570159872:0@lo:400:kworker.0 00000100:00100000:1.0:1788201636.919523:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201636.919666:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201636.919690:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570159488:0@lo:400:kworker.0 00000100:00100000:3.0:1788201636.919856:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570159744 00000100:00100000:3.0:1788201636.919869:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570159744 00000100:00100000:1.0:1788201636.919920:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201636.920074:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570159616 00000100:00100000:0.0:1788201636.920080:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570159616 00000100:00100000:0.0:1788201636.920155:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788201636.920223:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570159360 00000100:00100000:2.0:1788201636.920228:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570159360 00000100:00100000:0.0:1788201636.920647:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570159616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201636.920760:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570159616:12345-0@lo:400:kworker.0 Request processed in 122us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201636.920768:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788201636.920834:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624904ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570159616:0@lo:400:kworker.0 00000100:00080000:1.0:1788201636.921535:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201636.921545:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201636.921656:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1788201636.921671:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570159360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201636.922011:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570159360:12345-0@lo:400:kworker.0 Request processed in 333us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201636.922021:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1788201636.923423:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570159360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201636.928603:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570159872 00000100:00100000:2.0:1788201636.928625:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570159872 00000100:00100000:3.0:1788201636.928938:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570159488 00000100:00100000:3.0:1788201636.928945:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570159488 00000100:00100000:2.0:1788201636.929564:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1788201636.929581:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570159744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201636.929736:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570159744:12345-0@lo:400:kworker.0 Request processed in 160us (10408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201636.929834:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1788201636.929846:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570159872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201636.929899:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570159872:12345-0@lo:400:kworker.0 Request processed in 56us (10374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201636.929907:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1788201636.929931:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1788201636.929938:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570159488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201636.930900:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570159744:0@lo:400:kworker.0 00000100:00100000:1.0:1788201636.930993:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570159488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201636.931039:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570159872:0@lo:400:kworker.0 00000100:00100000:1.0:1788201636.931151:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201636.931194:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559712896 00000100:00100000:1.0:1788201636.931202:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559712896 00002000:00100000:1.0:1788201636.931249:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (897581056->898629631) req@ffff9624c1e54e00 x1875064559712896/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:2/0 lens 488/0 e 0 to 0 dl 1788201647 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201636.931262:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54e00 with x1875064559712896 ext(897581056->898629631) 00002000:00010000:1.0:1788201636.931268:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54e00 00000100:00100000:1.0:1788201636.931291:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 901 00000100:00100000:1.0:1788201636.931300:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559712896:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201636.934813:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570159488:12345-0@lo:400:kworker.0 Request processed in 46us (10066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201636.934848:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00080000:3.0:1788201636.934970:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201636.935120:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1788201636.957195:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559712896:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25874us (26037us total) trans 30064771902 rc 0/0 00000100:00100000:2.0:1788201636.957215:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 901 00002000:00100000:2.0:1788201636.957233:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (897581056->898629631) req@ffff9624c1e54e00 x1875064559712896/t30064771902(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:2/0 lens 488/448 e 0 to 0 dl 1788201647 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201636.957245:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54e00 with x1875064559712896 ext(897581056->898629631) 00002000:00010000:2.0:1788201636.957253:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54e00 00000100:00100000:1.0:1788201637.177214:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201637.181802:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559713024 00000100:00100000:0.0:1788201637.181827:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559713024 00002000:00100000:0.0:1788201637.181950:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (898629632->899678207) req@ffff9624c1e56680 x1875064559713024/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:3/0 lens 488/0 e 0 to 0 dl 1788201648 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201637.181974:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56680 with x1875064559713024 ext(898629632->899678207) 00002000:00010000:0.0:1788201637.181981:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56680 00000100:00100000:0.0:1788201637.182026:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 902 00000100:00100000:0.0:1788201637.182039:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559713024:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201637.182721:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201637.213980:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559713024:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31913us (36751us total) trans 30064771903 rc 0/0 00000100:00100000:0.0:1788201637.214000:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 902 00002000:00100000:0.0:1788201637.214019:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (898629632->899678207) req@ffff9624c1e56680 x1875064559713024/t30064771903(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:3/0 lens 488/448 e 0 to 0 dl 1788201648 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201637.214032:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56680 with x1875064559713024 ext(898629632->899678207) 00002000:00010000:0.0:1788201637.214041:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56680 00000100:00100000:1.0:1788201637.404960:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201637.405395:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559713152 00000100:00100000:3.0:1788201637.405411:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559713152 00002000:00100000:3.0:1788201637.405522:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (899678208->900726783) req@ffff9624c1e56d80 x1875064559713152/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:3/0 lens 488/0 e 0 to 0 dl 1788201648 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201637.405536:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56d80 with x1875064559713152 ext(899678208->900726783) 00002000:00010000:3.0:1788201637.405543:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56d80 00000100:00100000:3.0:1788201637.406013:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 903 00000100:00100000:3.0:1788201637.406028:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559713152:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201637.439630:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559713152:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33585us (34676us total) trans 30064771904 rc 0/0 00000100:00100000:0.0:1788201637.439650:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 903 00002000:00100000:0.0:1788201637.439669:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (899678208->900726783) req@ffff9624c1e56d80 x1875064559713152/t30064771904(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:3/0 lens 488/448 e 0 to 0 dl 1788201648 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201637.439703:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56d80 with x1875064559713152 ext(899678208->900726783) 00002000:00010000:0.0:1788201637.439711:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56d80 00000100:00100000:1.0:1788201637.622458:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201637.623306:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559713280 00000100:00100000:2.0:1788201637.623321:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559713280 00002000:00100000:2.0:1788201637.623415:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (900726784->901775359) req@ffff9624c1e55c00 x1875064559713280/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:3/0 lens 488/0 e 0 to 0 dl 1788201648 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201637.623429:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55c00 with x1875064559713280 ext(900726784->901775359) 00002000:00010000:2.0:1788201637.623436:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55c00 00000100:00100000:2.0:1788201637.623483:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 904 00000100:00100000:2.0:1788201637.623495:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559713280:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201637.649330:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559713280:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25819us (26871us total) trans 30064771905 rc 0/0 00000100:00100000:2.0:1788201637.649383:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 904 00002000:00100000:2.0:1788201637.649399:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (900726784->901775359) req@ffff9624c1e55c00 x1875064559713280/t30064771905(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:3/0 lens 488/448 e 0 to 0 dl 1788201648 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201637.649434:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55c00 with x1875064559713280 ext(900726784->901775359) 00002000:00010000:2.0:1788201637.649442:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55c00 00010000:00010000:0.0:1788201637.686863:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201637.868505:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201637.868665:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559713408 00000100:00100000:2.0:1788201637.868679:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559713408 00002000:00100000:2.0:1788201637.868770:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (901775360->902823935) req@ffff9624c1e57100 x1875064559713408/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:3/0 lens 488/0 e 0 to 0 dl 1788201648 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201637.868785:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57100 with x1875064559713408 ext(901775360->902823935) 00002000:00010000:2.0:1788201637.868792:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57100 00000100:00100000:2.0:1788201637.868834:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 905 00000100:00100000:2.0:1788201637.868847:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559713408:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201637.894692:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559713408:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25823us (26177us total) trans 30064771906 rc 0/0 00000100:00100000:2.0:1788201637.894713:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 905 00002000:00100000:2.0:1788201637.894745:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (901775360->902823935) req@ffff9624c1e57100 x1875064559713408/t30064771906(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:3/0 lens 488/448 e 0 to 0 dl 1788201648 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201637.894758:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57100 with x1875064559713408 ext(901775360->902823935) 00002000:00010000:2.0:1788201637.894767:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57100 00000100:00100000:1.0:1788201638.107296:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201638.107605:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559713536 00000100:00100000:0.0:1788201638.107620:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559713536 00002000:00100000:0.0:1788201638.107695:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (902823936->903872511) req@ffff9624c1e54a80 x1875064559713536/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:4/0 lens 488/0 e 0 to 0 dl 1788201649 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201638.107838:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54a80 with x1875064559713536 ext(902823936->903872511) 00002000:00010000:0.0:1788201638.107847:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54a80 00000100:00100000:0.0:1788201638.107897:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 906 00000100:00100000:0.0:1788201638.107911:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559713536:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201638.150617:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559713536:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 42689us (43318us total) trans 30064771907 rc 0/0 00000100:00100000:2.0:1788201638.150637:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 906 00002000:00100000:2.0:1788201638.150653:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (902823936->903872511) req@ffff9624c1e54a80 x1875064559713536/t30064771907(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:4/0 lens 488/448 e 0 to 0 dl 1788201649 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201638.150688:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54a80 with x1875064559713536 ext(902823936->903872511) 00002000:00010000:2.0:1788201638.150696:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54a80 00000100:00100000:1.0:1788201638.401451:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201638.401637:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559713664 00000100:00100000:0.0:1788201638.401651:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559713664 00002000:00100000:0.0:1788201638.401735:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (903872512->904921087) req@ffff9624c1e57b80 x1875064559713664/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:4/0 lens 488/0 e 0 to 0 dl 1788201649 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201638.401749:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57b80 with x1875064559713664 ext(903872512->904921087) 00002000:00010000:0.0:1788201638.401757:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57b80 00000100:00100000:0.0:1788201638.401858:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 907 00000100:00100000:0.0:1788201638.401871:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559713664:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201638.415579:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559713664:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13693us (14132us total) trans 30064771908 rc 0/0 00000100:00100000:2.0:1788201638.415598:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 907 00002000:00100000:2.0:1788201638.415618:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (903872512->904921087) req@ffff9624c1e57b80 x1875064559713664/t30064771908(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:4/0 lens 488/448 e 0 to 0 dl 1788201649 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201638.415631:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57b80 with x1875064559713664 ext(903872512->904921087) 00002000:00010000:2.0:1788201638.415639:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57b80 00000100:00100000:0.0:1788201638.615965:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201638.616077:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559713792 00000100:00100000:2.0:1788201638.616091:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559713792 00002000:00100000:2.0:1788201638.616186:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (904921088->905969663) req@ffff96248cd54700 x1875064559713792/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:4/0 lens 488/0 e 0 to 0 dl 1788201649 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201638.616199:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd54700 with x1875064559713792 ext(904921088->905969663) 00002000:00010000:2.0:1788201638.616206:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd54700 00000100:00100000:2.0:1788201638.616252:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 908 00000100:00100000:2.0:1788201638.616264:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559713792:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201638.645661:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559713792:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29381us (29695us total) trans 30064771909 rc 0/0 00000100:00100000:2.0:1788201638.645684:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 908 00002000:00100000:2.0:1788201638.645701:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (904921088->905969663) req@ffff96248cd54700 x1875064559713792/t30064771909(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:4/0 lens 488/448 e 0 to 0 dl 1788201649 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201638.647200:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd54700 with x1875064559713792 ext(904921088->905969663) 00002000:00010000:2.0:1788201638.647211:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd54700 00010000:00010000:2.0:1788201638.718788:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201638.923415:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201638.923609:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559713920 00000100:00100000:2.0:1788201638.923622:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559713920 00002000:00100000:2.0:1788201638.923689:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (905969664->907018239) req@ffff962485aaca80 x1875064559713920/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:4/0 lens 488/0 e 0 to 0 dl 1788201649 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201638.923702:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaca80 with x1875064559713920 ext(905969664->907018239) 00002000:00010000:2.0:1788201638.923721:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaca80 00000100:00100000:2.0:1788201638.923767:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 909 00000100:00100000:2.0:1788201638.923779:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559713920:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201638.963439:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559713920:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39645us (40022us total) trans 30064771910 rc 0/0 00000100:00100000:2.0:1788201638.963458:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 909 00002000:00100000:2.0:1788201638.963474:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (905969664->907018239) req@ffff962485aaca80 x1875064559713920/t30064771910(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:4/0 lens 488/448 e 0 to 0 dl 1788201649 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201638.963483:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaca80 with x1875064559713920 ext(905969664->907018239) 00002000:00010000:2.0:1788201638.963489:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaca80 00000100:00100000:1.0:1788201638.967082:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570160000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201638.967188:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201638.967447:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570160000 00000100:00100000:3.0:1788201638.967458:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570160000 00000100:00100000:3.0:1788201638.967530:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788201638.967539:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570160000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201638.967588:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 559218688 pending 30670848 free 2971664384 avail 2969567232 00000100:00100000:3.0:1788201638.967641:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570160000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201638.967646:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788201638.967697:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570160000:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201638.969248:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201639.128881:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201639.129065:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559714048 00000100:00100000:0.0:1788201639.129076:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559714048 00002000:00100000:0.0:1788201639.130052:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (907018240->908066815) req@ffff9624c1e55500 x1875064559714048/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:5/0 lens 488/0 e 0 to 0 dl 1788201650 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201639.130083:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55500 with x1875064559714048 ext(907018240->908066815) 00002000:00010000:0.0:1788201639.130089:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55500 00000100:00080000:1.0:1788201639.130215:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201639.130303:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 910 00000100:00100000:0.0:1788201639.130316:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2341:x1875064559714048:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201639.142523:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2341:x1875064559714048:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12198us (13639us total) trans 30064771911 rc 0/0 00000100:00100000:0.0:1788201639.142537:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 910 00002000:00100000:0.0:1788201639.142551:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (907018240->908066815) req@ffff9624c1e55500 x1875064559714048/t30064771911(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:5/0 lens 488/448 e 0 to 0 dl 1788201650 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201639.142562:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55500 with x1875064559714048 ext(907018240->908066815) 00002000:00010000:0.0:1788201639.142568:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55500 00000100:00100000:3.0:1788201639.226599:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201639.227080:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559714176 00000100:00100000:0.0:1788201639.227091:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559714176 00002000:00100000:0.0:1788201639.227153:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (908066816->909115391) req@ffff962485aafb80 x1875064559714176/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:5/0 lens 488/0 e 0 to 0 dl 1788201650 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201639.227166:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aafb80 with x1875064559714176 ext(908066816->909115391) 00002000:00010000:0.0:1788201639.227172:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aafb80 00000100:00100000:0.0:1788201639.227266:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 911 00000100:00100000:0.0:1788201639.227277:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2342:x1875064559714176:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201639.247854:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2342:x1875064559714176:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20567us (21253us total) trans 30064771912 rc 0/0 00000100:00100000:0.0:1788201639.247868:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 911 00002000:00100000:0.0:1788201639.247908:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (908066816->909115391) req@ffff962485aafb80 x1875064559714176/t30064771912(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:5/0 lens 488/448 e 0 to 0 dl 1788201650 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201639.247928:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aafb80 with x1875064559714176 ext(908066816->909115391) 00002000:00010000:0.0:1788201639.247935:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aafb80 00000100:00100000:3.0:1788201639.364640:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201639.364853:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559714304 00000100:00100000:2.0:1788201639.364866:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559714304 00002000:00100000:2.0:1788201639.364937:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (909115392->910163967) req@ffff962485aaea00 x1875064559714304/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:5/0 lens 488/0 e 0 to 0 dl 1788201650 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201639.364949:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaea00 with x1875064559714304 ext(909115392->910163967) 00002000:00010000:2.0:1788201639.364973:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaea00 00000100:00100000:2.0:1788201639.365017:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 912 00000100:00100000:2.0:1788201639.365030:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559714304:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201639.382296:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559714304:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17252us (17653us total) trans 30064771913 rc 0/0 00000100:00100000:2.0:1788201639.382312:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 912 00002000:00100000:2.0:1788201639.382328:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (909115392->910163967) req@ffff962485aaea00 x1875064559714304/t30064771913(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:5/0 lens 488/448 e 0 to 0 dl 1788201650 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201639.382339:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaea00 with x1875064559714304 ext(909115392->910163967) 00002000:00010000:2.0:1788201639.382377:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaea00 00000100:00100000:3.0:1788201639.526035:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201639.526116:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559714432 00000100:00100000:3.0:1788201639.526132:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559714432 00002000:00100000:3.0:1788201639.526219:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (910163968->911212543) req@ffff962485aad180 x1875064559714432/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:5/0 lens 488/0 e 0 to 0 dl 1788201650 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201639.526233:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aad180 with x1875064559714432 ext(910163968->911212543) 00002000:00010000:3.0:1788201639.526241:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aad180 00000100:00100000:3.0:1788201639.526302:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 913 00000100:00100000:3.0:1788201639.526315:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559714432:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201639.550079:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559714432:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23745us (24044us total) trans 30064771914 rc 0/0 00000100:00100000:1.0:1788201639.550242:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 913 00002000:00100000:1.0:1788201639.550262:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (910163968->911212543) req@ffff962485aad180 x1875064559714432/t30064771914(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:5/0 lens 488/448 e 0 to 0 dl 1788201650 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201639.550292:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aad180 with x1875064559714432 ext(910163968->911212543) 00002000:00010000:1.0:1788201639.550300:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aad180 00000001:00080000:0.0:1788201639.625042:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771912 is committed 00000001:00080000:0.0:1788201639.625106:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771913 is committed 00010000:00010000:2.0:1788201639.734629:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201639.885526:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201639.891519:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559714560 00000100:00100000:0.0:1788201639.891542:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559714560 00002000:00100000:0.0:1788201639.891634:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (911212544->912261119) req@ffff962485aac700 x1875064559714560/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:5/0 lens 488/0 e 0 to 0 dl 1788201650 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201639.891649:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aac700 with x1875064559714560 ext(911212544->912261119) 00002000:00010000:0.0:1788201639.891656:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aac700 00000100:00100000:0.0:1788201639.891719:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 914 00000100:00100000:0.0:1788201639.891733:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559714560:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201639.921086:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559714560:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29337us (35634us total) trans 30064771915 rc 0/0 00000100:00100000:1.0:1788201639.921107:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 914 00002000:00100000:1.0:1788201639.921125:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (911212544->912261119) req@ffff962485aac700 x1875064559714560/t30064771915(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:5/0 lens 488/448 e 0 to 0 dl 1788201650 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201639.921137:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aac700 with x1875064559714560 ext(911212544->912261119) 00002000:00010000:1.0:1788201639.921144:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aac700 00000100:00100000:2.0:1788201640.205502:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201640.208983:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559714688 00000100:00100000:3.0:1788201640.209007:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559714688 00002000:00100000:3.0:1788201640.209105:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (912261120->913309695) req@ffff962393aa3b80 x1875064559714688/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:6/0 lens 488/0 e 0 to 0 dl 1788201651 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201640.209119:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa3b80 with x1875064559714688 ext(912261120->913309695) 00002000:00010000:3.0:1788201640.209127:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa3b80 00000100:00100000:3.0:1788201640.209266:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 915 00000100:00100000:3.0:1788201640.209279:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559714688:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201640.241861:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559714688:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32570us (36360us total) trans 30064771916 rc 0/0 00000100:00100000:2.0:1788201640.241879:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 915 00002000:00100000:2.0:1788201640.241895:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (912261120->913309695) req@ffff962393aa3b80 x1875064559714688/t30064771916(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:6/0 lens 488/448 e 0 to 0 dl 1788201651 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201640.241916:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa3b80 with x1875064559714688 ext(912261120->913309695) 00002000:00010000:2.0:1788201640.241922:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa3b80 00000100:00100000:2.0:1788201640.484687:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201640.484810:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559714816 00000100:00100000:0.0:1788201640.484819:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559714816 00002000:00100000:0.0:1788201640.484872:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (913309696->914358271) req@ffff962393aa1880 x1875064559714816/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:6/0 lens 488/0 e 0 to 0 dl 1788201651 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201640.484882:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1880 with x1875064559714816 ext(913309696->914358271) 00002000:00010000:0.0:1788201640.484887:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1880 00000100:00100000:0.0:1788201640.484929:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 916 00000100:00100000:0.0:1788201640.484943:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559714816:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201640.515711:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559714816:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30754us (31078us total) trans 30064771917 rc 0/0 00000100:00100000:1.0:1788201640.515731:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 916 00002000:00100000:1.0:1788201640.515751:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (913309696->914358271) req@ffff962393aa1880 x1875064559714816/t30064771917(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:6/0 lens 488/448 e 0 to 0 dl 1788201651 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201640.515765:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1880 with x1875064559714816 ext(913309696->914358271) 00002000:00010000:1.0:1788201640.515776:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1880 00010000:00010000:1.0:1788201640.760171:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201640.760745:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201640.761495:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559715072 00000100:00100000:3.0:1788201640.761506:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559715072 00000100:00080000:1.0:1788201640.761604:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201640.761641:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 455 00000100:00100000:3.0:1788201640.761653:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624904ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559715072:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201640.761747:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624904ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559715072:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 98us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201640.761753:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 455 00000100:00100000:3.0:1788201640.762331:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201640.764409:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559714944 00000100:00100000:1.0:1788201640.764428:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559714944 00000100:00100000:1.0:1788201640.764538:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 570 00000100:00100000:1.0:1788201640.764550:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559714944:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1788201640.764666:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559714944:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 117us (2333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201640.764695:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 570 00000100:00100000:3.0:1788201640.801474:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201640.802543:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559715200 00000100:00100000:1.0:1788201640.802562:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559715200 00002000:00100000:1.0:1788201640.802651:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (914358272->915406847) req@ffff962485aad880 x1875064559715200/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:6/0 lens 488/0 e 0 to 0 dl 1788201651 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201640.802665:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aad880 with x1875064559715200 ext(914358272->915406847) 00002000:00010000:1.0:1788201640.802672:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aad880 00000100:00100000:1.0:1788201640.802728:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 917 00000100:00100000:1.0:1788201640.802739:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559715200:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201640.828133:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559715200:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25375us (26649us total) trans 30064771918 rc 0/0 00000100:00100000:1.0:1788201640.828151:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 917 00002000:00100000:1.0:1788201640.828168:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (914358272->915406847) req@ffff962485aad880 x1875064559715200/t30064771918(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:6/0 lens 488/448 e 0 to 0 dl 1788201651 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201640.828181:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aad880 with x1875064559715200 ext(914358272->915406847) 00002000:00010000:1.0:1788201640.828189:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aad880 00000100:00100000:0.0:1788201641.256327:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201641.256833:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559715328 00000100:00100000:1.0:1788201641.256846:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559715328 00002000:00100000:1.0:1788201641.256964:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (915406848->916455423) req@ffff962487e7aa00 x1875064559715328/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/0 e 0 to 0 dl 1788201652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201641.256978:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7aa00 with x1875064559715328 ext(915406848->916455423) 00002000:00010000:1.0:1788201641.256985:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7aa00 00000100:00100000:1.0:1788201641.257026:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 918 00000100:00100000:1.0:1788201641.257045:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559715328:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201641.258175:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201641.301910:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559715328:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 44836us (45566us total) trans 30064771919 rc 0/0 00000100:00100000:1.0:1788201641.301951:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 918 00002000:00100000:1.0:1788201641.301973:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (915406848->916455423) req@ffff962487e7aa00 x1875064559715328/t30064771919(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/448 e 0 to 0 dl 1788201652 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201641.301987:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7aa00 with x1875064559715328 ext(915406848->916455423) 00002000:00010000:1.0:1788201641.301995:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7aa00 00000100:00100000:0.0:1788201641.341833:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201641.342115:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559715456 00000100:00100000:2.0:1788201641.342131:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559715456 00002000:00100000:2.0:1788201641.342397:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (916455424->917503999) req@ffff962487e7b480 x1875064559715456/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/0 e 0 to 0 dl 1788201652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201641.342438:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b480 with x1875064559715456 ext(916455424->917503999) 00002000:00010000:2.0:1788201641.342447:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b480 00000100:00100000:2.0:1788201641.342489:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 919 00000100:00100000:2.0:1788201641.342500:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559715456:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201641.362451:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559715456:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19930us (20612us total) trans 30064771920 rc 0/0 00000100:00100000:1.0:1788201641.362475:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 919 00002000:00100000:1.0:1788201641.362495:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (916455424->917503999) req@ffff962487e7b480 x1875064559715456/t30064771920(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/448 e 0 to 0 dl 1788201652 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201641.362508:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b480 with x1875064559715456 ext(916455424->917503999) 00002000:00010000:1.0:1788201641.362519:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b480 00000100:00100000:2.0:1788201641.405460:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201641.406774:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559715584 00000100:00100000:0.0:1788201641.406792:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559715584 00002000:00100000:0.0:1788201641.406877:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (917504000->918552575) req@ffff962393aa2a00 x1875064559715584/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/0 e 0 to 0 dl 1788201652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201641.406901:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2a00 with x1875064559715584 ext(917504000->918552575) 00002000:00010000:0.0:1788201641.406908:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2a00 00000100:00100000:0.0:1788201641.406941:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 920 00000100:00100000:0.0:1788201641.406953:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559715584:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201641.431086:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559715584:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24118us (25630us total) trans 30064771921 rc 0/0 00000100:00100000:1.0:1788201641.431105:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 920 00002000:00100000:1.0:1788201641.431120:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (917504000->918552575) req@ffff962393aa2a00 x1875064559715584/t30064771921(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/448 e 0 to 0 dl 1788201652 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201641.431132:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2a00 with x1875064559715584 ext(917504000->918552575) 00002000:00010000:1.0:1788201641.431139:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2a00 00000100:00100000:0.0:1788201641.468954:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201641.469608:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559715712 00000100:00100000:1.0:1788201641.469641:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559715712 00002000:00100000:1.0:1788201641.469728:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (918552576->919601151) req@ffff962487e7b800 x1875064559715712/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/0 e 0 to 0 dl 1788201652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201641.469742:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b800 with x1875064559715712 ext(918552576->919601151) 00002000:00010000:1.0:1788201641.469749:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b800 00000100:00100000:1.0:1788201641.469801:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 921 00000100:00100000:1.0:1788201641.469814:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559715712:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201641.502982:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559715712:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33151us (34026us total) trans 30064771922 rc 0/0 00000100:00100000:1.0:1788201641.503001:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 921 00002000:00100000:1.0:1788201641.503018:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (918552576->919601151) req@ffff962487e7b800 x1875064559715712/t30064771922(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/448 e 0 to 0 dl 1788201652 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201641.503030:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b800 with x1875064559715712 ext(918552576->919601151) 00002000:00010000:1.0:1788201641.503038:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b800 00000100:00100000:1.0:1788201641.530043:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570160128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201641.530156:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201641.530601:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570160128 00000100:00100000:2.0:1788201641.530613:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570160128 00000100:00100000:2.0:1788201641.530713:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788201641.530726:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570160128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201641.530777:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201641.530859:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570160128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201641.530867:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00010000:00080000:1.0:1788201641.531207:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962485aaf100 x1875064570160128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201641.531231:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570160128:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201641.531304:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201641.709795:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201641.709905:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559715840 00000100:00100000:3.0:1788201641.709919:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559715840 00002000:00100000:3.0:1788201641.709990:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (919601152->920649727) req@ffff962393aa1180 x1875064559715840/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/0 e 0 to 0 dl 1788201652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201641.710026:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1180 with x1875064559715840 ext(919601152->920649727) 00002000:00010000:3.0:1788201641.710034:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1180 00000100:00100000:3.0:1788201641.710077:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 922 00000100:00100000:3.0:1788201641.710089:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559715840:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201641.768140:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559715840:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 58035us (58343us total) trans 30064771923 rc 0/0 00000100:00100000:0.0:1788201641.768159:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 922 00002000:00100000:0.0:1788201641.768176:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (919601152->920649727) req@ffff962393aa1180 x1875064559715840/t30064771923(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/448 e 0 to 0 dl 1788201652 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201641.768189:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1180 with x1875064559715840 ext(919601152->920649727) 00002000:00010000:0.0:1788201641.768197:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1180 00010000:00010000:2.0:1788201641.788023:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201641.852902:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201641.854024:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559715968 00000100:00100000:1.0:1788201641.854039:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559715968 00002000:00100000:1.0:1788201641.854110:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (920649728->921698303) req@ffff962393aa0700 x1875064559715968/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/0 e 0 to 0 dl 1788201652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201641.854123:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa0700 with x1875064559715968 ext(920649728->921698303) 00002000:00010000:1.0:1788201641.854145:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa0700 00000100:00100000:1.0:1788201641.854236:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 923 00000100:00100000:1.0:1788201641.854248:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559715968:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201641.869490:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559715968:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15227us (16588us total) trans 30064771924 rc 0/0 00000100:00100000:1.0:1788201641.869507:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 923 00002000:00100000:1.0:1788201641.869522:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (920649728->921698303) req@ffff962393aa0700 x1875064559715968/t30064771924(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/448 e 0 to 0 dl 1788201652 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201641.869536:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa0700 with x1875064559715968 ext(920649728->921698303) 00002000:00010000:1.0:1788201641.869544:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa0700 00000100:00100000:2.0:1788201641.966050:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201641.966189:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559716096 00000100:00100000:1.0:1788201641.966203:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559716096 00002000:00100000:1.0:1788201641.966282:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (921698304->922746879) req@ffff962393aa2300 x1875064559716096/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/0 e 0 to 0 dl 1788201652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201641.966295:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2300 with x1875064559716096 ext(921698304->922746879) 00002000:00010000:1.0:1788201641.966303:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2300 00000100:00100000:1.0:1788201641.966403:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 924 00000100:00100000:1.0:1788201641.966415:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559716096:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201642.020913:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2341:x1875064559716096:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 54482us (54863us total) trans 30064771925 rc 0/0 00000100:00100000:1.0:1788201642.020933:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 924 00002000:00100000:1.0:1788201642.020950:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (921698304->922746879) req@ffff962393aa2300 x1875064559716096/t30064771925(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:7/0 lens 488/448 e 0 to 0 dl 1788201652 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201642.020990:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2300 with x1875064559716096 ext(921698304->922746879) 00002000:00010000:1.0:1788201642.021000:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2300 00000100:00100000:0.0:1788201642.036618:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201642.038692:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559716224 00000100:00100000:2.0:1788201642.038714:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559716224 00002000:00100000:2.0:1788201642.038802:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (922746880->923795455) req@ffff962487e78000 x1875064559716224/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:8/0 lens 488/0 e 0 to 0 dl 1788201653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201642.038815:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78000 with x1875064559716224 ext(922746880->923795455) 00002000:00010000:2.0:1788201642.038822:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78000 00000100:00100000:2.0:1788201642.038862:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962487e7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570160384:0@lo:400:kworker.0 00000100:00100000:2.0:1788201642.038992:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201642.039048:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201642.039063:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962487e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570160256:0@lo:400:kworker.0 00000100:00100000:1.0:1788201642.039105:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201642.039190:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 925 00000100:00100000:1.0:1788201642.039203:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559716224:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201642.040290:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570160256 00000100:00100000:1.0:1788201642.040302:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570160256 00000100:00100000:1.0:1788201642.040338:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:1.0:1788201642.040371:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570160256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201642.040441:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570160256:12345-0@lo:400:kworker.0 Request processed in 72us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201642.040449:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:1.0:1788201642.040512:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962487e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570160256:0@lo:400:kworker.0 00000100:00100000:1.0:1788201642.068854:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559716224:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29631us (32233us total) trans 30064771926 rc 0/0 00000100:00100000:1.0:1788201642.068896:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 925 00002000:00100000:1.0:1788201642.068914:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (922746880->923795455) req@ffff962487e78000 x1875064559716224/t30064771926(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:8/0 lens 488/448 e 0 to 0 dl 1788201653 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201642.068928:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78000 with x1875064559716224 ext(922746880->923795455) 00002000:00010000:1.0:1788201642.068938:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78000 00000100:00100000:1.0:1788201642.076947:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624c1e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570160512:0@lo:400:kworker.0 00000100:00100000:0.0:1788201642.077619:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962487e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570160640:0@lo:400:kworker.0 00000100:00100000:3.0:1788201642.080207:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570160384 00000100:00100000:3.0:1788201642.080230:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570160384 00000100:00100000:3.0:1788201642.080327:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1788201642.080360:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570160384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201642.096846:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201642.097063:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962487e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570160768:0@lo:400:kworker.0 00000100:00100000:0.0:1788201642.097112:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201642.097159:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570160768 00000100:00100000:0.0:1788201642.097171:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570160768 00000100:00100000:0.0:1788201642.097241:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788201642.097271:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570160768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201642.097364:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570160768:12345-0@lo:400:kworker.0 Request processed in 95us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201642.097373:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00080000:0.0:1788201642.097425:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962487e78a80 x1875064570160768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201642.097442:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962487e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570160768:0@lo:400:kworker.0 00000100:00100000:0.0:1788201642.097535:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570160640 00000100:00100000:0.0:1788201642.097539:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570160640 00000100:00100000:0.0:1788201642.097576:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1788201642.097583:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570160640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201642.097623:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570160640:12345-0@lo:400:kworker.0 Request processed in 40us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201642.097630:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00080000:0.0:1788201642.097647:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201642.097666:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962487e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570160640:0@lo:400:kworker.0 00000100:00100000:1.0:1788201642.098286:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201642.098331:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201642.098358:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962487e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570160896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201642.098393:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201642.098948:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570160896 00000100:00100000:2.0:1788201642.098957:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570160896 00000100:00080000:3.0:1788201642.099120:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201642.099279:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570160384:12345-0@lo:400:kworker.0 Request processed in 18938us (60283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201642.099289:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1788201642.099391:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962487e7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570160384:0@lo:400:kworker.0 00000100:00100000:2.0:1788201642.099509:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1788201642.099519:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570160896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201642.099596:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570160896:12345-0@lo:400:kworker.0 Request processed in 79us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201642.099605:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1788201642.099633:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962487e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570160896:0@lo:400:kworker.0 00000100:00100000:0.0:1788201642.099814:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570160512 00000100:00100000:0.0:1788201642.099822:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570160512 00000100:00100000:0.0:1788201642.099894:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788201642.099904:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570160512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201642.099976:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570160512:12345-0@lo:400:kworker.0 Request processed in 74us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201642.099983:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788201642.100800:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624c1e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570160512:0@lo:400:kworker.0 00000100:00080000:3.0:1788201642.100889:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201642.127109:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201642.127317:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559716352 00000100:00100000:0.0:1788201642.127332:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559716352 00002000:00100000:0.0:1788201642.127441:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (923795456->924844031) req@ffff962485aaf100 x1875064559716352/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:8/0 lens 488/0 e 0 to 0 dl 1788201653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201642.127474:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaf100 with x1875064559716352 ext(923795456->924844031) 00002000:00010000:0.0:1788201642.127481:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaf100 00000100:00100000:0.0:1788201642.127514:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 926 00000100:00100000:0.0:1788201642.127526:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559716352:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201642.158509:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559716352:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30968us (31399us total) trans 30064771927 rc 0/0 00000100:00100000:1.0:1788201642.158528:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 926 00002000:00100000:1.0:1788201642.158544:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (923795456->924844031) req@ffff962485aaf100 x1875064559716352/t30064771927(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:8/0 lens 488/448 e 0 to 0 dl 1788201653 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201642.158557:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaf100 with x1875064559716352 ext(923795456->924844031) 00002000:00010000:1.0:1788201642.158565:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaf100 00000100:00100000:2.0:1788201642.348672:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201642.348820:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559716480 00000100:00100000:1.0:1788201642.348833:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559716480 00002000:00100000:1.0:1788201642.348926:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (924844032->925892607) req@ffff962393aa0380 x1875064559716480/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:8/0 lens 488/0 e 0 to 0 dl 1788201653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201642.348940:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa0380 with x1875064559716480 ext(924844032->925892607) 00002000:00010000:1.0:1788201642.348947:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa0380 00000100:00100000:1.0:1788201642.349000:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 927 00000100:00100000:1.0:1788201642.349012:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559716480:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201642.370975:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559716480:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21943us (22311us total) trans 30064771928 rc 0/0 00000100:00100000:1.0:1788201642.370996:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 927 00002000:00100000:1.0:1788201642.371013:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (924844032->925892607) req@ffff962393aa0380 x1875064559716480/t30064771928(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:8/0 lens 488/448 e 0 to 0 dl 1788201653 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201642.371045:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa0380 with x1875064559716480 ext(924844032->925892607) 00002000:00010000:1.0:1788201642.371054:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa0380 00000100:00100000:0.0:1788201642.570588:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201642.571392:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559716608 00000100:00100000:1.0:1788201642.571408:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559716608 00002000:00100000:1.0:1788201642.571612:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (925892608->926941183) req@ffff962487e79c00 x1875064559716608/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:8/0 lens 488/0 e 0 to 0 dl 1788201653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201642.571624:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79c00 with x1875064559716608 ext(925892608->926941183) 00002000:00010000:1.0:1788201642.571632:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79c00 00000100:00100000:1.0:1788201642.571680:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 928 00000100:00100000:1.0:1788201642.571693:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559716608:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201642.600020:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559716608:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28313us (29432us total) trans 30064771929 rc 0/0 00000100:00100000:1.0:1788201642.600040:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 928 00002000:00100000:1.0:1788201642.600058:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (925892608->926941183) req@ffff962487e79c00 x1875064559716608/t30064771929(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:8/0 lens 488/448 e 0 to 0 dl 1788201653 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201642.600070:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79c00 with x1875064559716608 ext(925892608->926941183) 00002000:00010000:1.0:1788201642.600079:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79c00 00000100:00100000:0.0:1788201642.802593:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201642.803608:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559716736 00000100:00100000:2.0:1788201642.803624:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559716736 00002000:00100000:2.0:1788201642.803705:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (926941184->927989759) req@ffff962487e79880 x1875064559716736/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:8/0 lens 488/0 e 0 to 0 dl 1788201653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201642.803718:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79880 with x1875064559716736 ext(926941184->927989759) 00002000:00010000:2.0:1788201642.803726:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79880 00000100:00100000:2.0:1788201642.803775:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 929 00000100:00100000:2.0:1788201642.803787:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559716736:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:2.0:1788201642.808083:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201642.831928:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559716736:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28125us (29331us total) trans 30064771930 rc 0/0 00000100:00100000:1.0:1788201642.831948:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 929 00002000:00100000:1.0:1788201642.831968:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (926941184->927989759) req@ffff962487e79880 x1875064559716736/t30064771930(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:8/0 lens 488/448 e 0 to 0 dl 1788201653 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201642.832011:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79880 with x1875064559716736 ext(926941184->927989759) 00002000:00010000:1.0:1788201642.832020:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79880 00000100:00100000:2.0:1788201643.008521:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201643.008680:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559716864 00000100:00100000:0.0:1788201643.008693:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559716864 00002000:00100000:0.0:1788201643.008779:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (927989760->929038335) req@ffff962393aa1f80 x1875064559716864/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/0 e 0 to 0 dl 1788201654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201643.008792:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1f80 with x1875064559716864 ext(927989760->929038335) 00002000:00010000:0.0:1788201643.008800:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1f80 00000100:00100000:0.0:1788201643.008846:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 930 00000100:00100000:0.0:1788201643.008867:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559716864:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201643.009428:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201643.041703:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559716864:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32818us (33179us total) trans 30064771931 rc 0/0 00000100:00100000:0.0:1788201643.041724:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 930 00002000:00100000:0.0:1788201643.041745:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (927989760->929038335) req@ffff962393aa1f80 x1875064559716864/t30064771931(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/448 e 0 to 0 dl 1788201654 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201643.041757:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1f80 with x1875064559716864 ext(927989760->929038335) 00002000:00010000:0.0:1788201643.041765:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1f80 00000100:00100000:2.0:1788201643.153905:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201643.154041:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559716992 00000100:00100000:1.0:1788201643.154055:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559716992 00002000:00100000:1.0:1788201643.154124:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (929038336->930086911) req@ffff962393aa3480 x1875064559716992/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/0 e 0 to 0 dl 1788201654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201643.154137:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa3480 with x1875064559716992 ext(929038336->930086911) 00002000:00010000:1.0:1788201643.154143:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa3480 00000100:00100000:1.0:1788201643.154187:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 931 00000100:00100000:1.0:1788201643.154198:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559716992:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201643.175964:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559716992:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21749us (22060us total) trans 30064771932 rc 0/0 00000100:00100000:3.0:1788201643.175982:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 931 00002000:00100000:3.0:1788201643.175999:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (929038336->930086911) req@ffff962393aa3480 x1875064559716992/t30064771932(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/448 e 0 to 0 dl 1788201654 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201643.176012:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa3480 with x1875064559716992 ext(929038336->930086911) 00002000:00010000:3.0:1788201643.176019:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa3480 00000100:00100000:1.0:1788201643.315708:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201643.318081:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559717120 00000100:00100000:2.0:1788201643.318102:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559717120 00002000:00100000:2.0:1788201643.318191:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (930086912->931135487) req@ffff9624c1e55f80 x1875064559717120/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/0 e 0 to 0 dl 1788201654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201643.318234:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55f80 with x1875064559717120 ext(930086912->931135487) 00002000:00010000:2.0:1788201643.318242:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55f80 00000100:00100000:2.0:1788201643.319795:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 932 00000100:00100000:2.0:1788201643.319820:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559717120:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201643.340639:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559717120:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20812us (24999us total) trans 30064771933 rc 0/0 00000100:00100000:3.0:1788201643.340657:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 932 00002000:00100000:3.0:1788201643.340672:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (930086912->931135487) req@ffff9624c1e55f80 x1875064559717120/t30064771933(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/448 e 0 to 0 dl 1788201654 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201643.340684:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55f80 with x1875064559717120 ext(930086912->931135487) 00002000:00010000:3.0:1788201643.340691:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55f80 00000100:00100000:3.0:1788201643.559386:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201643.560755:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559717248 00000100:00100000:1.0:1788201643.560774:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559717248 00002000:00100000:1.0:1788201643.561381:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (931135488->932184063) req@ffff962382b17b80 x1875064559717248/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/0 e 0 to 0 dl 1788201654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201643.561396:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17b80 with x1875064559717248 ext(931135488->932184063) 00002000:00010000:1.0:1788201643.561404:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17b80 00000100:00100000:1.0:1788201643.561456:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 933 00000100:00100000:1.0:1788201643.561469:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559717248:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201643.597690:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559717248:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36197us (38330us total) trans 30064771934 rc 0/0 00000100:00100000:2.0:1788201643.597713:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 933 00002000:00100000:2.0:1788201643.597735:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (931135488->932184063) req@ffff962382b17b80 x1875064559717248/t30064771934(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/448 e 0 to 0 dl 1788201654 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201643.597748:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17b80 with x1875064559717248 ext(931135488->932184063) 00002000:00010000:2.0:1788201643.597756:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17b80 00000100:00100000:0.0:1788201643.675082:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201643.675508:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559717376 00000100:00100000:1.0:1788201643.675524:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559717376 00002000:00100000:1.0:1788201643.675600:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (932184064->933232639) req@ffff962487e78700 x1875064559717376/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/0 e 0 to 0 dl 1788201654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201643.675965:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78700 with x1875064559717376 ext(932184064->933232639) 00002000:00010000:1.0:1788201643.675973:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78700 00000100:00100000:1.0:1788201643.676019:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 934 00000100:00100000:1.0:1788201643.676043:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559717376:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201643.694846:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559717376:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18372us (19346us total) trans 30064771935 rc 0/0 00000100:00100000:0.0:1788201643.694868:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 934 00002000:00100000:0.0:1788201643.694885:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (932184064->933232639) req@ffff962487e78700 x1875064559717376/t30064771935(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/448 e 0 to 0 dl 1788201654 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201643.694895:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78700 with x1875064559717376 ext(932184064->933232639) 00002000:00010000:0.0:1788201643.694901:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78700 00000100:00100000:3.0:1788201643.770108:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201643.770404:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559717504 00000100:00100000:0.0:1788201643.770415:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559717504 00002000:00100000:0.0:1788201643.770475:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (933232640->934281215) req@ffff962382b14a80 x1875064559717504/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/0 e 0 to 0 dl 1788201654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201643.770485:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14a80 with x1875064559717504 ext(933232640->934281215) 00002000:00010000:0.0:1788201643.770491:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14a80 00000100:00100000:0.0:1788201643.770524:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 935 00000100:00100000:0.0:1788201643.770533:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559717504:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201643.800461:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559717504:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29910us (30347us total) trans 30064771936 rc 0/0 00000100:00100000:0.0:1788201643.800481:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 935 00002000:00100000:0.0:1788201643.800499:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (933232640->934281215) req@ffff962382b14a80 x1875064559717504/t30064771936(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/448 e 0 to 0 dl 1788201654 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201643.800512:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14a80 with x1875064559717504 ext(933232640->934281215) 00002000:00010000:0.0:1788201643.800521:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14a80 00010000:00010000:1.0:1788201643.830738:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201643.868169:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201643.868276:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559717632 00000100:00100000:3.0:1788201643.868289:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559717632 00002000:00100000:3.0:1788201643.868437:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (934281216->935329791) req@ffff9624ba1d4e00 x1875064559717632/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/0 e 0 to 0 dl 1788201654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201643.868447:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d4e00 with x1875064559717632 ext(934281216->935329791) 00002000:00010000:3.0:1788201643.868453:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d4e00 00000100:00100000:3.0:1788201643.868511:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 936 00000100:00100000:3.0:1788201643.868521:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559717632:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201643.885976:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559717632:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17438us (17802us total) trans 30064771937 rc 0/0 00000100:00100000:3.0:1788201643.885993:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 936 00002000:00100000:3.0:1788201643.886009:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (934281216->935329791) req@ffff9624ba1d4e00 x1875064559717632/t30064771937(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/448 e 0 to 0 dl 1788201654 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201643.886018:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d4e00 with x1875064559717632 ext(934281216->935329791) 00002000:00010000:3.0:1788201643.886024:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d4e00 00000100:00100000:1.0:1788201643.948089:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201643.948214:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559717760 00000100:00100000:3.0:1788201643.948226:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559717760 00002000:00100000:3.0:1788201643.948289:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (935329792->936378367) req@ffff9624ba1d6680 x1875064559717760/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/0 e 0 to 0 dl 1788201654 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201643.948299:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d6680 with x1875064559717760 ext(935329792->936378367) 00002000:00010000:3.0:1788201643.948306:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d6680 00000100:00100000:3.0:1788201643.948419:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 937 00000100:00100000:3.0:1788201643.948428:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559717760:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201643.960511:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559717760:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12065us (12416us total) trans 30064771938 rc 0/0 00000100:00100000:3.0:1788201643.960530:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 937 00002000:00100000:3.0:1788201643.960546:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (935329792->936378367) req@ffff9624ba1d6680 x1875064559717760/t30064771938(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:9/0 lens 488/448 e 0 to 0 dl 1788201654 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201643.960556:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d6680 with x1875064559717760 ext(935329792->936378367) 00002000:00010000:3.0:1788201643.960563:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d6680 00000100:00100000:1.0:1788201644.037554:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201644.037689:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559717888 00000100:00100000:0.0:1788201644.037702:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559717888 00002000:00100000:0.0:1788201644.037802:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (936378368->937426943) req@ffff9624ba1d6d80 x1875064559717888/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/0 e 0 to 0 dl 1788201655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201644.037817:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d6d80 with x1875064559717888 ext(936378368->937426943) 00002000:00010000:0.0:1788201644.037824:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d6d80 00000100:00100000:0.0:1788201644.037874:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 938 00000100:00100000:0.0:1788201644.037886:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559717888:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201644.058594:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2342:x1875064559717888:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20692us (21038us total) trans 30064771939 rc 0/0 00000100:00100000:0.0:1788201644.058618:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 938 00002000:00100000:0.0:1788201644.058641:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (936378368->937426943) req@ffff9624ba1d6d80 x1875064559717888/t30064771939(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/448 e 0 to 0 dl 1788201655 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201644.058653:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d6d80 with x1875064559717888 ext(936378368->937426943) 00002000:00010000:0.0:1788201644.058662:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d6d80 00000100:00100000:1.0:1788201644.087729:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201644.087773:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962382b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570161024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201644.087884:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201644.088068:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570161024 00000100:00100000:0.0:1788201644.088078:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570161024 00000100:00100000:0.0:1788201644.088168:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788201644.088180:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570161024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201644.088209:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 572719104 pending 44302336 free 2949644288 avail 2947547136 00000100:00100000:0.0:1788201644.088268:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570161024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201644.088275:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:3.0:1788201644.088412:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201644.088517:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962382b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570161024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201644.143563:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201644.143726:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559718016 00000100:00100000:0.0:1788201644.143751:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559718016 00002000:00100000:0.0:1788201644.143823:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (937426944->938475519) req@ffff9624ba1d7100 x1875064559718016/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/0 e 0 to 0 dl 1788201655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201644.143873:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d7100 with x1875064559718016 ext(937426944->938475519) 00002000:00010000:0.0:1788201644.143880:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d7100 00000100:00100000:0.0:1788201644.143924:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 939 00000100:00100000:0.0:1788201644.143936:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559718016:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201644.159563:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2343:x1875064559718016:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15608us (15997us total) trans 30064771940 rc 0/0 00000100:00100000:0.0:1788201644.159582:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 939 00002000:00100000:0.0:1788201644.159602:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (937426944->938475519) req@ffff9624ba1d7100 x1875064559718016/t30064771940(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/448 e 0 to 0 dl 1788201655 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201644.159616:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d7100 with x1875064559718016 ext(937426944->938475519) 00002000:00010000:0.0:1788201644.159624:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d7100 00000100:00100000:3.0:1788201644.256077:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201644.256416:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559718144 00000100:00100000:2.0:1788201644.256430:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559718144 00002000:00100000:2.0:1788201644.256504:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (938475520->939524095) req@ffff962382b15f80 x1875064559718144/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/0 e 0 to 0 dl 1788201655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201644.256518:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15f80 with x1875064559718144 ext(938475520->939524095) 00002000:00010000:2.0:1788201644.256524:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15f80 00000100:00100000:2.0:1788201644.256563:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 940 00000100:00100000:2.0:1788201644.256573:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2344:x1875064559718144:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201644.270382:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2344:x1875064559718144:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13747us (14255us total) trans 30064771941 rc 0/0 00000100:00100000:2.0:1788201644.270402:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 940 00002000:00100000:2.0:1788201644.270439:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (938475520->939524095) req@ffff962382b15f80 x1875064559718144/t30064771941(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/448 e 0 to 0 dl 1788201655 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201644.270452:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15f80 with x1875064559718144 ext(938475520->939524095) 00002000:00010000:2.0:1788201644.270459:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15f80 00000100:00100000:1.0:1788201644.382242:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201644.382414:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559718272 00000100:00100000:3.0:1788201644.382429:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559718272 00002000:00100000:3.0:1788201644.382502:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (939524096->940572671) req@ffff9624ba1d4a80 x1875064559718272/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/0 e 0 to 0 dl 1788201655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201644.382515:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d4a80 with x1875064559718272 ext(939524096->940572671) 00002000:00010000:3.0:1788201644.382522:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d4a80 00000100:00100000:3.0:1788201644.382568:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 941 00000100:00100000:3.0:1788201644.382579:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2343:x1875064559718272:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201644.395708:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2343:x1875064559718272:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13114us (13466us total) trans 30064771942 rc 0/0 00000100:00100000:3.0:1788201644.395729:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 941 00002000:00100000:3.0:1788201644.397506:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (939524096->940572671) req@ffff9624ba1d4a80 x1875064559718272/t30064771942(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/448 e 0 to 0 dl 1788201655 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201644.397523:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d4a80 with x1875064559718272 ext(939524096->940572671) 00002000:00010000:3.0:1788201644.397531:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d4a80 00000100:00100000:2.0:1788201644.452526:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201644.456836:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559718400 00000100:00100000:0.0:1788201644.456859:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559718400 00002000:00100000:0.0:1788201644.456944:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (940572672->941621247) req@ffff962393aa3800 x1875064559718400/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/0 e 0 to 0 dl 1788201655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201644.456958:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa3800 with x1875064559718400 ext(940572672->941621247) 00002000:00010000:0.0:1788201644.456965:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa3800 00000100:00100000:0.0:1788201644.457069:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 942 00000100:00100000:0.0:1788201644.457082:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2341:x1875064559718400:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201644.474579:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2341:x1875064559718400:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17483us (22053us total) trans 30064771943 rc 0/0 00000100:00100000:0.0:1788201644.474597:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 942 00002000:00100000:0.0:1788201644.474630:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (940572672->941621247) req@ffff962393aa3800 x1875064559718400/t30064771943(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/448 e 0 to 0 dl 1788201655 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201644.474643:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa3800 with x1875064559718400 ext(940572672->941621247) 00002000:00010000:0.0:1788201644.474651:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa3800 00000100:00100000:3.0:1788201644.560934:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201644.563279:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559718528 00000100:00100000:0.0:1788201644.563313:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559718528 00002000:00100000:0.0:1788201644.563447:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (941621248->942669823) req@ffff962382b17800 x1875064559718528/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/0 e 0 to 0 dl 1788201655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201644.563461:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17800 with x1875064559718528 ext(941621248->942669823) 00002000:00010000:0.0:1788201644.563468:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17800 00000100:00100000:0.0:1788201644.563518:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 943 00000100:00100000:0.0:1788201644.563530:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2344:x1875064559718528:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201644.608863:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2344:x1875064559718528:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 45320us (47930us total) trans 30064771944 rc 0/0 00000100:00100000:1.0:1788201644.608880:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 943 00002000:00100000:1.0:1788201644.608897:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (941621248->942669823) req@ffff962382b17800 x1875064559718528/t30064771944(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/448 e 0 to 0 dl 1788201655 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201644.608911:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17800 with x1875064559718528 ext(941621248->942669823) 00002000:00010000:1.0:1788201644.608919:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17800 00000001:00080000:0.0:1788201644.794748:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771943 is committed 00000100:00100000:3.0:1788201644.846683:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201644.848952:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559718656 00000100:00100000:2.0:1788201644.848989:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559718656 00002000:00100000:2.0:1788201644.849075:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (942669824->943718399) req@ffff962382b14380 x1875064559718656/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/0 e 0 to 0 dl 1788201655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201644.849088:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14380 with x1875064559718656 ext(942669824->943718399) 00002000:00010000:2.0:1788201644.849094:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14380 00000100:00100000:2.0:1788201644.849143:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 944 00000100:00100000:2.0:1788201644.849155:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559718656:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:2.0:1788201644.856650:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201644.870269:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559718656:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21093us (23582us total) trans 30064771945 rc 0/0 00000100:00100000:0.0:1788201644.870289:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 944 00002000:00100000:0.0:1788201644.870320:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (942669824->943718399) req@ffff962382b14380 x1875064559718656/t30064771945(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:10/0 lens 488/448 e 0 to 0 dl 1788201655 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201644.870333:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14380 with x1875064559718656 ext(942669824->943718399) 00002000:00010000:0.0:1788201644.870355:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14380 00000100:00100000:3.0:1788201645.075704:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201645.075977:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559718784 00000100:00100000:2.0:1788201645.075995:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559718784 00002000:00100000:2.0:1788201645.076085:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (943718400->944766975) req@ffff9623bb561c00 x1875064559718784/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/0 e 0 to 0 dl 1788201656 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201645.076099:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561c00 with x1875064559718784 ext(943718400->944766975) 00002000:00010000:2.0:1788201645.076106:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561c00 00000100:00100000:2.0:1788201645.076145:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 945 00000100:00100000:2.0:1788201645.076156:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559718784:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:3.0:1788201645.077082:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201645.114970:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559718784:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 38793us (39259us total) trans 30064771946 rc 0/0 00000100:00100000:3.0:1788201645.114991:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 945 00002000:00100000:3.0:1788201645.115028:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (943718400->944766975) req@ffff9623bb561c00 x1875064559718784/t30064771946(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/448 e 0 to 0 dl 1788201656 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201645.115040:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561c00 with x1875064559718784 ext(943718400->944766975) 00002000:00010000:3.0:1788201645.115048:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561c00 00000100:00100000:0.0:1788201645.267408:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201645.267534:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559718912 00000100:00100000:1.0:1788201645.267547:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559718912 00002000:00100000:1.0:1788201645.267644:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (944766976->945815551) req@ffff962487e7a300 x1875064559718912/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/0 e 0 to 0 dl 1788201656 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201645.267659:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7a300 with x1875064559718912 ext(944766976->945815551) 00002000:00010000:1.0:1788201645.267666:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7a300 00000100:00100000:1.0:1788201645.267750:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 946 00000100:00100000:1.0:1788201645.267763:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559718912:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201645.303750:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559718912:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35973us (36341us total) trans 30064771947 rc 0/0 00000100:00100000:1.0:1788201645.303768:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 946 00002000:00100000:1.0:1788201645.303786:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (944766976->945815551) req@ffff962487e7a300 x1875064559718912/t30064771947(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/448 e 0 to 0 dl 1788201656 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201645.303800:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7a300 with x1875064559718912 ext(944766976->945815551) 00002000:00010000:1.0:1788201645.303807:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7a300 00000100:00100000:3.0:1788201645.517629:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201645.517879:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559719040 00000100:00100000:1.0:1788201645.517895:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559719040 00002000:00100000:1.0:1788201645.517978:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (945815552->946864127) req@ffff9623bb563100 x1875064559719040/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/0 e 0 to 0 dl 1788201656 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201645.517994:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb563100 with x1875064559719040 ext(945815552->946864127) 00002000:00010000:1.0:1788201645.518002:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb563100 00000100:00100000:1.0:1788201645.518049:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 947 00000100:00100000:1.0:1788201645.518062:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2341:x1875064559719040:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201645.531876:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559719040:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13797us (14244us total) trans 30064771948 rc 0/0 00000100:00100000:1.0:1788201645.531917:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 947 00002000:00100000:1.0:1788201645.531937:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (945815552->946864127) req@ffff9623bb563100 x1875064559719040/t30064771948(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/448 e 0 to 0 dl 1788201656 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201645.531949:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb563100 with x1875064559719040 ext(945815552->946864127) 00002000:00010000:1.0:1788201645.531958:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb563100 00000100:00100000:3.0:1788201645.619308:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201645.619591:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559719168 00000100:00100000:0.0:1788201645.619701:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559719168 00002000:00100000:0.0:1788201645.619776:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (946864128->947912703) req@ffff9623bb560a80 x1875064559719168/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/0 e 0 to 0 dl 1788201656 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201645.619834:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560a80 with x1875064559719168 ext(946864128->947912703) 00002000:00010000:0.0:1788201645.619842:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560a80 00000100:00100000:0.0:1788201645.619875:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 948 00000100:00100000:0.0:1788201645.619886:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559719168:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201645.643038:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559719168:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23142us (23745us total) trans 30064771949 rc 0/0 00000100:00100000:1.0:1788201645.643053:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 948 00002000:00100000:1.0:1788201645.643066:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (946864128->947912703) req@ffff9623bb560a80 x1875064559719168/t30064771949(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/448 e 0 to 0 dl 1788201656 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201645.643085:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560a80 with x1875064559719168 ext(946864128->947912703) 00002000:00010000:1.0:1788201645.643092:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560a80 00000100:00100000:3.0:1788201645.698792:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201645.698968:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559719296 00000100:00100000:2.0:1788201645.698982:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559719296 00002000:00100000:2.0:1788201645.699070:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (947912704->948961279) req@ffff9623bb563b80 x1875064559719296/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/0 e 0 to 0 dl 1788201656 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201645.699083:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb563b80 with x1875064559719296 ext(947912704->948961279) 00002000:00010000:2.0:1788201645.699090:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb563b80 00000100:00100000:2.0:1788201645.699139:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 949 00000100:00100000:2.0:1788201645.699151:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559719296:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201645.720848:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559719296:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21681us (22126us total) trans 30064771950 rc 0/0 00000100:00100000:2.0:1788201645.720867:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 949 00002000:00100000:2.0:1788201645.720882:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (947912704->948961279) req@ffff9623bb563b80 x1875064559719296/t30064771950(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/448 e 0 to 0 dl 1788201656 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201645.720892:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb563b80 with x1875064559719296 ext(947912704->948961279) 00002000:00010000:2.0:1788201645.720899:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb563b80 00000100:00100000:3.0:1788201645.795973:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201645.796116:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559719424 00000100:00100000:1.0:1788201645.796129:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559719424 00002000:00100000:1.0:1788201645.796188:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (948961280->950009855) req@ffff9623bb561880 x1875064559719424/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/0 e 0 to 0 dl 1788201656 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201645.796198:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561880 with x1875064559719424 ext(948961280->950009855) 00002000:00010000:1.0:1788201645.796204:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561880 00000100:00100000:1.0:1788201645.796239:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 950 00000100:00100000:1.0:1788201645.796247:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559719424:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201645.806293:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559719424:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10027us (10323us total) trans 30064771951 rc 0/0 00000100:00100000:0.0:1788201645.806313:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 950 00002000:00100000:0.0:1788201645.806331:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (948961280->950009855) req@ffff9623bb561880 x1875064559719424/t30064771951(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/448 e 0 to 0 dl 1788201656 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201645.806376:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561880 with x1875064559719424 ext(948961280->950009855) 00002000:00010000:0.0:1788201645.806384:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561880 00000100:00100000:3.0:1788201645.873528:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201645.873637:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201645.873785:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559719680 00000100:00100000:0.0:1788201645.873816:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559719680 00000100:00100000:0.0:1788201645.873904:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 459 00000100:00100000:0.0:1788201645.873916:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559719680:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201645.874012:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559719680:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 99us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201645.874020:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 459 00000100:00080000:1.0:1788201645.874415:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201645.874972:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559719552 00000100:00100000:2.0:1788201645.874979:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559719552 00000100:00100000:2.0:1788201645.875025:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 572 00000100:00100000:2.0:1788201645.875032:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559719552:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201645.875085:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559719552:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 54us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201645.875091:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 572 00010000:00010000:2.0:1788201645.882262:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201645.955313:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201645.956092:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559719808 00000100:00100000:1.0:1788201645.956107:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559719808 00002000:00100000:1.0:1788201645.956195:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (950009856->951058431) req@ffff9623bb561180 x1875064559719808/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/0 e 0 to 0 dl 1788201656 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201645.956209:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561180 with x1875064559719808 ext(950009856->951058431) 00002000:00010000:1.0:1788201645.956215:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561180 00000100:00100000:1.0:1788201645.956258:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 951 00000100:00100000:1.0:1788201645.956270:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559719808:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201645.977219:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559719808:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20930us (21902us total) trans 30064771952 rc 0/0 00000100:00100000:1.0:1788201645.977240:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 951 00002000:00100000:1.0:1788201645.977258:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (950009856->951058431) req@ffff9623bb561180 x1875064559719808/t30064771952(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:11/0 lens 488/448 e 0 to 0 dl 1788201656 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201645.977271:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561180 with x1875064559719808 ext(950009856->951058431) 00002000:00010000:1.0:1788201645.977278:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561180 00000100:00100000:3.0:1788201646.169012:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201646.169300:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559719936 00000100:00100000:2.0:1788201646.169315:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559719936 00002000:00100000:2.0:1788201646.169428:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (951058432->952107007) req@ffff9623bb560700 x1875064559719936/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:12/0 lens 488/0 e 0 to 0 dl 1788201657 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201646.169532:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560700 with x1875064559719936 ext(951058432->952107007) 00002000:00010000:2.0:1788201646.169539:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560700 00000100:00100000:2.0:1788201646.169645:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 952 00000100:00100000:2.0:1788201646.169658:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb560700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559719936:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201646.189249:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb560700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559719936:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19573us (20233us total) trans 30064771953 rc 0/0 00000100:00100000:2.0:1788201646.189269:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 952 00002000:00100000:2.0:1788201646.189290:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (951058432->952107007) req@ffff9623bb560700 x1875064559719936/t30064771953(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:12/0 lens 488/448 e 0 to 0 dl 1788201657 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201646.189302:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560700 with x1875064559719936 ext(951058432->952107007) 00002000:00010000:2.0:1788201646.189310:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560700 00000100:00100000:1.0:1788201646.338055:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201646.344996:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559720064 00000100:00100000:2.0:1788201646.345019:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559720064 00002000:00100000:2.0:1788201646.345104:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (952107008->953155583) req@ffff9624ba1d7b80 x1875064559720064/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:12/0 lens 488/0 e 0 to 0 dl 1788201657 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201646.345117:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d7b80 with x1875064559720064 ext(952107008->953155583) 00002000:00010000:2.0:1788201646.345124:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d7b80 00000100:00100000:2.0:1788201646.345248:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 953 00000100:00100000:2.0:1788201646.345260:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559720064:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201646.367281:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559720064:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22005us (29225us total) trans 30064771954 rc 0/0 00000100:00100000:3.0:1788201646.367303:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 953 00002000:00100000:3.0:1788201646.367320:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (952107008->953155583) req@ffff9624ba1d7b80 x1875064559720064/t30064771954(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:12/0 lens 488/448 e 0 to 0 dl 1788201657 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201646.367333:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d7b80 with x1875064559720064 ext(952107008->953155583) 00002000:00010000:3.0:1788201646.367368:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d7b80 00000100:00100000:0.0:1788201646.571907:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201646.572049:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559720192 00000100:00100000:2.0:1788201646.572064:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559720192 00002000:00100000:2.0:1788201646.572132:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (953155584->954204159) req@ffff962487e79500 x1875064559720192/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:12/0 lens 488/0 e 0 to 0 dl 1788201657 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201646.572166:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79500 with x1875064559720192 ext(953155584->954204159) 00002000:00010000:2.0:1788201646.572173:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79500 00000100:00100000:2.0:1788201646.572216:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 954 00000100:00100000:2.0:1788201646.572228:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559720192:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201646.610909:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559720192:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 38661us (39000us total) trans 30064771955 rc 0/0 00000100:00100000:2.0:1788201646.610928:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 954 00002000:00100000:2.0:1788201646.610946:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (953155584->954204159) req@ffff962487e79500 x1875064559720192/t30064771955(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:12/0 lens 488/448 e 0 to 0 dl 1788201657 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201646.610958:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e79500 with x1875064559720192 ext(953155584->954204159) 00002000:00010000:2.0:1788201646.610965:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e79500 00000100:00100000:0.0:1788201646.646923:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570161152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201646.647035:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201646.647384:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570161152 00000100:00100000:3.0:1788201646.647394:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570161152 00000100:00100000:3.0:1788201646.647468:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788201646.647480:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570161152:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201646.647604:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788201646.647660:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201646.647725:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570161152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 247us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201646.647732:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00010000:00080000:0.0:1788201646.647824:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9623bb562300 x1875064570161152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201646.647868:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570161152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201646.797517:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201646.797886:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559720320 00000100:00100000:1.0:1788201646.797901:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559720320 00002000:00100000:1.0:1788201646.797977:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (954204160->955252735) req@ffff9623bb561500 x1875064559720320/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:12/0 lens 488/0 e 0 to 0 dl 1788201657 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201646.797991:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561500 with x1875064559720320 ext(954204160->955252735) 00002000:00010000:1.0:1788201646.797999:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561500 00000100:00100000:1.0:1788201646.798038:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 955 00000100:00100000:1.0:1788201646.798051:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559720320:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201646.836622:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559720320:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 38553us (39105us total) trans 30064771956 rc 0/0 00000100:00100000:1.0:1788201646.836665:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 955 00002000:00100000:1.0:1788201646.836686:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (954204160->955252735) req@ffff9623bb561500 x1875064559720320/t30064771956(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:12/0 lens 488/448 e 0 to 0 dl 1788201657 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201646.836701:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561500 with x1875064559720320 ext(954204160->955252735) 00002000:00010000:1.0:1788201646.836709:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561500 00010000:00010000:1.0:1788201646.902875:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201646.958876:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201646.959229:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559720448 00000100:00100000:1.0:1788201646.959247:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559720448 00002000:00100000:1.0:1788201646.959376:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (955252736->956301311) req@ffff962393aa0000 x1875064559720448/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:12/0 lens 488/0 e 0 to 0 dl 1788201657 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201646.959391:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa0000 with x1875064559720448 ext(955252736->956301311) 00002000:00010000:1.0:1788201646.959397:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa0000 00000100:00100000:1.0:1788201646.959460:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 956 00000100:00100000:1.0:1788201646.959473:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559720448:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201646.986811:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559720448:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27311us (27916us total) trans 30064771957 rc 0/0 00000100:00100000:1.0:1788201646.986830:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 956 00002000:00100000:1.0:1788201646.986848:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (955252736->956301311) req@ffff962393aa0000 x1875064559720448/t30064771957(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:12/0 lens 488/448 e 0 to 0 dl 1788201657 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201646.986860:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa0000 with x1875064559720448 ext(955252736->956301311) 00002000:00010000:1.0:1788201646.986869:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa0000 00000100:00100000:0.0:1788201647.159378:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570161280:0@lo:400:kworker.0 00000100:00100000:0.0:1788201647.159486:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.159758:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570161280 00000100:00100000:3.0:1788201647.159769:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570161280 00000100:00100000:3.0:1788201647.159844:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:3.0:1788201647.159855:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570161280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.159935:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570161280:12345-0@lo:400:kworker.0 Request processed in 71us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.159944:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:3.0:1788201647.160014:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570161664:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.160070:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201647.160209:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570161280:0@lo:400:kworker.0 00000100:00100000:0.0:1788201647.160219:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570161792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201647.160249:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201647.160302:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570161792 00000100:00100000:0.0:1788201647.160306:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570161792 00000100:00100000:0.0:1788201647.160364:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788201647.160372:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570161792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201647.160413:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570161792:12345-0@lo:400:kworker.0 Request processed in 42us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201647.160419:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788201647.160616:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570161408:0@lo:400:kworker.0 00000100:00100000:2.0:1788201647.160654:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570161536:0@lo:400:kworker.0 00000100:00100000:2.0:1788201647.160692:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201647.160730:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570161664 00000100:00100000:2.0:1788201647.160734:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570161664 00000100:00100000:2.0:1788201647.160777:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1788201647.160797:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570161664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201647.160835:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570161664:12345-0@lo:400:kworker.0 Request processed in 40us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.160842:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1788201647.160862:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570161536 00000100:00100000:2.0:1788201647.160866:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570161536 00000100:00100000:2.0:1788201647.160903:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788201647.160911:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570161536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201647.160977:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.161006:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570161920:0@lo:400:kworker.0 00000100:00100000:1.0:1788201647.161032:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.161843:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570161408 00000100:00100000:1.0:1788201647.161852:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570161408 00000100:00100000:1.0:1788201647.161894:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570161920 00000100:00100000:1.0:1788201647.161898:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570161920 00000100:00100000:2.0:1788201647.162082:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570161536:12345-0@lo:400:kworker.0 Request processed in 1171us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.162092:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788201647.162119:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00010000:00080000:0.0:1788201647.162174:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9623bb560000 x1875064570161792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201647.162194:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570161792:0@lo:400:kworker.0 00000100:00080000:0.0:1788201647.162241:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201647.162247:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201647.162329:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570161664:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.162885:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570161536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201647.163582:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1788201647.170298:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570161408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201647.170657:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570161408:12345-0@lo:400:kworker.0 Request processed in 8528us (9679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.170670:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1788201647.170745:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570161408:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.179540:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201647.179729:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559720576 00000100:00100000:2.0:1788201647.179745:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559720576 00002000:00100000:2.0:1788201647.179919:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (956301312->957349887) req@ffff9623bb561f80 x1875064559720576/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:13/0 lens 488/0 e 0 to 0 dl 1788201658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201647.179941:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561f80 with x1875064559720576 ext(956301312->957349887) 00002000:00010000:2.0:1788201647.179948:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561f80 00000100:00100000:2.0:1788201647.179996:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 957 00000100:00100000:2.0:1788201647.180009:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559720576:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201647.180858:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201647.181019:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570161920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201647.182678:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570161920:12345-0@lo:400:kworker.0 Request processed in 19064us (21621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201647.182697:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1788201647.185653:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570161920:0@lo:400:kworker.0 00000100:00100000:2.0:1788201647.201846:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559720576:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21819us (22303us total) trans 30064771958 rc 0/0 00000100:00100000:2.0:1788201647.201868:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 957 00002000:00100000:2.0:1788201647.202140:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (956301312->957349887) req@ffff9623bb561f80 x1875064559720576/t30064771958(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:13/0 lens 488/448 e 0 to 0 dl 1788201658 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201647.202154:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561f80 with x1875064559720576 ext(956301312->957349887) 00002000:00010000:2.0:1788201647.202180:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561f80 00000100:00100000:0.0:1788201647.322016:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201647.322436:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559720704 00000100:00100000:2.0:1788201647.322451:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559720704 00002000:00100000:2.0:1788201647.322529:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (957349888->958398463) req@ffff962487e78a80 x1875064559720704/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:13/0 lens 488/0 e 0 to 0 dl 1788201658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201647.322543:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78a80 with x1875064559720704 ext(957349888->958398463) 00002000:00010000:2.0:1788201647.322550:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78a80 00000100:00100000:2.0:1788201647.322599:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 958 00000100:00100000:2.0:1788201647.322611:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559720704:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201647.346608:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559720704:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22428us (23040us total) trans 30064771959 rc 0/0 00000100:00100000:2.0:1788201647.346644:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 958 00002000:00100000:2.0:1788201647.346668:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (957349888->958398463) req@ffff962487e78a80 x1875064559720704/t30064771959(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:13/0 lens 488/448 e 0 to 0 dl 1788201658 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201647.346680:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78a80 with x1875064559720704 ext(957349888->958398463) 00002000:00010000:2.0:1788201647.346690:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78a80 00000100:00100000:0.0:1788201647.503969:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201647.504264:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559720832 00000100:00100000:3.0:1788201647.504278:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559720832 00002000:00100000:3.0:1788201647.504368:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (958398464->959447039) req@ffff962487e7a680 x1875064559720832/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:13/0 lens 488/0 e 0 to 0 dl 1788201658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201647.504382:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7a680 with x1875064559720832 ext(958398464->959447039) 00002000:00010000:3.0:1788201647.504399:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7a680 00000100:00100000:3.0:1788201647.504438:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 959 00000100:00100000:3.0:1788201647.504450:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559720832:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201647.528479:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559720832:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24012us (24510us total) trans 30064771960 rc 0/0 00000100:00100000:1.0:1788201647.528498:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 959 00002000:00100000:1.0:1788201647.528515:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (958398464->959447039) req@ffff962487e7a680 x1875064559720832/t30064771960(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:13/0 lens 488/448 e 0 to 0 dl 1788201658 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201647.528529:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7a680 with x1875064559720832 ext(958398464->959447039) 00002000:00010000:1.0:1788201647.528536:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7a680 00000100:00100000:0.0:1788201647.654307:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201647.655463:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559720960 00000100:00100000:1.0:1788201647.655480:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559720960 00002000:00100000:1.0:1788201647.655550:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (959447040->960495615) req@ffff962487e78e00 x1875064559720960/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:13/0 lens 488/0 e 0 to 0 dl 1788201658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201647.655564:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78e00 with x1875064559720960 ext(959447040->960495615) 00002000:00010000:1.0:1788201647.655570:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78e00 00000100:00100000:1.0:1788201647.655621:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 960 00000100:00100000:1.0:1788201647.655633:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559720960:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201647.685191:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559720960:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29544us (30885us total) trans 30064771961 rc 0/0 00000100:00100000:1.0:1788201647.685210:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 960 00002000:00100000:1.0:1788201647.685227:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (959447040->960495615) req@ffff962487e78e00 x1875064559720960/t30064771961(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:13/0 lens 488/448 e 0 to 0 dl 1788201658 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201647.685240:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78e00 with x1875064559720960 ext(959447040->960495615) 00002000:00010000:1.0:1788201647.685248:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78e00 00000100:00100000:0.0:1788201647.837651:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201647.838220:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559721088 00000100:00100000:2.0:1788201647.838235:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559721088 00002000:00100000:2.0:1788201647.838316:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (960495616->961544191) req@ffff9624ba20e300 x1875064559721088/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:13/0 lens 488/0 e 0 to 0 dl 1788201658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201647.838330:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20e300 with x1875064559721088 ext(960495616->961544191) 00002000:00010000:2.0:1788201647.838337:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20e300 00000100:00100000:2.0:1788201647.838414:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 961 00000100:00100000:2.0:1788201647.838425:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2342:x1875064559721088:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201647.865711:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2342:x1875064559721088:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27272us (28059us total) trans 30064771962 rc 0/0 00000100:00100000:2.0:1788201647.865728:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 961 00002000:00100000:2.0:1788201647.865744:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (960495616->961544191) req@ffff9624ba20e300 x1875064559721088/t30064771962(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:13/0 lens 488/448 e 0 to 0 dl 1788201658 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201647.865756:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20e300 with x1875064559721088 ext(960495616->961544191) 00002000:00010000:2.0:1788201647.865764:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20e300 00010000:00010000:2.0:1788201647.927413:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201648.015860:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201648.016861:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559721216 00000100:00100000:2.0:1788201648.016878:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559721216 00002000:00100000:2.0:1788201648.016954:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (961544192->962592767) req@ffff9623bb560e00 x1875064559721216/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:14/0 lens 488/0 e 0 to 0 dl 1788201659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201648.016967:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560e00 with x1875064559721216 ext(961544192->962592767) 00002000:00010000:2.0:1788201648.016974:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560e00 00000100:00100000:2.0:1788201648.017023:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 962 00000100:00100000:2.0:1788201648.017035:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559721216:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201648.034171:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559721216:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17117us (18307us total) trans 30064771963 rc 0/0 00000100:00100000:2.0:1788201648.034192:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 962 00002000:00100000:2.0:1788201648.034210:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (961544192->962592767) req@ffff9623bb560e00 x1875064559721216/t30064771963(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:14/0 lens 488/448 e 0 to 0 dl 1788201659 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201648.034225:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560e00 with x1875064559721216 ext(961544192->962592767) 00002000:00010000:2.0:1788201648.034234:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560e00 00000100:00100000:0.0:1788201648.317291:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201648.320752:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559721344 00000100:00100000:1.0:1788201648.320785:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559721344 00002000:00100000:1.0:1788201648.320874:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (962592768->963641343) req@ffff9624ba20d500 x1875064559721344/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:14/0 lens 488/0 e 0 to 0 dl 1788201659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201648.320889:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20d500 with x1875064559721344 ext(962592768->963641343) 00002000:00010000:1.0:1788201648.320896:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20d500 00000100:00100000:1.0:1788201648.320942:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 963 00000100:00100000:1.0:1788201648.320954:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2342:x1875064559721344:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201648.361363:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2342:x1875064559721344:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 40372us (44051us total) trans 30064771964 rc 0/0 00000100:00100000:1.0:1788201648.361381:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 963 00002000:00100000:1.0:1788201648.361399:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (962592768->963641343) req@ffff9624ba20d500 x1875064559721344/t30064771964(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:14/0 lens 488/448 e 0 to 0 dl 1788201659 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201648.361411:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20d500 with x1875064559721344 ext(962592768->963641343) 00002000:00010000:1.0:1788201648.361437:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20d500 00000100:00100000:3.0:1788201648.559152:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201648.561897:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559721472 00000100:00100000:1.0:1788201648.561921:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559721472 00002000:00100000:1.0:1788201648.562011:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (963641344->964689919) req@ffff9623bb563480 x1875064559721472/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:14/0 lens 488/0 e 0 to 0 dl 1788201659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201648.562024:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb563480 with x1875064559721472 ext(963641344->964689919) 00002000:00010000:1.0:1788201648.562031:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb563480 00000100:00100000:1.0:1788201648.562083:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 964 00000100:00100000:1.0:1788201648.562094:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2341:x1875064559721472:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201648.585660:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2341:x1875064559721472:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23554us (26511us total) trans 30064771965 rc 0/0 00000100:00100000:0.0:1788201648.585675:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 964 00002000:00100000:0.0:1788201648.585688:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (963641344->964689919) req@ffff9623bb563480 x1875064559721472/t30064771965(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:14/0 lens 488/448 e 0 to 0 dl 1788201659 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201648.585696:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb563480 with x1875064559721472 ext(963641344->964689919) 00002000:00010000:0.0:1788201648.585702:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb563480 00000100:00100000:3.0:1788201648.683020:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201648.684726:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559721600 00000100:00100000:2.0:1788201648.684747:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559721600 00002000:00100000:2.0:1788201648.684841:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (964689920->965738495) req@ffff9623bb563800 x1875064559721600/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:14/0 lens 488/0 e 0 to 0 dl 1788201659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201648.684854:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb563800 with x1875064559721600 ext(964689920->965738495) 00002000:00010000:2.0:1788201648.684862:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb563800 00000100:00100000:2.0:1788201648.684912:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 965 00000100:00100000:2.0:1788201648.684923:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2341:x1875064559721600:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201648.703955:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2341:x1875064559721600:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19014us (20934us total) trans 30064771966 rc 0/0 00000100:00100000:2.0:1788201648.703976:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 965 00002000:00100000:2.0:1788201648.703996:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (964689920->965738495) req@ffff9623bb563800 x1875064559721600/t30064771966(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:14/0 lens 488/448 e 0 to 0 dl 1788201659 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201648.704009:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb563800 with x1875064559721600 ext(964689920->965738495) 00002000:00010000:2.0:1788201648.704017:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb563800 00000100:00100000:3.0:1788201648.911958:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201648.912092:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559721728 00000100:00100000:2.0:1788201648.912105:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559721728 00002000:00100000:2.0:1788201648.912166:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (965738496->966787071) req@ffff9623bb562d80 x1875064559721728/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:14/0 lens 488/0 e 0 to 0 dl 1788201659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201648.912176:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb562d80 with x1875064559721728 ext(965738496->966787071) 00002000:00010000:2.0:1788201648.912182:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb562d80 00000100:00100000:2.0:1788201648.912214:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 966 00000100:00100000:2.0:1788201648.912232:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559721728:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201648.923205:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559721728:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10966us (11248us total) trans 30064771967 rc 0/0 00000100:00100000:2.0:1788201648.923237:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 966 00002000:00100000:2.0:1788201648.923253:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (965738496->966787071) req@ffff9623bb562d80 x1875064559721728/t30064771967(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:14/0 lens 488/448 e 0 to 0 dl 1788201659 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201648.923266:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb562d80 with x1875064559721728 ext(965738496->966787071) 00002000:00010000:2.0:1788201648.923273:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb562d80 00010000:00010000:2.0:1788201648.951165:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201649.193486:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201649.193670:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559721856 00000100:00100000:1.0:1788201649.193683:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559721856 00002000:00100000:1.0:1788201649.193789:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (966787072->967835647) req@ffff9623bb560000 x1875064559721856/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:15/0 lens 488/0 e 0 to 0 dl 1788201660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201649.193803:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560000 with x1875064559721856 ext(966787072->967835647) 00002000:00010000:1.0:1788201649.193810:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560000 00000100:00100000:1.0:1788201649.193850:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 967 00000100:00100000:1.0:1788201649.193861:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559721856:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201649.195805:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201649.206674:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba1d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570162048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201649.206865:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201649.207017:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570162048 00000100:00100000:1.0:1788201649.207027:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570162048 00000100:00100000:1.0:1788201649.207102:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788201649.207113:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570162048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201649.207144:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 570884096 pending 42598400 free 2918187008 avail 2916089856 00000100:00100000:1.0:1788201649.207198:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570162048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201649.207205:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:1.0:1788201649.207258:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201649.207302:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba1d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570162048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201649.220583:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559721856:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26703us (27090us total) trans 30064771968 rc 0/0 00000100:00100000:1.0:1788201649.220608:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 967 00002000:00100000:1.0:1788201649.220630:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (966787072->967835647) req@ffff9623bb560000 x1875064559721856/t30064771968(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:15/0 lens 488/448 e 0 to 0 dl 1788201660 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201649.220650:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560000 with x1875064559721856 ext(966787072->967835647) 00002000:00010000:1.0:1788201649.220657:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560000 00000100:00100000:2.0:1788201649.331657:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201649.338973:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559721984 00000100:00100000:0.0:1788201649.338997:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559721984 00002000:00100000:0.0:1788201649.339085:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (967835648->968884223) req@ffff962393aa2680 x1875064559721984/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:15/0 lens 488/0 e 0 to 0 dl 1788201660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201649.339094:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2680 with x1875064559721984 ext(967835648->968884223) 00002000:00010000:0.0:1788201649.339101:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2680 00000100:00100000:0.0:1788201649.339145:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 968 00000100:00100000:0.0:1788201649.339153:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559721984:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201649.351220:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2342:x1875064559721984:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12046us (19561us total) trans 30064771969 rc 0/0 00000100:00100000:0.0:1788201649.351242:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 968 00002000:00100000:0.0:1788201649.351261:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (967835648->968884223) req@ffff962393aa2680 x1875064559721984/t30064771969(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:15/0 lens 488/448 e 0 to 0 dl 1788201660 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201649.351275:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2680 with x1875064559721984 ext(967835648->968884223) 00002000:00010000:0.0:1788201649.351305:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2680 00000100:00100000:2.0:1788201649.471092:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201649.471385:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559722112 00000100:00100000:0.0:1788201649.471398:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559722112 00002000:00100000:0.0:1788201649.471470:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (798568448->799014911) req@ffff962393aa1c00 x1875064559722112/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:15/0 lens 488/0 e 0 to 0 dl 1788201660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201649.471483:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1c00 with x1875064559722112 ext(798568448->799014911) 00002000:00010000:0.0:1788201649.471490:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1c00 00000100:00100000:0.0:1788201649.471520:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 969 00000100:00100000:0.0:1788201649.471544:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2341:x1875064559722112:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201649.486174:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2341:x1875064559722112:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14620us (15084us total) trans 30064771970 rc 0/0 00000100:00100000:1.0:1788201649.486190:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 969 00002000:00100000:1.0:1788201649.486204:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (798568448->799014911) req@ffff962393aa1c00 x1875064559722112/t30064771970(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:15/0 lens 488/448 e 0 to 0 dl 1788201660 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201649.486215:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1c00 with x1875064559722112 ext(798568448->799014911) 00002000:00010000:1.0:1788201649.486221:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1c00 00000100:00100000:0.0:1788201649.492815:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201649.492992:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559722240 00000100:00100000:3.0:1788201649.493005:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559722240 00002000:00100000:3.0:1788201649.493077:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (968884224->969867263) req@ffff9624ba20df80 x1875064559722240/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:15/0 lens 488/0 e 0 to 0 dl 1788201660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201649.493090:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20df80 with x1875064559722240 ext(968884224->969867263) 00002000:00010000:3.0:1788201649.493119:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20df80 00000100:00100000:3.0:1788201649.493164:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 970 00000100:00100000:3.0:1788201649.493176:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2341:x1875064559722240:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201649.516024:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2341:x1875064559722240:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22828us (23201us total) trans 30064771971 rc 0/0 00000100:00100000:3.0:1788201649.516045:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 970 00002000:00100000:3.0:1788201649.516061:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (968884224->969867263) req@ffff9624ba20df80 x1875064559722240/t30064771971(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:15/0 lens 488/448 e 0 to 0 dl 1788201660 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201649.516074:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20df80 with x1875064559722240 ext(968884224->969867263) 00002000:00010000:3.0:1788201649.516082:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20df80 00000100:00100000:0.0:1788201649.779276:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201649.779450:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559722368 00000100:00100000:3.0:1788201649.779460:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559722368 00002000:00100000:3.0:1788201649.779649:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (969932800->970981375) req@ffff9624ba20f480 x1875064559722368/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:15/0 lens 488/0 e 0 to 0 dl 1788201660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201649.779662:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20f480 with x1875064559722368 ext(969932800->970981375) 00002000:00010000:3.0:1788201649.779670:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20f480 00000100:00100000:3.0:1788201649.779758:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 971 00000100:00100000:3.0:1788201649.779774:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2342:x1875064559722368:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201649.798038:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2342:x1875064559722368:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18261us (18762us total) trans 30064771972 rc 0/0 00000100:00100000:3.0:1788201649.798052:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 971 00002000:00100000:3.0:1788201649.798066:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (969932800->970981375) req@ffff9624ba20f480 x1875064559722368/t30064771972(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:15/0 lens 488/448 e 0 to 0 dl 1788201660 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201649.798090:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20f480 with x1875064559722368 ext(969932800->970981375) 00002000:00010000:3.0:1788201649.798096:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20f480 00000001:00080000:2.0:1788201649.842886:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771969 is committed 00000001:00080000:2.0:1788201649.842933:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771970 is committed 00000001:00080000:2.0:1788201649.843011:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064771971 is committed 00010000:00010000:1.0:1788201649.975841:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201650.009958:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201650.010118:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559722496 00000100:00100000:0.0:1788201650.010132:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559722496 00002000:00100000:0.0:1788201650.010194:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (970981376->972029951) req@ffff9623bb560380 x1875064559722496/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:16/0 lens 488/0 e 0 to 0 dl 1788201661 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201650.010206:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560380 with x1875064559722496 ext(970981376->972029951) 00002000:00010000:0.0:1788201650.010212:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560380 00000100:00100000:0.0:1788201650.010248:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 972 00000100:00100000:0.0:1788201650.010257:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb560380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559722496:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201650.023296:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb560380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559722496:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13028us (13345us total) trans 30064771973 rc 0/0 00000100:00100000:0.0:1788201650.023309:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 972 00002000:00100000:0.0:1788201650.023321:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (970981376->972029951) req@ffff9623bb560380 x1875064559722496/t30064771973(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:16/0 lens 488/448 e 0 to 0 dl 1788201661 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201650.023384:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560380 with x1875064559722496 ext(970981376->972029951) 00002000:00010000:0.0:1788201650.023391:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560380 00000100:00100000:2.0:1788201650.211401:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201650.211588:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559722624 00000100:00100000:0.0:1788201650.211603:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559722624 00002000:00100000:0.0:1788201650.211685:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (972029952->973078527) req@ffff962393aa2d80 x1875064559722624/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:16/0 lens 488/0 e 0 to 0 dl 1788201661 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201650.211699:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2d80 with x1875064559722624 ext(972029952->973078527) 00002000:00010000:0.0:1788201650.211715:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2d80 00000100:00100000:0.0:1788201650.211764:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 973 00000100:00100000:0.0:1788201650.211776:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559722624:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201650.222611:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2342:x1875064559722624:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10821us (11263us total) trans 30064771974 rc 0/0 00000100:00100000:0.0:1788201650.222631:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 973 00002000:00100000:0.0:1788201650.222645:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (972029952->973078527) req@ffff962393aa2d80 x1875064559722624/t30064771974(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:16/0 lens 488/448 e 0 to 0 dl 1788201661 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201650.222659:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2d80 with x1875064559722624 ext(972029952->973078527) 00002000:00010000:0.0:1788201650.222666:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2d80 00000100:00100000:2.0:1788201650.447310:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201650.447695:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559722752 00000100:00100000:3.0:1788201650.447708:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559722752 00002000:00100000:3.0:1788201650.447788:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (973078528->974127103) req@ffff9624c1cc6a00 x1875064559722752/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:16/0 lens 488/0 e 0 to 0 dl 1788201661 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201650.447802:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6a00 with x1875064559722752 ext(973078528->974127103) 00002000:00010000:3.0:1788201650.447810:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6a00 00000100:00100000:3.0:1788201650.447851:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 974 00000100:00100000:3.0:1788201650.447862:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559722752:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201650.484456:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559722752:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36578us (37148us total) trans 30064771975 rc 0/0 00000100:00100000:2.0:1788201650.484474:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 974 00002000:00100000:2.0:1788201650.484492:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (973078528->974127103) req@ffff9624c1cc6a00 x1875064559722752/t30064771975(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:16/0 lens 488/448 e 0 to 0 dl 1788201661 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201650.484505:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6a00 with x1875064559722752 ext(973078528->974127103) 00002000:00010000:2.0:1788201650.484514:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6a00 00000100:00100000:1.0:1788201650.612705:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201650.616444:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559722880 00000100:00100000:3.0:1788201650.616465:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559722880 00002000:00100000:3.0:1788201650.616620:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (974127104->975175679) req@ffff9624ba1d5180 x1875064559722880/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:16/0 lens 488/0 e 0 to 0 dl 1788201661 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201650.616633:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d5180 with x1875064559722880 ext(974127104->975175679) 00002000:00010000:3.0:1788201650.616640:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d5180 00000100:00100000:3.0:1788201650.616776:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 975 00000100:00100000:3.0:1788201650.616789:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559722880:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201650.634038:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559722880:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17235us (21334us total) trans 30064771976 rc 0/0 00000100:00100000:3.0:1788201650.634055:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 975 00002000:00100000:3.0:1788201650.634070:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (974127104->975175679) req@ffff9624ba1d5180 x1875064559722880/t30064771976(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:16/0 lens 488/448 e 0 to 0 dl 1788201661 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201650.634098:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d5180 with x1875064559722880 ext(974127104->975175679) 00002000:00010000:3.0:1788201650.634106:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d5180 00000100:00100000:2.0:1788201650.772517:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201650.772778:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559723008 00000100:00100000:0.0:1788201650.772792:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559723008 00002000:00100000:0.0:1788201650.772865:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (975175680->976224255) req@ffff9624c1cc5180 x1875064559723008/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:16/0 lens 488/0 e 0 to 0 dl 1788201661 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201650.772878:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5180 with x1875064559723008 ext(975175680->976224255) 00002000:00010000:0.0:1788201650.772885:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5180 00000100:00100000:0.0:1788201650.772945:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 976 00000100:00100000:0.0:1788201650.772956:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559723008:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201650.791886:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559723008:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18913us (19381us total) trans 30064771977 rc 0/0 00000100:00100000:0.0:1788201650.791908:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 976 00002000:00100000:0.0:1788201650.791927:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (975175680->976224255) req@ffff9624c1cc5180 x1875064559723008/t30064771977(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:16/0 lens 488/448 e 0 to 0 dl 1788201661 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201650.791939:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5180 with x1875064559723008 ext(975175680->976224255) 00002000:00010000:0.0:1788201650.791947:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5180 00000100:00100000:2.0:1788201650.932680:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201650.932861:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559723136 00000100:00100000:0.0:1788201650.932875:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559723136 00002000:00100000:0.0:1788201650.932947:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (976224256->977272831) req@ffff9624ba221500 x1875064559723136/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:16/0 lens 488/0 e 0 to 0 dl 1788201661 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201650.932962:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221500 with x1875064559723136 ext(976224256->977272831) 00002000:00010000:0.0:1788201650.932969:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221500 00000100:00100000:0.0:1788201650.933338:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 977 00000100:00100000:0.0:1788201650.933403:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559723136:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201650.965015:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559723136:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31599us (32336us total) trans 30064771978 rc 0/0 00000100:00100000:1.0:1788201650.965033:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 977 00002000:00100000:1.0:1788201650.965049:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (976224256->977272831) req@ffff9624ba221500 x1875064559723136/t30064771978(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:16/0 lens 488/448 e 0 to 0 dl 1788201661 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201650.965063:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221500 with x1875064559723136 ext(976224256->977272831) 00002000:00010000:1.0:1788201650.965094:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221500 00000100:00100000:1.0:1788201650.994992:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201650.995083:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201650.997260:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559723264 00000100:00100000:2.0:1788201650.997283:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559723264 00000100:00100000:2.0:1788201650.997435:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 574 00000100:00100000:2.0:1788201650.997472:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559723264:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201650.997599:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559723264:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 130us (2514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201650.997608:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 574 00000100:00100000:3.0:1788201651.002696:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559723392 00000100:00100000:3.0:1788201651.002730:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559723392 00010000:00010000:2.0:1788201651.008394:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201651.008732:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 463 00000100:00100000:0.0:1788201651.008752:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559723392:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201651.009008:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2341:x1875064559723392:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 261us (14032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201651.009017:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 463 00000100:00080000:1.0:1788201651.010673:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201651.126035:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201651.126155:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559723520 00000100:00100000:2.0:1788201651.126169:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559723520 00002000:00100000:2.0:1788201651.126328:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (977272832->978321407) req@ffff9624ba1d6300 x1875064559723520/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:17/0 lens 488/0 e 0 to 0 dl 1788201662 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201651.126377:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d6300 with x1875064559723520 ext(977272832->978321407) 00002000:00010000:2.0:1788201651.126386:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d6300 00000100:00080000:1.0:1788201651.126484:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201651.126603:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 978 00000100:00100000:2.0:1788201651.126618:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559723520:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201651.155286:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559723520:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28646us (29241us total) trans 30064771979 rc 0/0 00000100:00100000:3.0:1788201651.155311:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 978 00002000:00100000:3.0:1788201651.155335:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (977272832->978321407) req@ffff9624ba1d6300 x1875064559723520/t30064771979(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:17/0 lens 488/448 e 0 to 0 dl 1788201662 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201651.155362:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d6300 with x1875064559723520 ext(977272832->978321407) 00002000:00010000:3.0:1788201651.155371:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d6300 00000100:00100000:2.0:1788201651.276734:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201651.276893:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559723648 00000100:00100000:3.0:1788201651.276906:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559723648 00002000:00100000:3.0:1788201651.276989:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (978321408->979369983) req@ffff9624ba220380 x1875064559723648/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:17/0 lens 488/0 e 0 to 0 dl 1788201662 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201651.277004:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220380 with x1875064559723648 ext(978321408->979369983) 00002000:00010000:3.0:1788201651.277011:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220380 00000100:00100000:3.0:1788201651.277117:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 979 00000100:00100000:3.0:1788201651.277130:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559723648:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201651.287519:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559723648:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10375us (10797us total) trans 30064771980 rc 0/0 00000100:00100000:3.0:1788201651.287536:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 979 00002000:00100000:3.0:1788201651.287553:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (978321408->979369983) req@ffff9624ba220380 x1875064559723648/t30064771980(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:17/0 lens 488/448 e 0 to 0 dl 1788201662 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201651.287585:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220380 with x1875064559723648 ext(978321408->979369983) 00002000:00010000:3.0:1788201651.287593:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220380 00000100:00100000:3.0:1788201651.502872:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201651.503144:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559723776 00000100:00100000:0.0:1788201651.503176:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559723776 00002000:00100000:0.0:1788201651.503258:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (979369984->980418559) req@ffff9623bb562300 x1875064559723776/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:17/0 lens 488/0 e 0 to 0 dl 1788201662 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201651.503273:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb562300 with x1875064559723776 ext(979369984->980418559) 00002000:00010000:0.0:1788201651.503279:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb562300 00000100:00100000:0.0:1788201651.503391:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 980 00000100:00100000:0.0:1788201651.503403:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559723776:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201651.611065:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559723776:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 107648us (108198us total) trans 30064771981 rc 0/0 00000100:00100000:0.0:1788201651.611083:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 980 00002000:00100000:0.0:1788201651.611098:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (979369984->980418559) req@ffff9623bb562300 x1875064559723776/t30064771981(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:17/0 lens 488/448 e 0 to 0 dl 1788201662 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201651.611111:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb562300 with x1875064559723776 ext(979369984->980418559) 00002000:00010000:0.0:1788201651.611120:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb562300 00000100:00100000:3.0:1788201651.713937:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201651.714123:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559723904 00000100:00100000:1.0:1788201651.714137:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559723904 00002000:00100000:1.0:1788201651.714264:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (980418560->981467135) req@ffff9623bb431f80 x1875064559723904/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:17/0 lens 488/0 e 0 to 0 dl 1788201662 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201651.714277:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431f80 with x1875064559723904 ext(980418560->981467135) 00002000:00010000:1.0:1788201651.714285:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431f80 00000100:00100000:1.0:1788201651.714319:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 981 00000100:00100000:1.0:1788201651.714331:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559723904:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201651.752913:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559723904:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 38566us (38974us total) trans 30064771982 rc 0/0 00000100:00100000:2.0:1788201651.752936:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 981 00002000:00100000:2.0:1788201651.752955:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (980418560->981467135) req@ffff9623bb431f80 x1875064559723904/t30064771982(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:17/0 lens 488/448 e 0 to 0 dl 1788201662 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201651.752980:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431f80 with x1875064559723904 ext(980418560->981467135) 00002000:00010000:2.0:1788201651.752989:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431f80 00000100:00100000:0.0:1788201651.766906:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570162176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201651.767401:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201651.767948:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570162176 00000100:00100000:3.0:1788201651.768038:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570162176 00000100:00100000:3.0:1788201651.768133:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788201651.768147:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570162176:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201651.768339:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788201651.768590:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201651.768681:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570162176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 537us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201651.768690:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00010000:00080000:0.0:1788201651.769095:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9623bb433480 x1875064570162176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201651.769120:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570162176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201651.872736:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201651.877869:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559724032 00000100:00100000:3.0:1788201651.877895:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559724032 00002000:00100000:3.0:1788201651.877985:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (981467136->982515711) req@ffff9624ba1d5500 x1875064559724032/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:17/0 lens 488/0 e 0 to 0 dl 1788201662 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201651.877998:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d5500 with x1875064559724032 ext(981467136->982515711) 00002000:00010000:3.0:1788201651.878006:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d5500 00000100:00100000:3.0:1788201651.878050:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 982 00000100:00100000:3.0:1788201651.878062:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559724032:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201651.893203:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2341:x1875064559724032:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15125us (20468us total) trans 30064771983 rc 0/0 00000100:00100000:2.0:1788201651.893223:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 982 00002000:00100000:2.0:1788201651.893263:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (981467136->982515711) req@ffff9624ba1d5500 x1875064559724032/t30064771983(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:17/0 lens 488/448 e 0 to 0 dl 1788201662 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201651.893276:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d5500 with x1875064559724032 ext(981467136->982515711) 00002000:00010000:2.0:1788201651.893284:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d5500 00000100:00100000:1.0:1788201652.016844:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201652.016980:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559724160 00000100:00100000:3.0:1788201652.016995:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559724160 00002000:00100000:3.0:1788201652.017067:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (982515712->983564287) req@ffff9624ba1d4380 x1875064559724160/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/0 e 0 to 0 dl 1788201663 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201652.017110:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d4380 with x1875064559724160 ext(982515712->983564287) 00002000:00010000:3.0:1788201652.017118:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d4380 00000100:00100000:3.0:1788201652.017165:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 983 00000100:00100000:3.0:1788201652.017180:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559724160:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:2.0:1788201652.022584:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201652.034584:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559724160:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17391us (17742us total) trans 30064771984 rc 0/0 00000100:00100000:2.0:1788201652.034603:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 983 00002000:00100000:2.0:1788201652.034619:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (982515712->983564287) req@ffff9624ba1d4380 x1875064559724160/t30064771984(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/448 e 0 to 0 dl 1788201663 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201652.034632:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d4380 with x1875064559724160 ext(982515712->983564287) 00002000:00010000:2.0:1788201652.034640:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d4380 00000100:00100000:1.0:1788201652.134879:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201652.135300:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559724288 00000100:00100000:0.0:1788201652.135315:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559724288 00002000:00100000:0.0:1788201652.135419:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (983564288->984612863) req@ffff9624ba1d5f80 x1875064559724288/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/0 e 0 to 0 dl 1788201663 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201652.135433:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d5f80 with x1875064559724288 ext(983564288->984612863) 00002000:00010000:0.0:1788201652.135460:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d5f80 00000100:00100000:0.0:1788201652.135636:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 984 00000100:00100000:0.0:1788201652.135650:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559724288:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201652.152110:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559724288:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16444us (17226us total) trans 30064771985 rc 0/0 00000100:00100000:0.0:1788201652.152129:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 984 00002000:00100000:0.0:1788201652.152145:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (983564288->984612863) req@ffff9624ba1d5f80 x1875064559724288/t30064771985(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/448 e 0 to 0 dl 1788201663 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201652.152158:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d5f80 with x1875064559724288 ext(983564288->984612863) 00002000:00010000:0.0:1788201652.152167:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d5f80 00000100:00100000:3.0:1788201652.239877:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201652.240069:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559724416 00000100:00100000:2.0:1788201652.240086:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559724416 00002000:00100000:2.0:1788201652.240159:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (984612864->985661439) req@ffff9623bb433800 x1875064559724416/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/0 e 0 to 0 dl 1788201663 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201652.240183:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb433800 with x1875064559724416 ext(984612864->985661439) 00002000:00010000:2.0:1788201652.240190:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb433800 00000100:00100000:2.0:1788201652.240233:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 985 00000100:00100000:2.0:1788201652.240244:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559724416:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201652.262131:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559724416:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21867us (22251us total) trans 30064771986 rc 0/0 00000100:00100000:2.0:1788201652.262152:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 985 00002000:00100000:2.0:1788201652.262182:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (984612864->985661439) req@ffff9623bb433800 x1875064559724416/t30064771986(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/448 e 0 to 0 dl 1788201663 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201652.262220:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb433800 with x1875064559724416 ext(984612864->985661439) 00002000:00010000:2.0:1788201652.262229:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb433800 00000100:00100000:1.0:1788201652.278796:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba1d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570162432:0@lo:400:kworker.0 00000100:00100000:1.0:1788201652.278900:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201652.278975:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570162944:0@lo:400:kworker.0 00000100:00100000:1.0:1788201652.279003:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201652.279036:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201652.279042:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba1d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570162560:0@lo:400:kworker.0 00000100:00100000:1.0:1788201652.279071:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201652.279116:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570162432 00000100:00100000:1.0:1788201652.279133:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570162432 00000100:00100000:1.0:1788201652.279318:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570162944 00000100:00100000:1.0:1788201652.279322:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570162944 00000100:00100000:1.0:1788201652.279387:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1788201652.279397:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570162432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201652.279460:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570162432:12345-0@lo:400:kworker.0 Request processed in 64us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201652.279467:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1788201652.279485:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1788201652.279492:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570162944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201652.279520:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570162944:12345-0@lo:400:kworker.0 Request processed in 29us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201652.279525:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00080000:1.0:1788201652.279545:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201652.279580:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba1d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570162432:0@lo:400:kworker.0 00000100:00100000:1.0:1788201652.279590:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570162944:0@lo:400:kworker.0 00000100:00100000:3.0:1788201652.280280:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570162688:0@lo:400:kworker.0 00000100:00100000:3.0:1788201652.280329:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201652.280390:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788201652.280397:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba1d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570162304:0@lo:400:kworker.0 00000100:00100000:3.0:1788201652.280430:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201652.280458:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570162816:0@lo:400:kworker.0 00000100:00100000:3.0:1788201652.280486:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201652.280516:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570162304 00000100:00100000:3.0:1788201652.280522:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570162304 00000100:00100000:3.0:1788201652.280559:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1788201652.280566:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570162304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201652.280613:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570162304:12345-0@lo:400:kworker.0 Request processed in 47us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201652.280619:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1788201652.280752:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba1d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570162304:0@lo:400:kworker.0 00000100:00100000:2.0:1788201652.280899:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570162688 00000100:00100000:2.0:1788201652.280904:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570162688 00000100:00100000:2.0:1788201652.280950:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1788201652.280957:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570162688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201652.280996:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570162688:12345-0@lo:400:kworker.0 Request processed in 40us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201652.281002:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1788201652.281273:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570162560 00000100:00100000:0.0:1788201652.281278:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570162560 00000100:00100000:0.0:1788201652.281318:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570162816 00000100:00100000:0.0:1788201652.281320:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570162816 00000100:00100000:0.0:1788201652.281361:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788201652.281368:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570162560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201652.281412:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570162560:12345-0@lo:400:kworker.0 Request processed in 45us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201652.281419:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788201652.281430:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788201652.281435:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570162816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201652.281458:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570162816:12345-0@lo:400:kworker.0 Request processed in 24us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201652.281464:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788201652.281501:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba1d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570162560:0@lo:400:kworker.0 00000100:00080000:3.0:1788201652.281610:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201652.281615:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788201652.281636:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba285500 x1875064570162816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201652.281732:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570162816:0@lo:400:kworker.0 00000100:00100000:3.0:1788201652.281749:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570162688:0@lo:400:kworker.0 00000100:00100000:3.0:1788201652.345464:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201652.345749:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559724544 00000100:00100000:2.0:1788201652.345763:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559724544 00002000:00100000:2.0:1788201652.345833:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (985661440->986710015) req@ffff9623bb432680 x1875064559724544/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/0 e 0 to 0 dl 1788201663 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201652.345847:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb432680 with x1875064559724544 ext(985661440->986710015) 00002000:00010000:2.0:1788201652.345853:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb432680 00000100:00100000:2.0:1788201652.345883:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 986 00000100:00100000:2.0:1788201652.345894:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559724544:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201652.367107:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559724544:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21196us (21641us total) trans 30064771987 rc 0/0 00000100:00100000:2.0:1788201652.367128:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 986 00002000:00100000:2.0:1788201652.367147:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (985661440->986710015) req@ffff9623bb432680 x1875064559724544/t30064771987(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/448 e 0 to 0 dl 1788201663 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201652.367160:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb432680 with x1875064559724544 ext(985661440->986710015) 00002000:00010000:2.0:1788201652.367186:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb432680 00000100:00100000:1.0:1788201652.461241:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201652.461581:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559724672 00000100:00100000:3.0:1788201652.461594:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559724672 00002000:00100000:3.0:1788201652.461660:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (986710016->987758591) req@ffff9624ba284380 x1875064559724672/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/0 e 0 to 0 dl 1788201663 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201652.461672:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284380 with x1875064559724672 ext(986710016->987758591) 00002000:00010000:3.0:1788201652.461712:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284380 00000100:00100000:3.0:1788201652.461749:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 987 00000100:00100000:3.0:1788201652.461761:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559724672:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201652.485413:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559724672:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23636us (24170us total) trans 30064771988 rc 0/0 00000100:00100000:2.0:1788201652.485432:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 987 00002000:00100000:2.0:1788201652.485450:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (986710016->987758591) req@ffff9624ba284380 x1875064559724672/t30064771988(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/448 e 0 to 0 dl 1788201663 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201652.485463:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284380 with x1875064559724672 ext(986710016->987758591) 00002000:00010000:2.0:1788201652.485471:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284380 00000100:00100000:1.0:1788201652.588836:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201652.589071:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559724800 00000100:00100000:0.0:1788201652.589085:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559724800 00002000:00100000:0.0:1788201652.589158:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (987758592->988807167) req@ffff9624ba284000 x1875064559724800/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/0 e 0 to 0 dl 1788201663 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201652.589171:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284000 with x1875064559724800 ext(987758592->988807167) 00002000:00010000:0.0:1788201652.589177:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284000 00000100:00100000:0.0:1788201652.589218:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 988 00000100:00100000:0.0:1788201652.589230:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559724800:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201652.603943:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559724800:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14697us (15103us total) trans 30064771989 rc 0/0 00000100:00100000:0.0:1788201652.603960:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 988 00002000:00100000:0.0:1788201652.603977:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (987758592->988807167) req@ffff9624ba284000 x1875064559724800/t30064771989(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/448 e 0 to 0 dl 1788201663 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201652.603994:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284000 with x1875064559724800 ext(987758592->988807167) 00002000:00010000:0.0:1788201652.604002:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284000 00000100:00100000:3.0:1788201652.738424:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201652.738561:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559724928 00000100:00100000:2.0:1788201652.738577:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559724928 00002000:00100000:2.0:1788201652.738648:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (988807168->989855743) req@ffff9623bb432d80 x1875064559724928/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/0 e 0 to 0 dl 1788201663 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201652.738662:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb432d80 with x1875064559724928 ext(988807168->989855743) 00002000:00010000:2.0:1788201652.738669:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb432d80 00000100:00100000:2.0:1788201652.738723:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 989 00000100:00100000:2.0:1788201652.738735:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559724928:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201652.760604:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559724928:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21851us (22176us total) trans 30064771990 rc 0/0 00000100:00100000:2.0:1788201652.760627:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 989 00002000:00100000:2.0:1788201652.760650:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (988807168->989855743) req@ffff9623bb432d80 x1875064559724928/t30064771990(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/448 e 0 to 0 dl 1788201663 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201652.760663:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb432d80 with x1875064559724928 ext(988807168->989855743) 00002000:00010000:2.0:1788201652.760671:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb432d80 00000100:00100000:3.0:1788201652.977395:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201652.977548:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559725056 00000100:00100000:2.0:1788201652.977583:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559725056 00002000:00100000:2.0:1788201652.977663:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (989855744->990904319) req@ffff9623bb431c00 x1875064559725056/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/0 e 0 to 0 dl 1788201663 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201652.977676:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431c00 with x1875064559725056 ext(989855744->990904319) 00002000:00010000:2.0:1788201652.977694:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431c00 00000100:00100000:2.0:1788201652.977726:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 990 00000100:00100000:2.0:1788201652.977737:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559725056:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201652.997371:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559725056:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19600us (20004us total) trans 30064771991 rc 0/0 00000100:00100000:2.0:1788201652.997387:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 990 00002000:00100000:2.0:1788201652.997404:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (989855744->990904319) req@ffff9623bb431c00 x1875064559725056/t30064771991(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:18/0 lens 488/448 e 0 to 0 dl 1788201663 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201652.997413:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431c00 with x1875064559725056 ext(989855744->990904319) 00002000:00010000:2.0:1788201652.997419:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431c00 00010000:00010000:1.0:1788201653.046911:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201653.124609:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201653.124703:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559725184 00000100:00100000:3.0:1788201653.124717:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559725184 00000100:00080000:1.0:1788201653.124778:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1788201653.124802:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (990904320->991952895) req@ffff9624ba284e00 x1875064559725184/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:19/0 lens 488/0 e 0 to 0 dl 1788201664 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201653.124815:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284e00 with x1875064559725184 ext(990904320->991952895) 00002000:00010000:3.0:1788201653.124821:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284e00 00000100:00100000:3.0:1788201653.124903:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 991 00000100:00100000:3.0:1788201653.124918:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559725184:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201653.141076:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559725184:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16143us (16459us total) trans 30064771992 rc 0/0 00000100:00100000:2.0:1788201653.141098:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 991 00002000:00100000:2.0:1788201653.141116:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (990904320->991952895) req@ffff9624ba284e00 x1875064559725184/t30064771992(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:19/0 lens 488/448 e 0 to 0 dl 1788201664 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201653.141129:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284e00 with x1875064559725184 ext(990904320->991952895) 00002000:00010000:2.0:1788201653.141136:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284e00 00000100:00100000:3.0:1788201653.225655:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201653.226193:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559725312 00000100:00100000:0.0:1788201653.226207:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559725312 00002000:00100000:0.0:1788201653.226276:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (991952896->993001471) req@ffff9623bb433100 x1875064559725312/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:19/0 lens 488/0 e 0 to 0 dl 1788201664 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201653.226286:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb433100 with x1875064559725312 ext(991952896->993001471) 00002000:00010000:0.0:1788201653.226293:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb433100 00000100:00100000:0.0:1788201653.226337:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 992 00000100:00100000:0.0:1788201653.226391:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559725312:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201653.248660:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559725312:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22252us (23010us total) trans 30064771993 rc 0/0 00000100:00100000:0.0:1788201653.248693:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 992 00002000:00100000:0.0:1788201653.248712:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (991952896->993001471) req@ffff9623bb433100 x1875064559725312/t30064771993(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:19/0 lens 488/448 e 0 to 0 dl 1788201664 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201653.248724:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb433100 with x1875064559725312 ext(991952896->993001471) 00002000:00010000:0.0:1788201653.248732:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb433100 00000100:00100000:1.0:1788201653.391056:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201653.391129:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559725440 00000100:00100000:2.0:1788201653.391144:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559725440 00002000:00100000:2.0:1788201653.391321:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (993001472->994050047) req@ffff9624ba286680 x1875064559725440/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:19/0 lens 488/0 e 0 to 0 dl 1788201664 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201653.391488:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba286680 with x1875064559725440 ext(993001472->994050047) 00002000:00010000:2.0:1788201653.391496:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba286680 00000100:00100000:2.0:1788201653.391588:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 993 00000100:00100000:2.0:1788201653.391601:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559725440:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201653.400194:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2342:x1875064559725440:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8577us (9131us total) trans 30064771994 rc 0/0 00000100:00100000:2.0:1788201653.400215:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 993 00002000:00100000:2.0:1788201653.400235:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (993001472->994050047) req@ffff9624ba286680 x1875064559725440/t30064771994(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:19/0 lens 488/448 e 0 to 0 dl 1788201664 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201653.400248:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba286680 with x1875064559725440 ext(993001472->994050047) 00002000:00010000:2.0:1788201653.400256:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba286680 00000100:00100000:1.0:1788201653.573502:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201653.573730:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559725568 00000100:00100000:2.0:1788201653.573745:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559725568 00002000:00100000:2.0:1788201653.573816:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (994050048->995098623) req@ffff9624ba286d80 x1875064559725568/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:19/0 lens 488/0 e 0 to 0 dl 1788201664 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201653.573828:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba286d80 with x1875064559725568 ext(994050048->995098623) 00002000:00010000:2.0:1788201653.573834:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba286d80 00000100:00100000:2.0:1788201653.573952:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 994 00000100:00100000:2.0:1788201653.573965:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559725568:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201653.587569:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559725568:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12663us (13139us total) trans 30064771995 rc 0/0 00000100:00100000:2.0:1788201653.587588:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 994 00002000:00100000:2.0:1788201653.587616:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (994050048->995098623) req@ffff9624ba286d80 x1875064559725568/t30064771995(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:19/0 lens 488/448 e 0 to 0 dl 1788201664 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201653.587629:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba286d80 with x1875064559725568 ext(994050048->995098623) 00002000:00010000:2.0:1788201653.587706:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba286d80 00000100:00100000:3.0:1788201653.779991:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201653.780125:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559725696 00000100:00100000:2.0:1788201653.780135:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559725696 00002000:00100000:2.0:1788201653.780245:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (995098624->996147199) req@ffff9623bb430a80 x1875064559725696/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:19/0 lens 488/0 e 0 to 0 dl 1788201664 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201653.780255:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb430a80 with x1875064559725696 ext(995098624->996147199) 00002000:00010000:2.0:1788201653.780261:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb430a80 00000100:00100000:2.0:1788201653.780297:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 995 00000100:00100000:2.0:1788201653.780307:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559725696:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201653.803964:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559725696:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23644us (23969us total) trans 30064771996 rc 0/0 00000100:00100000:2.0:1788201653.803981:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 995 00002000:00100000:2.0:1788201653.803998:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (995098624->996147199) req@ffff9623bb430a80 x1875064559725696/t30064771996(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:19/0 lens 488/448 e 0 to 0 dl 1788201664 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201653.804009:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb430a80 with x1875064559725696 ext(995098624->996147199) 00002000:00010000:2.0:1788201653.804016:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb430a80 00000100:00100000:1.0:1788201653.961310:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201653.961566:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559725824 00000100:00100000:0.0:1788201653.961577:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559725824 00002000:00100000:0.0:1788201653.961631:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (996147200->997195775) req@ffff9624ba285c00 x1875064559725824/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:19/0 lens 488/0 e 0 to 0 dl 1788201664 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201653.961643:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba285c00 with x1875064559725824 ext(996147200->997195775) 00002000:00010000:0.0:1788201653.961649:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba285c00 00000100:00100000:0.0:1788201653.961684:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 996 00000100:00100000:0.0:1788201653.961694:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559725824:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201653.986549:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2344:x1875064559725824:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24719us (25113us total) trans 30064771997 rc 0/0 00000100:00100000:1.0:1788201653.986564:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 996 00002000:00100000:1.0:1788201653.986595:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (996147200->997195775) req@ffff9624ba285c00 x1875064559725824/t30064771997(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:19/0 lens 488/448 e 0 to 0 dl 1788201664 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201653.986606:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba285c00 with x1875064559725824 ext(996147200->997195775) 00002000:00010000:1.0:1788201653.986613:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba285c00 00010000:00010000:2.0:1788201654.070672:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201654.092750:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201654.092987:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559725952 00000100:00100000:1.0:1788201654.092998:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559725952 00002000:00100000:1.0:1788201654.093051:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (997195776->998244351) req@ffff9623bb433b80 x1875064559725952/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:20/0 lens 488/0 e 0 to 0 dl 1788201665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201654.093062:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb433b80 with x1875064559725952 ext(997195776->998244351) 00002000:00010000:1.0:1788201654.093068:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb433b80 00000100:00100000:1.0:1788201654.093108:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 997 00000100:00100000:1.0:1788201654.093117:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559725952:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201654.112727:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2343:x1875064559725952:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19597us (19972us total) trans 30064771998 rc 0/0 00000100:00100000:1.0:1788201654.112743:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 997 00002000:00100000:1.0:1788201654.112759:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (997195776->998244351) req@ffff9623bb433b80 x1875064559725952/t30064771998(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:20/0 lens 488/448 e 0 to 0 dl 1788201665 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201654.112771:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb433b80 with x1875064559725952 ext(997195776->998244351) 00002000:00010000:1.0:1788201654.112779:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb433b80 00000100:00100000:2.0:1788201654.258473:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201654.258596:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559726080 00000100:00100000:0.0:1788201654.258606:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559726080 00002000:00100000:0.0:1788201654.258665:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (998244352->999292927) req@ffff9624ba221f80 x1875064559726080/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:20/0 lens 488/0 e 0 to 0 dl 1788201665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201654.258677:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221f80 with x1875064559726080 ext(998244352->999292927) 00002000:00010000:0.0:1788201654.258683:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221f80 00000100:00100000:0.0:1788201654.258770:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 998 00000100:00100000:0.0:1788201654.258781:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2344:x1875064559726080:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201654.295191:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2344:x1875064559726080:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36393us (36710us total) trans 30064771999 rc 0/0 00000100:00100000:0.0:1788201654.295210:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 998 00002000:00100000:0.0:1788201654.295227:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (998244352->999292927) req@ffff9624ba221f80 x1875064559726080/t30064771999(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:20/0 lens 488/448 e 0 to 0 dl 1788201665 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201654.295241:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221f80 with x1875064559726080 ext(998244352->999292927) 00002000:00010000:0.0:1788201654.295248:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221f80 00000100:00100000:2.0:1788201654.327222:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570163072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201654.327326:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201654.327603:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570163072 00000100:00100000:1.0:1788201654.327615:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570163072 00000100:00100000:1.0:1788201654.328014:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788201654.328029:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570163072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201654.328064:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3407872 granted 577175552 pending 47710208 free 2889875456 avail 2887778304 00000100:00100000:1.0:1788201654.328162:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570163072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201654.328169:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788201654.331878:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570163072:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788201654.334779:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201654.428412:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201654.428540:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559726208 00000100:00100000:2.0:1788201654.428577:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559726208 00002000:00100000:2.0:1788201654.428774:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (999292928->1000341503) req@ffff9624ba284a80 x1875064559726208/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:20/0 lens 488/0 e 0 to 0 dl 1788201665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201654.428787:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284a80 with x1875064559726208 ext(999292928->1000341503) 00002000:00010000:2.0:1788201654.428846:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284a80 00000100:00100000:2.0:1788201654.428923:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 999 00000100:00100000:2.0:1788201654.428936:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2343:x1875064559726208:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201654.454271:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2343:x1875064559726208:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25321us (25855us total) trans 30064772000 rc 0/0 00000100:00100000:3.0:1788201654.454291:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 999 00002000:00100000:3.0:1788201654.454308:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (999292928->1000341503) req@ffff9624ba284a80 x1875064559726208/t30064772000(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:20/0 lens 488/448 e 0 to 0 dl 1788201665 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201654.454321:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284a80 with x1875064559726208 ext(999292928->1000341503) 00002000:00010000:3.0:1788201654.454329:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284a80 00000100:00100000:1.0:1788201654.605265:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201654.614436:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559726336 00000100:00100000:0.0:1788201654.614460:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559726336 00002000:00100000:0.0:1788201654.614547:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1000341504->1001390079) req@ffff9624ba287b80 x1875064559726336/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:20/0 lens 488/0 e 0 to 0 dl 1788201665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201654.614560:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba287b80 with x1875064559726336 ext(1000341504->1001390079) 00002000:00010000:0.0:1788201654.614567:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba287b80 00000100:00100000:0.0:1788201654.614617:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1000 00000100:00100000:0.0:1788201654.615146:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2342:x1875064559726336:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201654.636044:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2342:x1875064559726336:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20886us (30770us total) trans 30064772001 rc 0/0 00000100:00100000:0.0:1788201654.636066:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1000 00002000:00100000:0.0:1788201654.636088:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1000341504->1001390079) req@ffff9624ba287b80 x1875064559726336/t30064772001(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:20/0 lens 488/448 e 0 to 0 dl 1788201665 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201654.636099:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba287b80 with x1875064559726336 ext(1000341504->1001390079) 00002000:00010000:0.0:1788201654.636143:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba287b80 00000100:00100000:3.0:1788201654.794111:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201654.795030:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559726464 00000100:00100000:1.0:1788201654.795044:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559726464 00002000:00100000:1.0:1788201654.795123:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1001390080->1002438655) req@ffff9623bb431880 x1875064559726464/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:20/0 lens 488/0 e 0 to 0 dl 1788201665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201654.795138:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431880 with x1875064559726464 ext(1001390080->1002438655) 00002000:00010000:1.0:1788201654.795157:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431880 00000100:00100000:1.0:1788201654.795200:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1001 00000100:00100000:1.0:1788201654.795213:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2344:x1875064559726464:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201654.830849:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2344:x1875064559726464:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35619us (36846us total) trans 30064772002 rc 0/0 00000100:00100000:1.0:1788201654.830868:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1001 00002000:00100000:1.0:1788201654.830886:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1001390080->1002438655) req@ffff9623bb431880 x1875064559726464/t30064772002(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:20/0 lens 488/448 e 0 to 0 dl 1788201665 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201654.830899:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431880 with x1875064559726464 ext(1001390080->1002438655) 00002000:00010000:1.0:1788201654.830907:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431880 00000001:00080000:2.0:1788201654.957974:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772001 is committed 00000001:00080000:2.0:1788201654.958042:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772002 is committed 00000100:00100000:3.0:1788201654.992517:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201654.992715:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559726592 00000100:00100000:2.0:1788201654.992727:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559726592 00002000:00100000:2.0:1788201654.992800:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1002438656->1003487231) req@ffff9623bb432a00 x1875064559726592/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:20/0 lens 488/0 e 0 to 0 dl 1788201665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201654.992810:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb432a00 with x1875064559726592 ext(1002438656->1003487231) 00002000:00010000:2.0:1788201654.992816:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb432a00 00000100:00100000:2.0:1788201654.992887:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1002 00000100:00100000:2.0:1788201654.992901:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559726592:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201655.004799:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559726592:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11883us (12281us total) trans 30064772003 rc 0/0 00000100:00100000:0.0:1788201655.004816:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1002 00002000:00100000:0.0:1788201655.004834:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1002438656->1003487231) req@ffff9623bb432a00 x1875064559726592/t30064772003(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:20/0 lens 488/448 e 0 to 0 dl 1788201665 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201655.004846:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb432a00 with x1875064559726592 ext(1002438656->1003487231) 00002000:00010000:0.0:1788201655.004855:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb432a00 00010000:00010000:2.0:1788201655.096550:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201655.153934:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201655.154028:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559726720 00000100:00100000:3.0:1788201655.154042:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559726720 00002000:00100000:3.0:1788201655.154210:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1003487232->1004535807) req@ffff9624ba223800 x1875064559726720/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/0 e 0 to 0 dl 1788201666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201655.154224:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba223800 with x1875064559726720 ext(1003487232->1004535807) 00002000:00010000:3.0:1788201655.154231:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba223800 00000100:00100000:3.0:1788201655.154276:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1003 00000100:00100000:3.0:1788201655.154289:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559726720:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201655.156117:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201655.171632:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559726720:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17328us (17696us total) trans 30064772004 rc 0/0 00000100:00100000:3.0:1788201655.171664:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1003 00002000:00100000:3.0:1788201655.171683:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1003487232->1004535807) req@ffff9624ba223800 x1875064559726720/t30064772004(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/448 e 0 to 0 dl 1788201666 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201655.171721:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba223800 with x1875064559726720 ext(1003487232->1004535807) 00002000:00010000:3.0:1788201655.171731:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba223800 00000100:00100000:0.0:1788201655.279433:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201655.279564:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559726848 00000100:00100000:1.0:1788201655.279578:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559726848 00002000:00100000:1.0:1788201655.279664:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1004535808->1005584383) req@ffff9624ba20c000 x1875064559726848/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/0 e 0 to 0 dl 1788201666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201655.279813:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20c000 with x1875064559726848 ext(1004535808->1005584383) 00002000:00010000:1.0:1788201655.279820:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20c000 00000100:00100000:1.0:1788201655.279915:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1004 00000100:00100000:1.0:1788201655.279928:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559726848:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201655.293379:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559726848:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13438us (13945us total) trans 30064772005 rc 0/0 00000100:00100000:1.0:1788201655.293396:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1004 00002000:00100000:1.0:1788201655.293411:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1004535808->1005584383) req@ffff9624ba20c000 x1875064559726848/t30064772005(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/448 e 0 to 0 dl 1788201666 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201655.293425:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20c000 with x1875064559726848 ext(1004535808->1005584383) 00002000:00010000:1.0:1788201655.293433:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20c000 00000100:00100000:0.0:1788201655.393318:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201655.393497:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559726976 00000100:00100000:2.0:1788201655.393513:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559726976 00002000:00100000:2.0:1788201655.393587:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1005584384->1006632959) req@ffff9624ba20ce00 x1875064559726976/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/0 e 0 to 0 dl 1788201666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201655.393601:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20ce00 with x1875064559726976 ext(1005584384->1006632959) 00002000:00010000:2.0:1788201655.393608:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20ce00 00000100:00100000:2.0:1788201655.393682:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1005 00000100:00100000:2.0:1788201655.393693:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559726976:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201655.414573:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559726976:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20863us (21255us total) trans 30064772006 rc 0/0 00000100:00100000:1.0:1788201655.414592:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1005 00002000:00100000:1.0:1788201655.414610:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1005584384->1006632959) req@ffff9624ba20ce00 x1875064559726976/t30064772006(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/448 e 0 to 0 dl 1788201666 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201655.414624:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20ce00 with x1875064559726976 ext(1005584384->1006632959) 00002000:00010000:1.0:1788201655.414632:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20ce00 00000100:00100000:0.0:1788201655.495691:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201655.495832:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559727104 00000100:00100000:2.0:1788201655.495846:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559727104 00002000:00100000:2.0:1788201655.495923:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1006632960->1007681535) req@ffff9624ba20e680 x1875064559727104/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/0 e 0 to 0 dl 1788201666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201655.495935:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20e680 with x1875064559727104 ext(1006632960->1007681535) 00002000:00010000:2.0:1788201655.495942:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20e680 00000100:00100000:2.0:1788201655.495984:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1006 00000100:00100000:2.0:1788201655.495994:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559727104:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201655.518559:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559727104:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22545us (22865us total) trans 30064772007 rc 0/0 00000100:00100000:3.0:1788201655.518578:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1006 00002000:00100000:3.0:1788201655.518594:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1006632960->1007681535) req@ffff9624ba20e680 x1875064559727104/t30064772007(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/448 e 0 to 0 dl 1788201666 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201655.518607:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20e680 with x1875064559727104 ext(1006632960->1007681535) 00002000:00010000:3.0:1788201655.518616:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20e680 00000100:00100000:0.0:1788201655.609670:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201655.609821:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559727232 00000100:00100000:3.0:1788201655.609835:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559727232 00002000:00100000:3.0:1788201655.609904:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1007681536->1008730111) req@ffff9624ba20ed80 x1875064559727232/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/0 e 0 to 0 dl 1788201666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201655.609918:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20ed80 with x1875064559727232 ext(1007681536->1008730111) 00002000:00010000:3.0:1788201655.609925:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20ed80 00000100:00100000:3.0:1788201655.609967:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1007 00000100:00100000:3.0:1788201655.609978:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559727232:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201655.631782:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559727232:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21788us (22111us total) trans 30064772008 rc 0/0 00000100:00100000:2.0:1788201655.631801:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1007 00002000:00100000:2.0:1788201655.631817:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1007681536->1008730111) req@ffff9624ba20ed80 x1875064559727232/t30064772008(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/448 e 0 to 0 dl 1788201666 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201655.631830:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20ed80 with x1875064559727232 ext(1007681536->1008730111) 00002000:00010000:2.0:1788201655.631838:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20ed80 00000100:00100000:3.0:1788201655.745750:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201655.745984:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559727360 00000100:00100000:1.0:1788201655.746000:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559727360 00002000:00100000:1.0:1788201655.746082:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1008730112->1009778687) req@ffff9623bb431180 x1875064559727360/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/0 e 0 to 0 dl 1788201666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201655.746126:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431180 with x1875064559727360 ext(1008730112->1009778687) 00002000:00010000:1.0:1788201655.746134:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431180 00000100:00100000:1.0:1788201655.746178:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1008 00000100:00100000:1.0:1788201655.746191:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559727360:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201655.762843:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559727360:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16637us (17093us total) trans 30064772009 rc 0/0 00000100:00100000:1.0:1788201655.762861:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1008 00002000:00100000:1.0:1788201655.762879:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1008730112->1009778687) req@ffff9623bb431180 x1875064559727360/t30064772009(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/448 e 0 to 0 dl 1788201666 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201655.762890:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431180 with x1875064559727360 ext(1008730112->1009778687) 00002000:00010000:1.0:1788201655.762898:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431180 00000100:00100000:3.0:1788201655.863292:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201655.863432:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559727488 00000100:00100000:1.0:1788201655.863445:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559727488 00002000:00100000:1.0:1788201655.863524:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1009778688->1010827263) req@ffff9623bb430700 x1875064559727488/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/0 e 0 to 0 dl 1788201666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201655.863539:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb430700 with x1875064559727488 ext(1009778688->1010827263) 00002000:00010000:1.0:1788201655.863547:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb430700 00000100:00100000:1.0:1788201655.863593:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1009 00000100:00100000:1.0:1788201655.863605:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559727488:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201655.884170:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559727488:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20545us (20872us total) trans 30064772010 rc 0/0 00000100:00100000:1.0:1788201655.884190:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1009 00002000:00100000:1.0:1788201655.884238:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1009778688->1010827263) req@ffff9623bb430700 x1875064559727488/t30064772010(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:21/0 lens 488/448 e 0 to 0 dl 1788201666 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201655.884250:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb430700 with x1875064559727488 ext(1009778688->1010827263) 00002000:00010000:1.0:1788201655.884258:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb430700 00000100:00100000:3.0:1788201656.116523:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201656.117213:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559727616 00000100:00100000:2.0:1788201656.117226:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559727616 00002000:00100000:2.0:1788201656.117293:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1010827264->1011875839) req@ffff9623bb432300 x1875064559727616/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/0 e 0 to 0 dl 1788201667 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201656.117305:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb432300 with x1875064559727616 ext(1010827264->1011875839) 00002000:00010000:2.0:1788201656.117312:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb432300 00000100:00100000:2.0:1788201656.117396:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1010 00000100:00100000:2.0:1788201656.117544:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559727616:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:0.0:1788201656.124402:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201656.125145:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201656.126561:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559727744 00000100:00100000:2.0:1788201656.126579:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559727744 00000100:00100000:2.0:1788201656.126684:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 576 00000100:00100000:2.0:1788201656.126696:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559727744:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201656.126810:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559727744:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 117us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201656.126819:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 576 00000100:00100000:0.0:1788201656.129047:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201656.131091:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559727872 00000100:00100000:2.0:1788201656.131139:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559727872 00000100:00100000:2.0:1788201656.131254:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 467 00000100:00100000:2.0:1788201656.131268:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559727872:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201656.131400:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2344:x1875064559727872:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 135us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201656.131409:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 467 00000100:00080000:0.0:1788201656.132423:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201656.141695:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559727616:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24137us (25170us total) trans 30064772011 rc 0/0 00000100:00100000:0.0:1788201656.141714:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1010 00002000:00100000:0.0:1788201656.141730:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1010827264->1011875839) req@ffff9623bb432300 x1875064559727616/t30064772011(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/448 e 0 to 0 dl 1788201667 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201656.141742:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb432300 with x1875064559727616 ext(1010827264->1011875839) 00002000:00010000:0.0:1788201656.141751:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb432300 00000100:00100000:3.0:1788201656.208744:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201656.208974:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559728000 00000100:00100000:2.0:1788201656.208988:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559728000 00002000:00100000:2.0:1788201656.209055:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1011875840->1012924415) req@ffff9623bb431500 x1875064559728000/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/0 e 0 to 0 dl 1788201667 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201656.209311:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431500 with x1875064559728000 ext(1011875840->1012924415) 00002000:00010000:2.0:1788201656.209320:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431500 00000100:00100000:2.0:1788201656.209456:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1011 00000100:00100000:2.0:1788201656.209469:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559728000:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201656.248004:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559728000:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 38523us (39261us total) trans 30064772012 rc 0/0 00000100:00100000:2.0:1788201656.248037:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1011 00002000:00100000:2.0:1788201656.248054:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1011875840->1012924415) req@ffff9623bb431500 x1875064559728000/t30064772012(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/448 e 0 to 0 dl 1788201667 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201656.248067:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431500 with x1875064559728000 ext(1011875840->1012924415) 00002000:00010000:2.0:1788201656.248074:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431500 00000100:00100000:2.0:1788201656.405935:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201656.406075:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559728128 00000100:00100000:1.0:1788201656.406088:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559728128 00002000:00100000:1.0:1788201656.406172:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1012924416->1013972991) req@ffff9624ba220000 x1875064559728128/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/0 e 0 to 0 dl 1788201667 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201656.406186:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220000 with x1875064559728128 ext(1012924416->1013972991) 00002000:00010000:1.0:1788201656.406192:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220000 00000100:00100000:1.0:1788201656.406237:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1012 00000100:00100000:1.0:1788201656.406249:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559728128:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201656.428958:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559728128:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22694us (23023us total) trans 30064772013 rc 0/0 00000100:00100000:1.0:1788201656.428977:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1012 00002000:00100000:1.0:1788201656.428993:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1012924416->1013972991) req@ffff9624ba220000 x1875064559728128/t30064772013(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/448 e 0 to 0 dl 1788201667 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201656.429006:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220000 with x1875064559728128 ext(1012924416->1013972991) 00002000:00010000:1.0:1788201656.429014:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220000 00000100:00100000:2.0:1788201656.573979:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201656.574337:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559728256 00000100:00100000:1.0:1788201656.574384:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559728256 00002000:00100000:1.0:1788201656.574470:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1013972992->1015021567) req@ffff9624ba220e00 x1875064559728256/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/0 e 0 to 0 dl 1788201667 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201656.574485:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220e00 with x1875064559728256 ext(1013972992->1015021567) 00002000:00010000:1.0:1788201656.574511:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220e00 00000100:00100000:1.0:1788201656.574552:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1013 00000100:00100000:1.0:1788201656.574564:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559728256:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201656.595962:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559728256:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21382us (21980us total) trans 30064772014 rc 0/0 00000100:00100000:1.0:1788201656.595981:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1013 00002000:00100000:1.0:1788201656.595998:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1013972992->1015021567) req@ffff9624ba220e00 x1875064559728256/t30064772014(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/448 e 0 to 0 dl 1788201667 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201656.596011:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220e00 with x1875064559728256 ext(1013972992->1015021567) 00002000:00010000:1.0:1788201656.596018:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220e00 00000100:00100000:3.0:1788201656.694486:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201656.696245:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559728384 00000100:00100000:0.0:1788201656.696262:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559728384 00002000:00100000:0.0:1788201656.696338:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1015021568->1016070143) req@ffff9623bb430380 x1875064559728384/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/0 e 0 to 0 dl 1788201667 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201656.696419:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb430380 with x1875064559728384 ext(1015021568->1016070143) 00002000:00010000:0.0:1788201656.696428:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb430380 00000100:00100000:0.0:1788201656.696472:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1014 00000100:00100000:0.0:1788201656.696482:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559728384:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201656.705991:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559728384:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9493us (11504us total) trans 30064772015 rc 0/0 00000100:00100000:2.0:1788201656.706007:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1014 00002000:00100000:2.0:1788201656.706023:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1015021568->1016070143) req@ffff9623bb430380 x1875064559728384/t30064772015(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/448 e 0 to 0 dl 1788201667 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201656.706033:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb430380 with x1875064559728384 ext(1015021568->1016070143) 00002000:00010000:2.0:1788201656.706040:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb430380 00000100:00100000:3.0:1788201656.795560:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201656.795725:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559728512 00000100:00100000:2.0:1788201656.795739:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559728512 00002000:00100000:2.0:1788201656.795820:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1016070144->1017118719) req@ffff9623bb433480 x1875064559728512/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/0 e 0 to 0 dl 1788201667 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201656.795833:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb433480 with x1875064559728512 ext(1016070144->1017118719) 00002000:00010000:2.0:1788201656.795841:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb433480 00000100:00100000:2.0:1788201656.795888:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1015 00000100:00100000:2.0:1788201656.795900:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559728512:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201656.821587:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559728512:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25021us (25377us total) trans 30064772016 rc 0/0 00000100:00100000:3.0:1788201656.821608:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1015 00002000:00100000:3.0:1788201656.821636:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1016070144->1017118719) req@ffff9623bb433480 x1875064559728512/t30064772016(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/448 e 0 to 0 dl 1788201667 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201656.821648:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb433480 with x1875064559728512 ext(1016070144->1017118719) 00002000:00010000:3.0:1788201656.821657:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb433480 00000100:00100000:1.0:1788201656.887722:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201656.887762:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570163200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201656.887868:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201656.890750:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570163200 00000100:00100000:3.0:1788201656.890892:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570163200 00000100:00100000:3.0:1788201656.891011:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788201656.891025:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570163200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201656.891081:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201656.891312:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570163200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 289us (3443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201656.891321:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:0.0:1788201656.891564:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788201656.891649:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962393984000 x1875064570163200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201656.891697:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570163200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201656.944818:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201656.944959:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559728640 00000100:00100000:0.0:1788201656.944976:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559728640 00002000:00100000:0.0:1788201656.945049:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1017118720->1018167295) req@ffff9624ba286a00 x1875064559728640/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/0 e 0 to 0 dl 1788201667 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201656.945063:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba286a00 with x1875064559728640 ext(1017118720->1018167295) 00002000:00010000:0.0:1788201656.945071:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba286a00 00000100:00100000:0.0:1788201656.945121:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1016 00000100:00100000:0.0:1788201656.945133:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559728640:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201656.977838:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559728640:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32690us (33018us total) trans 30064772017 rc 0/0 00000100:00100000:0.0:1788201656.977856:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1016 00002000:00100000:0.0:1788201656.977873:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1017118720->1018167295) req@ffff9624ba286a00 x1875064559728640/t30064772017(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:22/0 lens 488/448 e 0 to 0 dl 1788201667 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201656.977885:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba286a00 with x1875064559728640 ext(1017118720->1018167295) 00002000:00010000:0.0:1788201656.977893:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba286a00 00000100:00100000:3.0:1788201657.102918:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201657.103230:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559728768 00000100:00100000:1.0:1788201657.103246:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559728768 00002000:00100000:1.0:1788201657.103402:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1018167296->1019215871) req@ffff962393984e00 x1875064559728768/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:23/0 lens 488/0 e 0 to 0 dl 1788201668 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201657.103415:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393984e00 with x1875064559728768 ext(1018167296->1019215871) 00002000:00010000:1.0:1788201657.103422:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393984e00 00000100:00100000:1.0:1788201657.103461:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1017 00000100:00100000:1.0:1788201657.103474:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559728768:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201657.105552:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201657.131035:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559728768:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27542us (28113us total) trans 30064772018 rc 0/0 00000100:00100000:1.0:1788201657.131083:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1017 00002000:00100000:1.0:1788201657.131113:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1018167296->1019215871) req@ffff962393984e00 x1875064559728768/t30064772018(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:23/0 lens 488/448 e 0 to 0 dl 1788201668 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201657.131126:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393984e00 with x1875064559728768 ext(1018167296->1019215871) 00002000:00010000:1.0:1788201657.131135:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393984e00 00010000:00010000:2.0:1788201657.142974:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201657.249770:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201657.249950:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559728896 00000100:00100000:0.0:1788201657.249983:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559728896 00002000:00100000:0.0:1788201657.250053:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1019215872->1020264447) req@ffff9624ba222680 x1875064559728896/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:23/0 lens 488/0 e 0 to 0 dl 1788201668 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201657.250067:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba222680 with x1875064559728896 ext(1019215872->1020264447) 00002000:00010000:0.0:1788201657.250074:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba222680 00000100:00100000:0.0:1788201657.250188:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1018 00000100:00100000:0.0:1788201657.250199:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559728896:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201657.272624:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559728896:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22397us (22852us total) trans 30064772019 rc 0/0 00000100:00100000:1.0:1788201657.272640:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1018 00002000:00100000:1.0:1788201657.272657:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1019215872->1020264447) req@ffff9624ba222680 x1875064559728896/t30064772019(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:23/0 lens 488/448 e 0 to 0 dl 1788201668 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201657.272669:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba222680 with x1875064559728896 ext(1019215872->1020264447) 00002000:00010000:1.0:1788201657.272676:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba222680 00000100:00100000:0.0:1788201657.399811:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570163712:0@lo:400:kworker.0 00000100:00100000:0.0:1788201657.399921:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201657.400001:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201657.400008:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba20f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570163328:0@lo:400:kworker.0 00000100:00100000:0.0:1788201657.400044:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201657.400068:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba20ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570163840:0@lo:400:kworker.0 00000100:00100000:0.0:1788201657.400139:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201657.400176:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba20ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570163456:0@lo:400:kworker.0 00000100:00100000:0.0:1788201657.400206:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201657.400226:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570163968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201657.400250:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570163840 00000100:00100000:0.0:1788201657.400254:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201657.400261:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570163840 00000100:00100000:0.0:1788201657.400274:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201657.400282:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570163584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201657.400308:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201657.400403:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570163712 00000100:00100000:2.0:1788201657.400405:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570163456 00000100:00100000:1.0:1788201657.400410:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570163712 00000100:00100000:2.0:1788201657.400412:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570163456 00000100:00100000:2.0:1788201657.400454:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570163968 00000100:00100000:2.0:1788201657.400458:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570163968 00000100:00100000:1.0:1788201657.400463:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1788201657.400478:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570163456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201657.400486:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1788201657.400498:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570163712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201657.400562:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570163456:12345-0@lo:400:kworker.0 Request processed in 87us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201657.400571:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570163712:12345-0@lo:400:kworker.0 Request processed in 74us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201657.400574:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1788201657.400585:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1788201657.400599:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1788201657.400616:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570163968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201657.400624:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570163328 00000100:00100000:2.0:1788201657.400630:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570163328 00000100:00100000:1.0:1788201657.400651:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570163968:12345-0@lo:400:kworker.0 Request processed in 36us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201657.400667:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1788201657.400677:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1788201657.400682:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570163328:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788201657.400702:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201657.400733:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570163328:12345-0@lo:400:kworker.0 Request processed in 55us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201657.400742:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1788201657.400752:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba20f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570163328:0@lo:400:kworker.0 00000100:00100000:1.0:1788201657.400771:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570163712:0@lo:400:kworker.0 00000100:00100000:3.0:1788201657.401169:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570163584 00000100:00100000:3.0:1788201657.401175:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570163584 00000100:00100000:0.0:1788201657.401200:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba20ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570163456:0@lo:400:kworker.0 00000100:00100000:0.0:1788201657.401217:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba20d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570163968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201657.401234:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788201657.401246:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570163840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201657.401257:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788201657.401276:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570163584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201657.401306:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570163840:12345-0@lo:400:kworker.0 Request processed in 63us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201657.401314:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788201657.401334:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570163584:12345-0@lo:400:kworker.0 Request processed in 59us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201657.401364:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788201657.401402:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570163584:0@lo:400:kworker.0 00000100:00080000:0.0:1788201657.401426:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788201657.401449:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9624ba20ea00 x1875064570163840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201657.401460:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba20ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570163840:0@lo:400:kworker.0 00000100:00100000:2.0:1788201657.406188:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201657.411790:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559729024 00000100:00100000:3.0:1788201657.411820:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559729024 00002000:00100000:3.0:1788201657.411917:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1020264448->1021313023) req@ffff9624ba222d80 x1875064559729024/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:23/0 lens 488/0 e 0 to 0 dl 1788201668 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201657.412493:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba222d80 with x1875064559729024 ext(1020264448->1021313023) 00002000:00010000:3.0:1788201657.412503:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba222d80 00000100:00100000:3.0:1788201657.412558:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1019 00000100:00100000:3.0:1788201657.412575:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2342:x1875064559729024:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201657.438823:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2342:x1875064559729024:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26236us (32633us total) trans 30064772020 rc 0/0 00000100:00100000:1.0:1788201657.438841:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1019 00002000:00100000:1.0:1788201657.438859:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1020264448->1021313023) req@ffff9624ba222d80 x1875064559729024/t30064772020(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:23/0 lens 488/448 e 0 to 0 dl 1788201668 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201657.438872:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba222d80 with x1875064559729024 ext(1020264448->1021313023) 00002000:00010000:1.0:1788201657.438880:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba222d80 00000100:00100000:2.0:1788201657.613006:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201657.613210:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559729152 00000100:00100000:1.0:1788201657.613229:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559729152 00002000:00100000:1.0:1788201657.613322:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1021313024->1022361599) req@ffff9624ba221c00 x1875064559729152/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:23/0 lens 488/0 e 0 to 0 dl 1788201668 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201657.613337:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221c00 with x1875064559729152 ext(1021313024->1022361599) 00002000:00010000:1.0:1788201657.613472:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221c00 00000100:00100000:1.0:1788201657.613595:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1020 00000100:00100000:1.0:1788201657.613619:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559729152:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201657.639330:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559729152:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25696us (26321us total) trans 30064772021 rc 0/0 00000100:00100000:1.0:1788201657.639378:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1020 00002000:00100000:1.0:1788201657.639397:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1021313024->1022361599) req@ffff9624ba221c00 x1875064559729152/t30064772021(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:23/0 lens 488/448 e 0 to 0 dl 1788201668 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201657.639427:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221c00 with x1875064559729152 ext(1021313024->1022361599) 00002000:00010000:1.0:1788201657.639435:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221c00 00000100:00100000:3.0:1788201657.758143:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201657.761685:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559729280 00000100:00100000:1.0:1788201657.761707:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559729280 00002000:00100000:1.0:1788201657.761794:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1022361600->1023410175) req@ffff962393986680 x1875064559729280/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:23/0 lens 488/0 e 0 to 0 dl 1788201668 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201657.761809:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393986680 with x1875064559729280 ext(1022361600->1023410175) 00002000:00010000:1.0:1788201657.761817:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393986680 00000100:00100000:1.0:1788201657.761953:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1021 00000100:00100000:1.0:1788201657.761966:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559729280:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201657.785469:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559729280:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23483us (27320us total) trans 30064772022 rc 0/0 00000100:00100000:1.0:1788201657.785491:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1021 00002000:00100000:1.0:1788201657.785513:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1022361600->1023410175) req@ffff962393986680 x1875064559729280/t30064772022(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:23/0 lens 488/448 e 0 to 0 dl 1788201668 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201657.785526:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393986680 with x1875064559729280 ext(1022361600->1023410175) 00002000:00010000:1.0:1788201657.785534:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393986680 00000100:00100000:0.0:1788201657.877988:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201657.878724:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559729408 00000100:00100000:1.0:1788201657.878803:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559729408 00002000:00100000:1.0:1788201657.878881:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1023410176->1024458751) req@ffff9623bb438a80 x1875064559729408/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:23/0 lens 488/0 e 0 to 0 dl 1788201668 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201657.878895:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb438a80 with x1875064559729408 ext(1023410176->1024458751) 00002000:00010000:1.0:1788201657.878901:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb438a80 00000100:00100000:1.0:1788201657.878965:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1022 00000100:00100000:1.0:1788201657.878977:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559729408:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201657.902038:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559729408:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23040us (24044us total) trans 30064772023 rc 0/0 00000100:00100000:1.0:1788201657.902060:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1022 00002000:00100000:1.0:1788201657.902090:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1023410176->1024458751) req@ffff9623bb438a80 x1875064559729408/t30064772023(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:23/0 lens 488/448 e 0 to 0 dl 1788201668 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201657.902104:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb438a80 with x1875064559729408 ext(1023410176->1024458751) 00002000:00010000:1.0:1788201657.902113:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb438a80 00000100:00100000:2.0:1788201658.033027:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201658.033125:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559729536 00000100:00100000:3.0:1788201658.033141:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559729536 00002000:00100000:3.0:1788201658.033212:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1024458752->1025507327) req@ffff9624ba223100 x1875064559729536/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/0 e 0 to 0 dl 1788201669 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201658.033225:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba223100 with x1875064559729536 ext(1024458752->1025507327) 00002000:00010000:3.0:1788201658.033232:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba223100 00000100:00100000:3.0:1788201658.033274:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1023 00000100:00100000:3.0:1788201658.033285:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559729536:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201658.062599:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559729536:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29298us (29570us total) trans 30064772024 rc 0/0 00000100:00100000:1.0:1788201658.062616:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1023 00002000:00100000:1.0:1788201658.062633:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1024458752->1025507327) req@ffff9624ba223100 x1875064559729536/t30064772024(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/448 e 0 to 0 dl 1788201669 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201658.062646:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba223100 with x1875064559729536 ext(1024458752->1025507327) 00002000:00010000:1.0:1788201658.062653:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba223100 00000100:00100000:2.0:1788201658.151016:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201658.151208:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559729664 00000100:00100000:0.0:1788201658.151222:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559729664 00002000:00100000:0.0:1788201658.151297:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1025507328->1026555903) req@ffff9624ba220a80 x1875064559729664/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/0 e 0 to 0 dl 1788201669 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201658.151309:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220a80 with x1875064559729664 ext(1025507328->1026555903) 00002000:00010000:0.0:1788201658.151315:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220a80 00000100:00100000:0.0:1788201658.151460:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1024 00000100:00100000:0.0:1788201658.151474:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559729664:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:2.0:1788201658.166684:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201658.168403:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2342:x1875064559729664:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16914us (17385us total) trans 30064772025 rc 0/0 00000100:00100000:0.0:1788201658.168422:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1024 00002000:00100000:0.0:1788201658.168441:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1025507328->1026555903) req@ffff9624ba220a80 x1875064559729664/t30064772025(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/448 e 0 to 0 dl 1788201669 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201658.168454:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220a80 with x1875064559729664 ext(1025507328->1026555903) 00002000:00010000:0.0:1788201658.168484:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220a80 00000100:00100000:2.0:1788201658.339329:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201658.339475:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559729792 00000100:00100000:1.0:1788201658.339500:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559729792 00002000:00100000:1.0:1788201658.339566:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1026555904->1027604479) req@ffff9624ba223b80 x1875064559729792/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/0 e 0 to 0 dl 1788201669 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201658.339577:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba223b80 with x1875064559729792 ext(1026555904->1027604479) 00002000:00010000:1.0:1788201658.339593:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba223b80 00000100:00100000:1.0:1788201658.339642:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1025 00000100:00100000:1.0:1788201658.339654:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559729792:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201658.364773:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559729792:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25102us (25438us total) trans 30064772026 rc 0/0 00000100:00100000:1.0:1788201658.364792:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1025 00002000:00100000:1.0:1788201658.364808:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1026555904->1027604479) req@ffff9624ba223b80 x1875064559729792/t30064772026(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/448 e 0 to 0 dl 1788201669 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201658.364822:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba223b80 with x1875064559729792 ext(1026555904->1027604479) 00002000:00010000:1.0:1788201658.364830:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba223b80 00000100:00100000:2.0:1788201658.526929:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201658.527264:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559729920 00000100:00100000:1.0:1788201658.527278:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559729920 00002000:00100000:1.0:1788201658.527451:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1027604480->1028653055) req@ffff9624ba221880 x1875064559729920/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/0 e 0 to 0 dl 1788201669 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201658.527465:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221880 with x1875064559729920 ext(1027604480->1028653055) 00002000:00010000:1.0:1788201658.527473:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221880 00000100:00100000:1.0:1788201658.528436:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1026 00000100:00100000:1.0:1788201658.528456:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559729920:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201658.554142:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559729920:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25668us (27204us total) trans 30064772027 rc 0/0 00000100:00100000:1.0:1788201658.554165:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1026 00002000:00100000:1.0:1788201658.554188:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1027604480->1028653055) req@ffff9624ba221880 x1875064559729920/t30064772027(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/448 e 0 to 0 dl 1788201669 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201658.554201:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221880 with x1875064559729920 ext(1027604480->1028653055) 00002000:00010000:1.0:1788201658.554210:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221880 00000100:00100000:3.0:1788201658.677034:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201658.682126:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559730048 00000100:00100000:1.0:1788201658.682179:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559730048 00002000:00100000:1.0:1788201658.682314:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1028653056->1029701631) req@ffff9624b9b95850 x1875064559730048/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/0 e 0 to 0 dl 1788201669 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201658.682330:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9b95850 with x1875064559730048 ext(1028653056->1029701631) 00002000:00010000:1.0:1788201658.682357:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9b95850 00000100:00100000:2.0:1788201658.683865:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1027 00000100:00100000:2.0:1788201658.683897:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9b95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559730048:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201658.703044:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9b95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559730048:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19149us (26014us total) trans 30064772028 rc 0/0 00000100:00100000:3.0:1788201658.703062:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1027 00002000:00100000:3.0:1788201658.703078:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1028653056->1029701631) req@ffff9624b9b95850 x1875064559730048/t30064772028(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/448 e 0 to 0 dl 1788201669 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201658.703090:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9b95850 with x1875064559730048 ext(1028653056->1029701631) 00002000:00010000:3.0:1788201658.703117:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9b95850 00000100:00100000:1.0:1788201658.823001:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201658.823107:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559730176 00000100:00100000:0.0:1788201658.823125:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559730176 00002000:00100000:0.0:1788201658.823197:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1029701632->1030750207) req@ffff9624ba285180 x1875064559730176/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/0 e 0 to 0 dl 1788201669 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201658.823222:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba285180 with x1875064559730176 ext(1029701632->1030750207) 00002000:00010000:0.0:1788201658.823230:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba285180 00000100:00100000:0.0:1788201658.823277:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1028 00000100:00100000:0.0:1788201658.823290:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2341:x1875064559730176:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201658.850646:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2341:x1875064559730176:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27338us (27635us total) trans 30064772029 rc 0/0 00000100:00100000:1.0:1788201658.850673:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1028 00002000:00100000:1.0:1788201658.850695:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1029701632->1030750207) req@ffff9624ba285180 x1875064559730176/t30064772029(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/448 e 0 to 0 dl 1788201669 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201658.850709:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba285180 with x1875064559730176 ext(1029701632->1030750207) 00002000:00010000:1.0:1788201658.850718:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba285180 00000100:00100000:3.0:1788201658.964472:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201658.964594:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559730304 00000100:00100000:0.0:1788201658.964608:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559730304 00002000:00100000:0.0:1788201658.964695:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1030750208->1031798783) req@ffff962393984e00 x1875064559730304/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/0 e 0 to 0 dl 1788201669 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201658.964707:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393984e00 with x1875064559730304 ext(1030750208->1031798783) 00002000:00010000:0.0:1788201658.964714:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393984e00 00000100:00100000:0.0:1788201658.964763:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1029 00000100:00100000:0.0:1788201658.964776:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2344:x1875064559730304:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201658.978271:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2344:x1875064559730304:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13480us (13801us total) trans 30064772030 rc 0/0 00000100:00100000:1.0:1788201658.978289:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1029 00002000:00100000:1.0:1788201658.978304:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1030750208->1031798783) req@ffff962393984e00 x1875064559730304/t30064772030(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:24/0 lens 488/448 e 0 to 0 dl 1788201669 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201658.978317:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393984e00 with x1875064559730304 ext(1030750208->1031798783) 00002000:00010000:1.0:1788201658.978323:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393984e00 00000100:00100000:2.0:1788201659.083617:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201659.086230:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559730432 00000100:00100000:1.0:1788201659.086252:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559730432 00002000:00100000:1.0:1788201659.086435:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1031798784->1032847359) req@ffff9624ba222a00 x1875064559730432/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:25/0 lens 488/0 e 0 to 0 dl 1788201670 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201659.086473:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba222a00 with x1875064559730432 ext(1031798784->1032847359) 00002000:00010000:1.0:1788201659.086480:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba222a00 00000100:00100000:1.0:1788201659.086537:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1030 00000100:00100000:1.0:1788201659.086552:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2344:x1875064559730432:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201659.087440:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201659.112223:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2344:x1875064559730432:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25657us (28605us total) trans 30064772031 rc 0/0 00000100:00100000:0.0:1788201659.112242:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1030 00002000:00100000:0.0:1788201659.112260:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1031798784->1032847359) req@ffff9624ba222a00 x1875064559730432/t30064772031(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:25/0 lens 488/448 e 0 to 0 dl 1788201670 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201659.112274:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba222a00 with x1875064559730432 ext(1031798784->1032847359) 00002000:00010000:0.0:1788201659.112302:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba222a00 00010000:00010000:0.0:1788201659.190820:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201659.201491:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201659.202989:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559730560 00000100:00100000:0.0:1788201659.203008:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559730560 00002000:00100000:0.0:1788201659.203096:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1032847360->1033895935) req@ffff9624ba221180 x1875064559730560/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:25/0 lens 488/0 e 0 to 0 dl 1788201670 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201659.203111:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221180 with x1875064559730560 ext(1032847360->1033895935) 00002000:00010000:0.0:1788201659.203119:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221180 00000100:00100000:0.0:1788201659.203168:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1031 00000100:00100000:0.0:1788201659.203181:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2344:x1875064559730560:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201659.226091:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2344:x1875064559730560:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22891us (24593us total) trans 30064772032 rc 0/0 00000100:00100000:0.0:1788201659.226114:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1031 00002000:00100000:0.0:1788201659.226134:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1032847360->1033895935) req@ffff9624ba221180 x1875064559730560/t30064772032(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:25/0 lens 488/448 e 0 to 0 dl 1788201670 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201659.226145:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221180 with x1875064559730560 ext(1032847360->1033895935) 00002000:00010000:0.0:1788201659.226154:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221180 00000100:00100000:1.0:1788201659.352874:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201659.353100:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559730688 00000100:00100000:2.0:1788201659.353114:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559730688 00002000:00100000:2.0:1788201659.353183:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1033895936->1034944511) req@ffff9624ba284700 x1875064559730688/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:25/0 lens 488/0 e 0 to 0 dl 1788201670 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201659.353196:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284700 with x1875064559730688 ext(1033895936->1034944511) 00002000:00010000:2.0:1788201659.353203:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284700 00000100:00100000:2.0:1788201659.353248:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1032 00000100:00100000:2.0:1788201659.353262:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2343:x1875064559730688:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201659.386137:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2343:x1875064559730688:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32863us (33262us total) trans 30064772033 rc 0/0 00000100:00100000:2.0:1788201659.386154:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1032 00002000:00100000:2.0:1788201659.386170:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1033895936->1034944511) req@ffff9624ba284700 x1875064559730688/t30064772033(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:25/0 lens 488/448 e 0 to 0 dl 1788201670 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201659.386183:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284700 with x1875064559730688 ext(1033895936->1034944511) 00002000:00010000:2.0:1788201659.386190:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284700 00000100:00100000:3.0:1788201659.447370:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201659.447403:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570164096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201659.447499:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201659.447740:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570164096 00000100:00100000:1.0:1788201659.447751:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570164096 00000100:00100000:1.0:1788201659.447845:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788201659.447866:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570164096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201659.447896:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3407872 granted 582287360 pending 52822016 free 2857369600 avail 2855272448 00000100:00080000:0.0:1788201659.448052:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201659.449170:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570164096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1300us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201659.449183:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788201659.449377:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570164096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201659.537060:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201659.537929:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559730816 00000100:00100000:1.0:1788201659.537943:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559730816 00002000:00100000:1.0:1788201659.538023:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1034944512->1035993087) req@ffff962393986d80 x1875064559730816/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:25/0 lens 488/0 e 0 to 0 dl 1788201670 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201659.538039:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393986d80 with x1875064559730816 ext(1034944512->1035993087) 00002000:00010000:1.0:1788201659.538048:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393986d80 00000100:00100000:1.0:1788201659.538095:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1033 00000100:00100000:1.0:1788201659.538107:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2342:x1875064559730816:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201659.552670:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+70:2342:x1875064559730816:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14548us (15611us total) trans 30064772034 rc 0/0 00000100:00100000:1.0:1788201659.552710:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1033 00002000:00100000:1.0:1788201659.552729:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1034944512->1035993087) req@ffff962393986d80 x1875064559730816/t30064772034(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:25/0 lens 488/448 e 0 to 0 dl 1788201670 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201659.552743:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393986d80 with x1875064559730816 ext(1034944512->1035993087) 00002000:00010000:1.0:1788201659.552752:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393986d80 00000100:00100000:2.0:1788201659.677806:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201659.679308:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559730944 00000100:00100000:0.0:1788201659.679327:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559730944 00002000:00100000:0.0:1788201659.679419:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1035993088->1037041663) req@ffff9624ba220700 x1875064559730944/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:25/0 lens 488/0 e 0 to 0 dl 1788201670 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201659.679433:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220700 with x1875064559730944 ext(1035993088->1037041663) 00002000:00010000:0.0:1788201659.679450:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220700 00000100:00100000:0.0:1788201659.679493:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1034 00000100:00100000:0.0:1788201659.679531:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+70:2344:x1875064559730944:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201659.699258:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+72:2344:x1875064559730944:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19719us (21452us total) trans 30064772035 rc 0/0 00000100:00100000:1.0:1788201659.699276:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1034 00002000:00100000:1.0:1788201659.699294:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1035993088->1037041663) req@ffff9624ba220700 x1875064559730944/t30064772035(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:25/0 lens 488/448 e 0 to 0 dl 1788201670 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201659.699307:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220700 with x1875064559730944 ext(1035993088->1037041663) 00002000:00010000:1.0:1788201659.699315:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220700 00000100:00100000:3.0:1788201659.830160:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201659.830389:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559731072 00000100:00100000:0.0:1788201659.830403:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559731072 00002000:00100000:0.0:1788201659.830492:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1037041664->1038090239) req@ffff962393985c00 x1875064559731072/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:25/0 lens 488/0 e 0 to 0 dl 1788201670 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201659.830506:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393985c00 with x1875064559731072 ext(1037041664->1038090239) 00002000:00010000:0.0:1788201659.830513:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393985c00 00000100:00100000:0.0:1788201659.830553:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1035 00000100:00100000:0.0:1788201659.830573:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+72:2343:x1875064559731072:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201659.865214:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+74:2343:x1875064559731072:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34621us (35046us total) trans 30064772036 rc 0/0 00000100:00100000:2.0:1788201659.865233:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1035 00002000:00100000:2.0:1788201659.865251:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1037041664->1038090239) req@ffff962393985c00 x1875064559731072/t30064772036(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:25/0 lens 488/448 e 0 to 0 dl 1788201670 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201659.865283:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393985c00 with x1875064559731072 ext(1037041664->1038090239) 00002000:00010000:2.0:1788201659.865291:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393985c00 00000100:00100000:2.0:1788201660.025624:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201660.025718:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559731200 00000100:00100000:2.0:1788201660.025734:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559731200 00002000:00100000:2.0:1788201660.025821:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1038090240->1039138815) req@ffff9624ba222300 x1875064559731200/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:26/0 lens 488/0 e 0 to 0 dl 1788201671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201660.025834:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba222300 with x1875064559731200 ext(1038090240->1039138815) 00002000:00010000:2.0:1788201660.025848:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba222300 00000100:00100000:3.0:1788201660.031273:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1036 00000100:00100000:3.0:1788201660.031299:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+74:2344:x1875064559731200:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201660.052380:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+76:2344:x1875064559731200:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21070us (27315us total) trans 30064772037 rc 0/0 00000100:00100000:0.0:1788201660.052403:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1036 00002000:00100000:0.0:1788201660.052426:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1038090240->1039138815) req@ffff9624ba222300 x1875064559731200/t30064772037(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:26/0 lens 488/448 e 0 to 0 dl 1788201671 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201660.052447:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba222300 with x1875064559731200 ext(1038090240->1039138815) 00002000:00010000:0.0:1788201660.052456:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba222300 00000001:00080000:2.0:1788201660.145897:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772032 is committed 00000001:00080000:2.0:1788201660.145947:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772035 is committed 00000001:00080000:2.0:1788201660.146056:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772036 is committed 00000100:00100000:1.0:1788201660.179096:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201660.179244:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559731328 00000100:00100000:0.0:1788201660.179257:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559731328 00002000:00100000:0.0:1788201660.179368:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1039138816->1040187391) req@ffff9624ba284000 x1875064559731328/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:26/0 lens 488/0 e 0 to 0 dl 1788201671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201660.179382:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284000 with x1875064559731328 ext(1039138816->1040187391) 00002000:00010000:0.0:1788201660.179390:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284000 00000100:00100000:0.0:1788201660.179430:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1037 00000100:00100000:0.0:1788201660.179451:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559731328:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201660.190040:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559731328:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10574us (10944us total) trans 30064772038 rc 0/0 00000100:00100000:1.0:1788201660.190059:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1037 00002000:00100000:1.0:1788201660.190077:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1039138816->1040187391) req@ffff9624ba284000 x1875064559731328/t30064772038(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:26/0 lens 488/448 e 0 to 0 dl 1788201671 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201660.190089:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284000 with x1875064559731328 ext(1039138816->1040187391) 00002000:00010000:1.0:1788201660.190096:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284000 00010000:00010000:2.0:1788201660.214800:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201660.378390:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201660.378467:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559731456 00000100:00100000:2.0:1788201660.378482:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559731456 00002000:00100000:2.0:1788201660.378598:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1040187392->1041235967) req@ffff962393987100 x1875064559731456/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:26/0 lens 488/0 e 0 to 0 dl 1788201671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201660.378610:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393987100 with x1875064559731456 ext(1040187392->1041235967) 00002000:00010000:2.0:1788201660.378617:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393987100 00000100:00100000:2.0:1788201660.378714:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1038 00000100:00100000:2.0:1788201660.378727:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559731456:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201660.394085:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559731456:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15340us (15729us total) trans 30064772039 rc 0/0 00000100:00100000:1.0:1788201660.394128:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1038 00002000:00100000:1.0:1788201660.395292:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1040187392->1041235967) req@ffff962393987100 x1875064559731456/t30064772039(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:26/0 lens 488/448 e 0 to 0 dl 1788201671 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201660.395307:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393987100 with x1875064559731456 ext(1040187392->1041235967) 00002000:00010000:1.0:1788201660.395316:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393987100 00000100:00100000:2.0:1788201660.586248:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201660.586716:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559731584 00000100:00100000:3.0:1788201660.586729:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559731584 00002000:00100000:3.0:1788201660.586808:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1041235968->1042284543) req@ffff9624ba221500 x1875064559731584/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:26/0 lens 488/0 e 0 to 0 dl 1788201671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201660.586821:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221500 with x1875064559731584 ext(1041235968->1042284543) 00002000:00010000:3.0:1788201660.586828:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221500 00000100:00100000:3.0:1788201660.586923:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1039 00000100:00100000:3.0:1788201660.586936:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559731584:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201660.606057:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559731584:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18838us (19537us total) trans 30064772040 rc 0/0 00000100:00100000:3.0:1788201660.606075:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1039 00002000:00100000:3.0:1788201660.606093:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1041235968->1042284543) req@ffff9624ba221500 x1875064559731584/t30064772040(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:26/0 lens 488/448 e 0 to 0 dl 1788201671 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201660.606183:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221500 with x1875064559731584 ext(1041235968->1042284543) 00002000:00010000:3.0:1788201660.606192:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221500 00000100:00100000:2.0:1788201660.852782:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201660.853040:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559731712 00000100:00100000:0.0:1788201660.853054:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559731712 00002000:00100000:0.0:1788201660.853135:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1042284544->1043333119) req@ffff9624ba220380 x1875064559731712/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:26/0 lens 488/0 e 0 to 0 dl 1788201671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201660.853150:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220380 with x1875064559731712 ext(1042284544->1043333119) 00002000:00010000:0.0:1788201660.853158:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220380 00000100:00100000:0.0:1788201660.853269:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1040 00000100:00100000:0.0:1788201660.853281:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559731712:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201660.873479:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559731712:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20181us (20696us total) trans 30064772041 rc 0/0 00000100:00100000:3.0:1788201660.873498:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1040 00002000:00100000:3.0:1788201660.873516:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1042284544->1043333119) req@ffff9624ba220380 x1875064559731712/t30064772041(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:26/0 lens 488/448 e 0 to 0 dl 1788201671 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201660.873530:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220380 with x1875064559731712 ext(1042284544->1043333119) 00002000:00010000:3.0:1788201660.873549:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220380 00000100:00100000:2.0:1788201661.080306:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201661.080500:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559731840 00000100:00100000:1.0:1788201661.080518:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559731840 00002000:00100000:1.0:1788201661.080597:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1043333120->1044381695) req@ffff9624ba221f80 x1875064559731840/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:27/0 lens 488/0 e 0 to 0 dl 1788201672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201661.080611:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221f80 with x1875064559731840 ext(1043333120->1044381695) 00002000:00010000:1.0:1788201661.080617:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221f80 00000100:00100000:1.0:1788201661.080654:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1041 00000100:00100000:1.0:1788201661.080666:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559731840:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201661.081164:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201661.094265:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559731840:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13589us (13961us total) trans 30064772042 rc 0/0 00000100:00100000:1.0:1788201661.094279:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1041 00002000:00100000:1.0:1788201661.094293:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1043333120->1044381695) req@ffff9624ba221f80 x1875064559731840/t30064772042(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:27/0 lens 488/448 e 0 to 0 dl 1788201672 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201661.094302:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221f80 with x1875064559731840 ext(1043333120->1044381695) 00002000:00010000:1.0:1788201661.094309:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221f80 00010000:00010000:2.0:1788201661.238788:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201661.241314:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201661.241553:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559731968 00000100:00100000:3.0:1788201661.241567:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559731968 00000100:00100000:3.0:1788201661.241649:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 578 00000100:00100000:3.0:1788201661.241663:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559731968:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201661.241779:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2341:x1875064559731968:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 120us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201661.241789:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 578 00000100:00100000:2.0:1788201661.257326:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201661.257548:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559732096 00000100:00100000:0.0:1788201661.257564:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559732096 00000100:00100000:0.0:1788201661.257668:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 471 00000100:00100000:0.0:1788201661.257684:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559732096:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201661.261632:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:2342:x1875064559732096:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 3934us (4314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201661.261653:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 471 00000100:00080000:1.0:1788201661.262375:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201661.280672:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201661.280930:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559732224 00000100:00100000:1.0:1788201661.280952:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559732224 00002000:00100000:1.0:1788201661.281043:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1044381696->1045430271) req@ffff9623bb43bb80 x1875064559732224/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:27/0 lens 488/0 e 0 to 0 dl 1788201672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201661.281057:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb43bb80 with x1875064559732224 ext(1044381696->1045430271) 00002000:00010000:1.0:1788201661.281065:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb43bb80 00000100:00100000:1.0:1788201661.281110:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1042 00000100:00100000:1.0:1788201661.281123:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559732224:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201661.299505:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559732224:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18367us (18831us total) trans 30064772043 rc 0/0 00000100:00100000:1.0:1788201661.301463:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1042 00002000:00100000:1.0:1788201661.301487:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1044381696->1045430271) req@ffff9623bb43bb80 x1875064559732224/t30064772043(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:27/0 lens 488/448 e 0 to 0 dl 1788201672 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201661.301501:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb43bb80 with x1875064559732224 ext(1044381696->1045430271) 00002000:00010000:1.0:1788201661.301511:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb43bb80 00000100:00100000:3.0:1788201661.441807:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201661.444477:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559732352 00000100:00100000:2.0:1788201661.444500:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559732352 00002000:00100000:2.0:1788201661.444596:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1045430272->1046478847) req@ffff962393984a80 x1875064559732352/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:27/0 lens 488/0 e 0 to 0 dl 1788201672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201661.444611:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393984a80 with x1875064559732352 ext(1045430272->1046478847) 00002000:00010000:2.0:1788201661.444617:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393984a80 00000100:00100000:2.0:1788201661.444750:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1043 00000100:00100000:2.0:1788201661.444764:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559732352:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201661.460550:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559732352:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15765us (18735us total) trans 30064772044 rc 0/0 00000100:00100000:2.0:1788201661.460569:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1043 00002000:00100000:2.0:1788201661.460586:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1045430272->1046478847) req@ffff962393984a80 x1875064559732352/t30064772044(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:27/0 lens 488/448 e 0 to 0 dl 1788201672 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201661.460599:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393984a80 with x1875064559732352 ext(1045430272->1046478847) 00002000:00010000:2.0:1788201661.460606:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393984a80 00000100:00100000:3.0:1788201661.646714:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201661.646857:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559732480 00000100:00100000:0.0:1788201661.646871:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559732480 00002000:00100000:0.0:1788201661.646955:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1046478848->1047527423) req@ffff962393987b80 x1875064559732480/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:27/0 lens 488/0 e 0 to 0 dl 1788201672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201661.646969:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393987b80 with x1875064559732480 ext(1046478848->1047527423) 00002000:00010000:0.0:1788201661.646977:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393987b80 00000100:00100000:0.0:1788201661.647026:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1044 00000100:00100000:0.0:1788201661.647061:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559732480:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201661.663164:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559732480:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16089us (16451us total) trans 30064772045 rc 0/0 00000100:00100000:0.0:1788201661.663182:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1044 00002000:00100000:0.0:1788201661.663200:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1046478848->1047527423) req@ffff962393987b80 x1875064559732480/t30064772045(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:27/0 lens 488/448 e 0 to 0 dl 1788201672 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201661.663213:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393987b80 with x1875064559732480 ext(1046478848->1047527423) 00002000:00010000:0.0:1788201661.663221:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393987b80 00000100:00100000:3.0:1788201661.804883:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201661.804965:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559732608 00000100:00100000:1.0:1788201661.804979:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559732608 00002000:00100000:1.0:1788201661.805065:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1047527424->1048575999) req@ffff962393985880 x1875064559732608/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:27/0 lens 488/0 e 0 to 0 dl 1788201672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201661.805078:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393985880 with x1875064559732608 ext(1047527424->1048575999) 00002000:00010000:1.0:1788201661.805085:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393985880 00000100:00100000:1.0:1788201661.805132:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1045 00000100:00100000:1.0:1788201661.805144:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559732608:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201661.838129:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559732608:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32969us (33244us total) trans 30064772046 rc 0/0 00000100:00100000:0.0:1788201661.838147:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1045 00002000:00100000:0.0:1788201661.838166:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1047527424->1048575999) req@ffff962393985880 x1875064559732608/t30064772046(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:27/0 lens 488/448 e 0 to 0 dl 1788201672 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201661.838179:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393985880 with x1875064559732608 ext(1047527424->1048575999) 00002000:00010000:0.0:1788201661.838187:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393985880 00000100:00100000:1.0:1788201661.959154:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201661.959298:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559732736 00000100:00100000:2.0:1788201661.959312:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559732736 00002000:00100000:2.0:1788201661.959432:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1048576000->1049624575) req@ffff9624ba284e00 x1875064559732736/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:27/0 lens 488/0 e 0 to 0 dl 1788201672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201661.959446:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284e00 with x1875064559732736 ext(1048576000->1049624575) 00002000:00010000:2.0:1788201661.959454:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284e00 00000100:00100000:2.0:1788201661.959487:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1046 00000100:00100000:2.0:1788201661.959509:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559732736:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201661.979278:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559732736:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19762us (20123us total) trans 30064772047 rc 0/0 00000100:00100000:2.0:1788201661.979297:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1046 00002000:00100000:2.0:1788201661.979314:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1048576000->1049624575) req@ffff9624ba284e00 x1875064559732736/t30064772047(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:27/0 lens 488/448 e 0 to 0 dl 1788201672 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201661.979329:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284e00 with x1875064559732736 ext(1048576000->1049624575) 00002000:00010000:2.0:1788201661.979337:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284e00 00000100:00100000:0.0:1788201662.007240:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962393986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570164224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201662.007408:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201662.007575:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570164224 00000100:00100000:1.0:1788201662.007605:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570164224 00000100:00100000:1.0:1788201662.007695:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788201662.007707:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570164224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201662.007756:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201662.007822:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570164224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201662.007830:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00080000:1.0:1788201662.007878:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962393986a00 x1875064570164224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201662.007901:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962393986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570164224:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201662.008080:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201662.120467:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201662.120676:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559732864 00000100:00100000:2.0:1788201662.120690:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559732864 00002000:00100000:2.0:1788201662.121427:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1049624576->1050673151) req@ffff962393985180 x1875064559732864/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:28/0 lens 488/0 e 0 to 0 dl 1788201673 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201662.121440:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393985180 with x1875064559732864 ext(1049624576->1050673151) 00002000:00010000:2.0:1788201662.121448:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393985180 00000100:00100000:2.0:1788201662.121589:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1047 00000100:00100000:2.0:1788201662.121607:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559732864:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201662.136207:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559732864:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14590us (15739us total) trans 30064772048 rc 0/0 00000100:00100000:2.0:1788201662.136227:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1047 00002000:00100000:2.0:1788201662.136243:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1049624576->1050673151) req@ffff962393985180 x1875064559732864/t30064772048(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:28/0 lens 488/448 e 0 to 0 dl 1788201673 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201662.136255:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393985180 with x1875064559732864 ext(1049624576->1050673151) 00002000:00010000:2.0:1788201662.136262:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393985180 00000100:00100000:3.0:1788201662.236053:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201662.236420:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559732992 00000100:00100000:0.0:1788201662.236434:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559732992 00002000:00100000:0.0:1788201662.236528:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1050673152->1051721727) req@ffff962393984700 x1875064559732992/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:28/0 lens 488/0 e 0 to 0 dl 1788201673 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201662.236543:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393984700 with x1875064559732992 ext(1050673152->1051721727) 00002000:00010000:0.0:1788201662.236550:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393984700 00000100:00100000:0.0:1788201662.236611:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1048 00000100:00100000:0.0:1788201662.236623:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559732992:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:0.0:1788201662.262927:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201662.273211:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559732992:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36570us (37157us total) trans 30064772049 rc 0/0 00000100:00100000:1.0:1788201662.273230:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1048 00002000:00100000:1.0:1788201662.273247:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1050673152->1051721727) req@ffff962393984700 x1875064559732992/t30064772049(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:28/0 lens 488/448 e 0 to 0 dl 1788201673 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201662.273260:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393984700 with x1875064559732992 ext(1050673152->1051721727) 00002000:00010000:1.0:1788201662.273268:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393984700 00000100:00100000:3.0:1788201662.406199:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201662.406582:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559733120 00000100:00100000:0.0:1788201662.406595:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559733120 00002000:00100000:0.0:1788201662.406669:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1051721728->1052770303) req@ffff962393986300 x1875064559733120/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:28/0 lens 488/0 e 0 to 0 dl 1788201673 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201662.406682:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393986300 with x1875064559733120 ext(1051721728->1052770303) 00002000:00010000:0.0:1788201662.406690:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393986300 00000100:00100000:0.0:1788201662.406733:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1049 00000100:00100000:0.0:1788201662.406755:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559733120:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201662.416842:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559733120:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10082us (10641us total) trans 30064772050 rc 0/0 00000100:00100000:1.0:1788201662.416861:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1049 00002000:00100000:1.0:1788201662.416878:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1051721728->1052770303) req@ffff962393986300 x1875064559733120/t30064772050(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:28/0 lens 488/448 e 0 to 0 dl 1788201673 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201662.416891:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393986300 with x1875064559733120 ext(1051721728->1052770303) 00002000:00010000:1.0:1788201662.416899:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393986300 00000100:00100000:2.0:1788201662.522475:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570164608:0@lo:400:kworker.0 00000100:00100000:0.0:1788201662.522581:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570164352:0@lo:400:kworker.0 00000100:00100000:2.0:1788201662.522628:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201662.522630:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201662.522690:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570164736:0@lo:400:kworker.0 00000100:00100000:3.0:1788201662.522807:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570164480:0@lo:400:kworker.0 00000100:00100000:0.0:1788201662.528087:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570164864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201662.528175:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201662.528268:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570164864 00000100:00100000:0.0:1788201662.528277:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570164864 00000100:00100000:0.0:1788201662.528464:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1788201662.528476:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570164864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201662.528618:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570164864:12345-0@lo:400:kworker.0 Request processed in 143us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201662.528626:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1788201662.528656:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570164352 00000100:00100000:0.0:1788201662.528660:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570164352 00000100:00100000:0.0:1788201662.528688:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:0.0:1788201662.528713:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570164352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201662.529225:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570164352:12345-0@lo:400:kworker.0 Request processed in 510us (6590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201662.529234:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00080000:0.0:1788201662.529286:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201662.529334:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570164352:0@lo:400:kworker.0 00000100:00100000:0.0:1788201662.529366:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570164864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201662.529413:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570164608 00000100:00100000:0.0:1788201662.529418:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570164608 00000100:00100000:0.0:1788201662.529456:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788201662.529464:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570164608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201662.529528:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570164608:12345-0@lo:400:kworker.0 Request processed in 65us (6900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201662.529535:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:0.0:1788201662.529549:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201662.530776:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570164608:0@lo:400:kworker.0 00000100:00100000:1.0:1788201662.541977:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201662.542438:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570164736 00000100:00100000:0.0:1788201662.542451:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570164736 00000100:00100000:0.0:1788201662.542559:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1788201662.542573:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570164736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201662.542664:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570164736:12345-0@lo:400:kworker.0 Request processed in 94us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201662.542673:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00080000:1.0:1788201662.542807:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201662.542852:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570164736:0@lo:400:kworker.0 00000100:00100000:3.0:1788201662.543127:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201662.545171:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570164480 00000100:00100000:0.0:1788201662.545190:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570164480 00000100:00100000:0.0:1788201662.545283:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1788201662.545295:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570164480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201662.545574:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875064570164480:12345-0@lo:400:kworker.0 Request processed in 280us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201662.545582:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1788201662.552270:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875064570164480:0@lo:400:kworker.0 00000100:00100000:2.0:1788201662.562578:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201662.562876:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559733248 00000100:00100000:1.0:1788201662.562891:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559733248 00002000:00100000:1.0:1788201662.562989:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1052770304->1053818879) req@ffff9624ba222680 x1875064559733248/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:28/0 lens 488/0 e 0 to 0 dl 1788201673 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201662.563004:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba222680 with x1875064559733248 ext(1052770304->1053818879) 00002000:00010000:1.0:1788201662.563011:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba222680 00000100:00100000:1.0:1788201662.563063:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1050 00000100:00100000:1.0:1788201662.563077:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559733248:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201662.591407:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559733248:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28316us (28833us total) trans 30064772051 rc 0/0 00000100:00100000:1.0:1788201662.591425:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1050 00002000:00100000:1.0:1788201662.591442:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1052770304->1053818879) req@ffff9624ba222680 x1875064559733248/t30064772051(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:28/0 lens 488/448 e 0 to 0 dl 1788201673 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201662.591456:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba222680 with x1875064559733248 ext(1052770304->1053818879) 00002000:00010000:1.0:1788201662.591463:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba222680 00000100:00100000:2.0:1788201662.742210:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201662.744619:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559733376 00000100:00100000:3.0:1788201662.744638:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559733376 00002000:00100000:3.0:1788201662.744972:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1053818880->1054867455) req@ffff9624ba220a80 x1875064559733376/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:28/0 lens 488/0 e 0 to 0 dl 1788201673 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201662.744988:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220a80 with x1875064559733376 ext(1053818880->1054867455) 00002000:00010000:3.0:1788201662.745057:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220a80 00000100:00100000:3.0:1788201662.745226:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1051 00000100:00100000:3.0:1788201662.745240:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559733376:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201662.765367:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559733376:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20095us (23135us total) trans 30064772052 rc 0/0 00000100:00100000:3.0:1788201662.765388:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1051 00002000:00100000:3.0:1788201662.765404:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1053818880->1054867455) req@ffff9624ba220a80 x1875064559733376/t30064772052(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:28/0 lens 488/448 e 0 to 0 dl 1788201673 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201662.765418:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220a80 with x1875064559733376 ext(1053818880->1054867455) 00002000:00010000:3.0:1788201662.765425:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220a80 00000100:00100000:1.0:1788201662.987038:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201662.987168:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559733504 00000100:00100000:0.0:1788201662.987181:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559733504 00002000:00100000:0.0:1788201662.987249:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1054867456->1055916031) req@ffff9624ba286d80 x1875064559733504/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:28/0 lens 488/0 e 0 to 0 dl 1788201673 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201662.987261:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba286d80 with x1875064559733504 ext(1054867456->1055916031) 00002000:00010000:0.0:1788201662.987268:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba286d80 00000100:00100000:0.0:1788201662.987315:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1052 00000100:00100000:0.0:1788201662.987327:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559733504:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201663.004772:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2342:x1875064559733504:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17430us (17733us total) trans 30064772053 rc 0/0 00000100:00100000:1.0:1788201663.004790:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1052 00002000:00100000:1.0:1788201663.004805:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1054867456->1055916031) req@ffff9624ba286d80 x1875064559733504/t30064772053(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:28/0 lens 488/448 e 0 to 0 dl 1788201673 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201663.004836:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba286d80 with x1875064559733504 ext(1054867456->1055916031) 00002000:00010000:1.0:1788201663.004844:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba286d80 00010000:00010000:2.0:1788201663.290278:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201663.294990:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201663.298312:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559733632 00000100:00100000:0.0:1788201663.298334:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559733632 00002000:00100000:0.0:1788201663.298484:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1055916032->1056964607) req@ffff9624ba285c00 x1875064559733632/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:29/0 lens 488/0 e 0 to 0 dl 1788201674 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201663.298509:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba285c00 with x1875064559733632 ext(1055916032->1056964607) 00002000:00010000:0.0:1788201663.298518:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba285c00 00000100:00100000:0.0:1788201663.298558:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1053 00000100:00100000:0.0:1788201663.298569:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559733632:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201663.300690:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201663.329713:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559733632:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31120us (34719us total) trans 30064772054 rc 0/0 00000100:00100000:1.0:1788201663.329735:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1053 00002000:00100000:1.0:1788201663.329759:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1055916032->1056964607) req@ffff9624ba285c00 x1875064559733632/t30064772054(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:29/0 lens 488/448 e 0 to 0 dl 1788201674 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201663.329889:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba285c00 with x1875064559733632 ext(1055916032->1056964607) 00002000:00010000:1.0:1788201663.329898:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba285c00 00000100:00100000:2.0:1788201663.463671:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201663.463846:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559733760 00000100:00100000:1.0:1788201663.463859:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559733760 00002000:00100000:1.0:1788201663.463929:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1056964608->1058013183) req@ffff9624ba223b80 x1875064559733760/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:29/0 lens 488/0 e 0 to 0 dl 1788201674 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201663.463943:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba223b80 with x1875064559733760 ext(1056964608->1058013183) 00002000:00010000:1.0:1788201663.463950:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba223b80 00000100:00100000:1.0:1788201663.464004:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1054 00000100:00100000:1.0:1788201663.464016:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559733760:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201663.557761:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559733760:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 93722us (94084us total) trans 30064772055 rc 0/0 00000100:00100000:1.0:1788201663.557783:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1054 00002000:00100000:1.0:1788201663.557802:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1056964608->1058013183) req@ffff9624ba223b80 x1875064559733760/t30064772055(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:29/0 lens 488/448 e 0 to 0 dl 1788201674 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201663.557833:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba223b80 with x1875064559733760 ext(1056964608->1058013183) 00002000:00010000:1.0:1788201663.557843:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba223b80 00000100:00100000:0.0:1788201663.631206:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201663.631369:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559733888 00000100:00100000:3.0:1788201663.631381:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559733888 00002000:00100000:3.0:1788201663.631451:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1058013184->1059061759) req@ffff9623bb439180 x1875064559733888/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:29/0 lens 488/0 e 0 to 0 dl 1788201674 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201663.631464:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb439180 with x1875064559733888 ext(1058013184->1059061759) 00002000:00010000:3.0:1788201663.631473:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb439180 00000100:00100000:3.0:1788201663.631524:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1055 00000100:00100000:3.0:1788201663.631556:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559733888:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201663.643077:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559733888:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11508us (11871us total) trans 30064772056 rc 0/0 00000100:00100000:3.0:1788201663.643094:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1055 00002000:00100000:3.0:1788201663.643109:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1058013184->1059061759) req@ffff9623bb439180 x1875064559733888/t30064772056(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:29/0 lens 488/448 e 0 to 0 dl 1788201674 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201663.643121:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb439180 with x1875064559733888 ext(1058013184->1059061759) 00002000:00010000:3.0:1788201663.643129:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb439180 00000100:00100000:1.0:1788201663.774384:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201663.774875:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559734016 00000100:00100000:2.0:1788201663.774891:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559734016 00002000:00100000:2.0:1788201663.774966:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1059061760->1060110335) req@ffff9624ba284a80 x1875064559734016/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:29/0 lens 488/0 e 0 to 0 dl 1788201674 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201663.774978:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284a80 with x1875064559734016 ext(1059061760->1060110335) 00002000:00010000:2.0:1788201663.774985:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284a80 00000100:00100000:2.0:1788201663.775028:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1056 00000100:00100000:2.0:1788201663.775040:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559734016:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201663.810421:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559734016:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35366us (36130us total) trans 30064772057 rc 0/0 00000100:00100000:2.0:1788201663.810441:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1056 00002000:00100000:2.0:1788201663.810459:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1059061760->1060110335) req@ffff9624ba284a80 x1875064559734016/t30064772057(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:29/0 lens 488/448 e 0 to 0 dl 1788201674 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201663.813368:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284a80 with x1875064559734016 ext(1059061760->1060110335) 00002000:00010000:2.0:1788201663.813381:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284a80 00000100:00100000:1.0:1788201663.935938:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201663.936069:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559734144 00000100:00100000:0.0:1788201663.936091:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559734144 00002000:00100000:0.0:1788201663.936161:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1060110336->1061158911) req@ffff9624ba287b80 x1875064559734144/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:29/0 lens 488/0 e 0 to 0 dl 1788201674 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201663.936201:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba287b80 with x1875064559734144 ext(1060110336->1061158911) 00002000:00010000:0.0:1788201663.936207:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba287b80 00000100:00100000:0.0:1788201663.936251:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1057 00000100:00100000:0.0:1788201663.936262:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559734144:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201663.965936:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559734144:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29658us (29997us total) trans 30064772058 rc 0/0 00000100:00100000:0.0:1788201663.965958:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1057 00002000:00100000:0.0:1788201663.965976:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1060110336->1061158911) req@ffff9624ba287b80 x1875064559734144/t30064772058(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:29/0 lens 488/448 e 0 to 0 dl 1788201674 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201663.965988:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba287b80 with x1875064559734144 ext(1060110336->1061158911) 00002000:00010000:0.0:1788201663.965995:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba287b80 00000100:00100000:2.0:1788201664.074892:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201664.075405:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559734272 00000100:00100000:1.0:1788201664.075419:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559734272 00002000:00100000:1.0:1788201664.075509:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1061158912->1062207487) req@ffff9624ba221880 x1875064559734272/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/0 e 0 to 0 dl 1788201675 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201664.075522:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221880 with x1875064559734272 ext(1061158912->1062207487) 00002000:00010000:1.0:1788201664.075529:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221880 00000100:00100000:1.0:1788201664.075571:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1058 00000100:00100000:1.0:1788201664.075584:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559734272:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201664.094641:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559734272:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19041us (19743us total) trans 30064772059 rc 0/0 00000100:00100000:1.0:1788201664.094661:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1058 00002000:00100000:1.0:1788201664.094678:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1061158912->1062207487) req@ffff9624ba221880 x1875064559734272/t30064772059(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/448 e 0 to 0 dl 1788201675 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201664.094691:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221880 with x1875064559734272 ext(1061158912->1062207487) 00002000:00010000:1.0:1788201664.094699:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221880 00000100:00100000:2.0:1788201664.199203:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201664.203551:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559734400 00000100:00100000:3.0:1788201664.203573:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559734400 00002000:00100000:3.0:1788201664.203658:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1062207488->1063256063) req@ffff9624ba220e00 x1875064559734400/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/0 e 0 to 0 dl 1788201675 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201664.203673:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220e00 with x1875064559734400 ext(1062207488->1063256063) 00002000:00010000:3.0:1788201664.203681:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220e00 00000100:00100000:3.0:1788201664.203784:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1059 00000100:00100000:3.0:1788201664.203797:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559734400:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201664.220310:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559734400:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16498us (21108us total) trans 30064772060 rc 0/0 00000100:00100000:3.0:1788201664.220328:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1059 00002000:00100000:3.0:1788201664.220375:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1062207488->1063256063) req@ffff9624ba220e00 x1875064559734400/t30064772060(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/448 e 0 to 0 dl 1788201675 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201664.220387:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220e00 with x1875064559734400 ext(1062207488->1063256063) 00002000:00010000:3.0:1788201664.220396:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220e00 00010000:00010000:2.0:1788201664.310743:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201664.320413:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201664.321083:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559734528 00000100:00100000:1.0:1788201664.321096:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559734528 00002000:00100000:1.0:1788201664.321167:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1063256064->1064304639) req@ffff9624ba222d80 x1875064559734528/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/0 e 0 to 0 dl 1788201675 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201664.321204:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba222d80 with x1875064559734528 ext(1063256064->1064304639) 00002000:00010000:1.0:1788201664.321212:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba222d80 00000100:00100000:1.0:1788201664.321256:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1060 00000100:00100000:1.0:1788201664.321277:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2342:x1875064559734528:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201664.337246:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559734528:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15963us (16830us total) trans 30064772061 rc 0/0 00000100:00100000:1.0:1788201664.337266:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1060 00002000:00100000:1.0:1788201664.337285:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1063256064->1064304639) req@ffff9624ba222d80 x1875064559734528/t30064772061(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/448 e 0 to 0 dl 1788201675 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201664.337297:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba222d80 with x1875064559734528 ext(1063256064->1064304639) 00002000:00010000:1.0:1788201664.337305:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba222d80 00000100:00100000:3.0:1788201664.450768:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201664.451025:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559734656 00000100:00100000:0.0:1788201664.451040:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559734656 00002000:00100000:0.0:1788201664.451130:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1064304640->1065353215) req@ffff962393984380 x1875064559734656/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/0 e 0 to 0 dl 1788201675 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201664.451145:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393984380 with x1875064559734656 ext(1064304640->1065353215) 00002000:00010000:0.0:1788201664.451152:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393984380 00000100:00100000:0.0:1788201664.451195:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1061 00000100:00100000:0.0:1788201664.451207:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559734656:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201664.464450:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559734656:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13227us (13680us total) trans 30064772062 rc 0/0 00000100:00100000:0.0:1788201664.464469:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1061 00002000:00100000:0.0:1788201664.464516:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1064304640->1065353215) req@ffff962393984380 x1875064559734656/t30064772062(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/448 e 0 to 0 dl 1788201675 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201664.464529:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393984380 with x1875064559734656 ext(1064304640->1065353215) 00002000:00010000:0.0:1788201664.464537:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393984380 00000100:00100000:3.0:1788201664.556336:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201664.556513:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559734784 00000100:00100000:2.0:1788201664.556529:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559734784 00002000:00100000:2.0:1788201664.556606:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1065353216->1066401791) req@ffff962393985f80 x1875064559734784/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/0 e 0 to 0 dl 1788201675 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201664.556620:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393985f80 with x1875064559734784 ext(1065353216->1066401791) 00002000:00010000:2.0:1788201664.556627:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393985f80 00000100:00100000:2.0:1788201664.556670:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1062 00000100:00100000:2.0:1788201664.556682:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2341:x1875064559734784:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201664.567055:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570164992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201664.567160:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201664.567380:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570164992 00000100:00100000:1.0:1788201664.567391:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570164992 00000100:00100000:1.0:1788201664.567472:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788201664.567495:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570164992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201664.567527:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 574029824 pending 46006272 free 2821718016 avail 2819620864 00000100:00100000:1.0:1788201664.567586:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570164992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201664.567594:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788201664.567650:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570164992:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201664.567725:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201664.590561:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2341:x1875064559734784:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33865us (34224us total) trans 30064772063 rc 0/0 00000100:00100000:1.0:1788201664.590601:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1062 00002000:00100000:1.0:1788201664.590619:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1065353216->1066401791) req@ffff962393985f80 x1875064559734784/t30064772063(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/448 e 0 to 0 dl 1788201675 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201664.590633:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393985f80 with x1875064559734784 ext(1065353216->1066401791) 00002000:00010000:1.0:1788201664.590641:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393985f80 00000100:00100000:3.0:1788201664.660541:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201664.661210:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559734912 00000100:00100000:2.0:1788201664.661225:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559734912 00002000:00100000:2.0:1788201664.661296:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1066401792->1067450367) req@ffff962393987480 x1875064559734912/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/0 e 0 to 0 dl 1788201675 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201664.661309:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393987480 with x1875064559734912 ext(1066401792->1067450367) 00002000:00010000:2.0:1788201664.661317:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393987480 00000100:00100000:2.0:1788201664.661460:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1063 00000100:00100000:2.0:1788201664.661484:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2344:x1875064559734912:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201664.697674:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2344:x1875064559734912:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 36181us (37127us total) trans 30064772064 rc 0/0 00000100:00100000:0.0:1788201664.697695:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1063 00002000:00100000:0.0:1788201664.697979:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1066401792->1067450367) req@ffff962393987480 x1875064559734912/t30064772064(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/448 e 0 to 0 dl 1788201675 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201664.697993:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393987480 with x1875064559734912 ext(1066401792->1067450367) 00002000:00010000:0.0:1788201664.698001:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393987480 00000100:00100000:3.0:1788201664.885676:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201664.887032:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559735040 00000100:00100000:1.0:1788201664.887048:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559735040 00002000:00100000:1.0:1788201664.887133:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1067450368->1068498943) req@ffff962393987800 x1875064559735040/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/0 e 0 to 0 dl 1788201675 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201664.887144:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393987800 with x1875064559735040 ext(1067450368->1068498943) 00002000:00010000:1.0:1788201664.887150:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393987800 00000100:00100000:1.0:1788201664.887192:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1064 00000100:00100000:1.0:1788201664.887201:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2343:x1875064559735040:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201664.906026:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2343:x1875064559735040:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18805us (20347us total) trans 30064772065 rc 0/0 00000100:00100000:1.0:1788201664.906044:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1064 00002000:00100000:1.0:1788201664.906059:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1067450368->1068498943) req@ffff962393987800 x1875064559735040/t30064772065(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:30/0 lens 488/448 e 0 to 0 dl 1788201675 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201664.906102:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393987800 with x1875064559735040 ext(1067450368->1068498943) 00002000:00010000:1.0:1788201664.906110:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393987800 00000100:00100000:3.0:1788201665.039209:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201665.040275:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559735168 00000100:00100000:0.0:1788201665.040289:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559735168 00002000:00100000:0.0:1788201665.040406:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1068498944->1069547519) req@ffff962393986a00 x1875064559735168/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:31/0 lens 488/0 e 0 to 0 dl 1788201676 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201665.040416:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393986a00 with x1875064559735168 ext(1068498944->1069547519) 00002000:00010000:0.0:1788201665.040422:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393986a00 00000100:00100000:0.0:1788201665.040454:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1065 00000100:00100000:0.0:1788201665.040466:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2344:x1875064559735168:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201665.040852:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201665.069166:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2344:x1875064559735168:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28685us (29955us total) trans 30064772066 rc 0/0 00000100:00100000:0.0:1788201665.069204:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1065 00002000:00100000:0.0:1788201665.069220:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1068498944->1069547519) req@ffff962393986a00 x1875064559735168/t30064772066(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:31/0 lens 488/448 e 0 to 0 dl 1788201676 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201665.069232:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393986a00 with x1875064559735168 ext(1068498944->1069547519) 00002000:00010000:0.0:1788201665.069240:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393986a00 00000001:00080000:2.0:1788201665.219195:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772066 is committed 00000100:00100000:2.0:1788201665.265849:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201665.266152:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559735296 00000100:00100000:1.0:1788201665.266167:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559735296 00002000:00100000:1.0:1788201665.266265:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1069547520->1070596095) req@ffff9624ba221c00 x1875064559735296/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:31/0 lens 488/0 e 0 to 0 dl 1788201676 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201665.266281:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221c00 with x1875064559735296 ext(1069547520->1070596095) 00002000:00010000:1.0:1788201665.266288:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221c00 00000100:00100000:1.0:1788201665.266331:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1066 00000100:00100000:1.0:1788201665.266366:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2343:x1875064559735296:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201665.279874:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559735296:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13521us (14029us total) trans 30064772067 rc 0/0 00000100:00100000:1.0:1788201665.279891:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1066 00002000:00100000:1.0:1788201665.279904:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (1069547520->1070596095) req@ffff9624ba221c00 x1875064559735296/t30064772067(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:31/0 lens 488/448 e 0 to 0 dl 1788201676 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201665.279916:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba221c00 with x1875064559735296 ext(1069547520->1070596095) 00002000:00010000:1.0:1788201665.279922:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba221c00 00010000:00010000:0.0:1788201665.334674:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201665.410920:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201665.411166:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559735424 00000100:00100000:2.0:1788201665.411176:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559735424 00002000:00100000:2.0:1788201665.411228:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1070596096->1071644671) req@ffff962393984000 x1875064559735424/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:31/0 lens 488/0 e 0 to 0 dl 1788201676 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201665.411238:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393984000 with x1875064559735424 ext(1070596096->1071644671) 00002000:00010000:2.0:1788201665.411243:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393984000 00000100:00100000:2.0:1788201665.411385:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1067 00000100:00100000:2.0:1788201665.411395:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559735424:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201665.442379:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559735424:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30972us (31457us total) trans 30064772068 rc 0/0 00000100:00100000:0.0:1788201665.442396:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1067 00002000:00100000:0.0:1788201665.442410:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1070596096->1071644671) req@ffff962393984000 x1875064559735424/t30064772068(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:31/0 lens 488/448 e 0 to 0 dl 1788201676 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201665.442422:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393984000 with x1875064559735424 ext(1070596096->1071644671) 00002000:00010000:0.0:1788201665.442429:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393984000 00000100:00100000:2.0:1788201665.589825:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201665.589981:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559735552 00000100:00100000:1.0:1788201665.589991:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559735552 00002000:00100000:1.0:1788201665.590040:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1071644672->1072693247) req@ffff9624ba220000 x1875064559735552/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:31/0 lens 488/0 e 0 to 0 dl 1788201676 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201665.590051:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220000 with x1875064559735552 ext(1071644672->1072693247) 00002000:00010000:1.0:1788201665.590057:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220000 00000100:00100000:1.0:1788201665.590092:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1068 00000100:00100000:1.0:1788201665.590102:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559735552:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201665.606801:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559735552:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16123us (16420us total) trans 30064772069 rc 0/0 00000100:00100000:2.0:1788201665.607237:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1068 00002000:00100000:2.0:1788201665.607259:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1071644672->1072693247) req@ffff9624ba220000 x1875064559735552/t30064772069(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:31/0 lens 488/448 e 0 to 0 dl 1788201676 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201665.607270:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba220000 with x1875064559735552 ext(1071644672->1072693247) 00002000:00010000:2.0:1788201665.607277:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba220000 00000100:00100000:3.0:1788201665.799572:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201665.799662:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559735680 00000100:00100000:0.0:1788201665.799677:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559735680 00002000:00100000:0.0:1788201665.799734:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1072693248->1073741823) req@ffff962388ba3100 x1875064559735680/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:31/0 lens 488/0 e 0 to 0 dl 1788201676 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201665.799746:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3100 with x1875064559735680 ext(1072693248->1073741823) 00002000:00010000:0.0:1788201665.799753:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3100 00000100:00100000:0.0:1788201665.799856:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1069 00000100:00100000:0.0:1788201665.799866:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559735680:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201665.803576:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201665.807023:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559735808 00000100:00100000:2.0:1788201665.807041:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559735808 00002000:00100000:2.0:1788201665.807106:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (969867264->969932799) req@ffff962388ba0a80 x1875064559735808/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:31/0 lens 488/0 e 0 to 0 dl 1788201676 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201665.807119:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0a80 with x1875064559735808 ext(969867264->969932799) 00002000:00010000:2.0:1788201665.807124:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0a80 00000100:00100000:2.0:1788201665.807179:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1070 00000100:00100000:2.0:1788201665.807192:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559735808:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201665.814505:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559735680:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14629us (14937us total) trans 30064772070 rc 0/0 00000100:00100000:0.0:1788201665.814533:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1069 00002000:00100000:0.0:1788201665.814546:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1072693248->1073741823) req@ffff962388ba3100 x1875064559735680/t30064772070(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:31/0 lens 488/448 e 0 to 0 dl 1788201676 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201665.814556:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3100 with x1875064559735680 ext(1072693248->1073741823) 00002000:00010000:0.0:1788201665.814561:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3100 00000100:00100000:2.0:1788201665.817503:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559735808:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10303us (13930us total) trans 30064772071 rc 0/0 00000100:00100000:2.0:1788201665.817517:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1070 00002000:00100000:2.0:1788201665.817529:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (969867264->969932799) req@ffff962388ba0a80 x1875064559735808/t30064772071(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:31/0 lens 488/448 e 0 to 0 dl 1788201676 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201665.817555:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0a80 with x1875064559735808 ext(969867264->969932799) 00002000:00010000:2.0:1788201665.817560:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0a80 00000100:00100000:3.0:1788201665.822547:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201665.822648:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559735936 00000100:00100000:0.0:1788201665.822658:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559735936 00000100:00100000:0.0:1788201665.822720:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 161 00000100:00100000:0.0:1788201665.822731:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559735936:12345-192.168.201.56@tcp:16:iozone.0 00000001:00080000:2.0:1788201665.902226:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772070 is committed 00000001:00080000:2.0:1788201665.902513:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772071 is committed 00000100:00100000:3.0:1788201665.902892:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559735936:12345-192.168.201.56@tcp:16:iozone.0 Request processed in 80156us (80348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201665.902905:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 161 00000100:00100000:1.0:1788201665.908398:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201665.909043:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559736192 00000100:00100000:0.0:1788201665.909056:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559736192 00000100:00100000:0.0:1788201665.909143:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 105 00000100:00100000:0.0:1788201665.909154:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+9:17463:x1875064559736192:12345-192.168.201.56@tcp:101:iozone.0 00010000:00010000:0.0:1788201665.909176:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201665.909200:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df000/0xa81c4c9a2f3cb730 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x390884812bd99b66 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201665.909282:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb737 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201665.909296:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb737 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201665.909308:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb737 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201665.909324:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb73e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201665.909380:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201665.909389:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788201665.910424:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788201665.919289:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27ec00/0xa81c4c9a2f3cb745 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.919314:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27ec00/0xa81c4c9a2f3cb745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.919330:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27ec00/0xa81c4c9a2f3cb745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201665.919608:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x10:0x0]: returning size 0 00010000:00010000:1.0:1788201665.919845:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb737 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.919853:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb737 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.919861:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb737 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.919868:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4df400 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201665.919872:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb737 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.919881:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb737 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.919894:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624a8e9fb00) 00010000:00010000:1.0:1788201665.919897:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201665.919902:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb737 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.919909:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df400/0xa81c4c9a2f3cb737 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.920715:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.920724:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb73e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.920730:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb73e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.920737:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624ba4dec00 already unused, calling callback (ffffffffc1f7f4f0) 00010000:00010000:1.0:1788201665.920740:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb73e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.920746:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb73e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.920757:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd178b560 (ffff962482424700) 00010000:00010000:1.0:1788201665.920760:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201665.920763:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb73e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.920768:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4dec00/0xa81c4c9a2f3cb73e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd178b560 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.920838:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624ba4df000/0xa81c4c9a2f3cb730 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b66 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.920854:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96248e27ec00/0xa81c4c9a2f3cb745 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0x390884812bd99b66 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201665.920876:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9624a8e9f300) 00010000:00010000:1.0:1788201665.920878:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788201665.920881:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96248e27ec00, rc 0) 00000100:00100000:1.0:1788201665.921905:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:17463:x1875064559736192:12345-192.168.201.56@tcp:101:iozone.0 Request processed in 12745us (13510us total) trans 4294967385 rc 0/0 00000100:00100000:1.0:1788201665.921916:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 105 00000100:00100000:1.0:1788201665.929765:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201665.929866:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559736448 00000100:00100000:0.0:1788201665.929876:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559736448 00000100:00100000:0.0:1788201665.930031:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:0.0:1788201665.930044:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+11:17463:x1875064559736448:12345-192.168.201.56@tcp:35:iozone.0 00000001:00080000:0.0:1788201665.930389:0:5828:0:(tgt_lastrcvd.c:2124:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1788201665.930890:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:17463:x1875064559736448:12345-192.168.201.56@tcp:35:iozone.0 Request processed in 846us (1133us total) trans 4294967387 rc 0/0 00000100:00100000:0.0:1788201665.930900:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 38 00000020:00080000:0.0:1788201665.930905:0:5828:0:(tgt_main.c:807:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788201665.937304:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201665.937473:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559736576 00000100:00100000:0.0:1788201665.937484:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559736576 00000100:00100000:0.0:1788201665.937540:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 162 00000100:00100000:0.0:1788201665.937550:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559736576:12345-192.168.201.56@tcp:16:iozone.0 00000100:00100000:0.0:1788201665.937724:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2342:x1875064559736576:12345-192.168.201.56@tcp:16:iozone.0 Request processed in 174us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201665.937732:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 162 00000100:00100000:2.0:1788201666.112769:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201666.117730:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559736704 00000100:00100000:1.0:1788201666.117744:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559736704 00002000:00100000:1.0:1788201666.117812:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (0->1048575) req@ffff96248c9c4700 x1875064559736704/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:32/0 lens 488/0 e 0 to 0 dl 1788201677 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201666.117824:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4700 with x1875064559736704 ext(0->1048575) 00002000:00010000:1.0:1788201666.117830:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4700 00000100:00100000:1.0:1788201666.117874:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1071 00000100:00100000:1.0:1788201666.117884:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2344:x1875064559736704:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201666.151862:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559736704:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33968us (39096us total) trans 30064772072 rc 0/0 00000100:00100000:1.0:1788201666.151878:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1071 00002000:00100000:1.0:1788201666.151890:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (0->1048575) req@ffff96248c9c4700 x1875064559736704/t30064772072(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:32/0 lens 488/448 e 0 to 0 dl 1788201677 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201666.151900:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4700 with x1875064559736704 ext(0->1048575) 00002000:00010000:1.0:1788201666.151906:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4700 00000100:00100000:2.0:1788201666.304643:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201666.304754:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559736832 00000100:00100000:0.0:1788201666.304776:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559736832 00002000:00100000:0.0:1788201666.304837:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff96248c9c7100 x1875064559736832/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:32/0 lens 488/0 e 0 to 0 dl 1788201677 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201666.304870:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c7100 with x1875064559736832 ext(1048576->2097151) 00002000:00010000:0.0:1788201666.304877:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c7100 00000100:00100000:0.0:1788201666.304914:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1072 00000100:00100000:0.0:1788201666.304934:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559736832:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201666.332047:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559736832:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27099us (27399us total) trans 30064772073 rc 0/0 00000100:00100000:0.0:1788201666.332064:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1072 00002000:00100000:0.0:1788201666.332081:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff96248c9c7100 x1875064559736832/t30064772073(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:32/0 lens 488/448 e 0 to 0 dl 1788201677 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201666.332093:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c7100 with x1875064559736832 ext(1048576->2097151) 00002000:00010000:0.0:1788201666.332101:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c7100 00010000:00010000:2.0:1788201666.358656:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201666.362411:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201666.362440:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201666.362537:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559737088 00000100:00100000:2.0:1788201666.362547:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559737088 00000100:00100000:2.0:1788201666.362614:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 475 00000100:00100000:2.0:1788201666.362625:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:2343:x1875064559737088:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201666.362674:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559736960 00000100:00100000:0.0:1788201666.362680:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559736960 00000100:00100000:2.0:1788201666.362720:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+13:2343:x1875064559737088:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 95us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201666.362721:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 580 00000100:00100000:2.0:1788201666.362735:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 475 00000100:00100000:0.0:1788201666.362736:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559736960:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201666.362772:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559736960:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 40us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201666.362781:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 580 00000100:00100000:3.0:1788201666.494084:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201666.494505:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559737216 00000100:00100000:2.0:1788201666.494518:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559737216 00002000:00100000:2.0:1788201666.494572:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff962388ba2a00 x1875064559737216/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:32/0 lens 488/0 e 0 to 0 dl 1788201677 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201666.494583:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2a00 with x1875064559737216 ext(2097152->3145727) 00002000:00010000:2.0:1788201666.494589:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2a00 00000100:00100000:2.0:1788201666.494624:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1073 00000100:00100000:2.0:1788201666.494633:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559737216:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201666.502997:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559737216:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8351us (8910us total) trans 30064772074 rc 0/0 00000100:00100000:2.0:1788201666.503031:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1073 00002000:00100000:2.0:1788201666.503047:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff962388ba2a00 x1875064559737216/t30064772074(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:32/0 lens 488/448 e 0 to 0 dl 1788201677 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201666.503058:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2a00 with x1875064559737216 ext(2097152->3145727) 00002000:00010000:2.0:1788201666.503064:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2a00 00000100:00100000:3.0:1788201666.653673:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201666.653982:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559737344 00000100:00100000:2.0:1788201666.653994:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559737344 00002000:00100000:2.0:1788201666.654044:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff962388ba0700 x1875064559737344/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:32/0 lens 488/0 e 0 to 0 dl 1788201677 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201666.654056:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0700 with x1875064559737344 ext(3145728->4194303) 00002000:00010000:2.0:1788201666.654061:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0700 00000100:00100000:2.0:1788201666.654096:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1074 00000100:00100000:2.0:1788201666.654105:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559737344:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201666.672385:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559737344:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18233us (18676us total) trans 30064772075 rc 0/0 00000100:00100000:2.0:1788201666.672399:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1074 00002000:00100000:2.0:1788201666.672411:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff962388ba0700 x1875064559737344/t30064772075(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:32/0 lens 488/448 e 0 to 0 dl 1788201677 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201666.672422:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0700 with x1875064559737344 ext(3145728->4194303) 00002000:00010000:2.0:1788201666.672429:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0700 00000100:00100000:1.0:1788201666.757586:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201666.757715:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559737472 00000100:00100000:2.0:1788201666.757726:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559737472 00002000:00100000:2.0:1788201666.757852:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff9624ba286300 x1875064559737472/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:32/0 lens 488/0 e 0 to 0 dl 1788201677 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201666.757871:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba286300 with x1875064559737472 ext(4194304->5242879) 00002000:00010000:2.0:1788201666.757877:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba286300 00000100:00100000:2.0:1788201666.757912:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1075 00000100:00100000:2.0:1788201666.757924:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559737472:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201666.773483:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559737472:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15552us (15901us total) trans 30064772076 rc 0/0 00000100:00100000:2.0:1788201666.773497:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1075 00002000:00100000:2.0:1788201666.773510:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff9624ba286300 x1875064559737472/t30064772076(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:32/0 lens 488/448 e 0 to 0 dl 1788201677 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201666.773521:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba286300 with x1875064559737472 ext(4194304->5242879) 00002000:00010000:2.0:1788201666.773527:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba286300 00000100:00100000:1.0:1788201666.925680:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201666.925766:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559737600 00000100:00100000:0.0:1788201666.925793:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559737600 00002000:00100000:0.0:1788201666.925851:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (5242880->6291455) req@ffff9624ba285500 x1875064559737600/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:32/0 lens 488/0 e 0 to 0 dl 1788201677 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201666.925862:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba285500 with x1875064559737600 ext(5242880->6291455) 00002000:00010000:0.0:1788201666.925883:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba285500 00000100:00100000:0.0:1788201666.925974:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1076 00000100:00100000:0.0:1788201666.925985:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559737600:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201666.938823:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559737600:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12828us (13142us total) trans 30064772077 rc 0/0 00000100:00100000:1.0:1788201666.938838:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1076 00002000:00100000:1.0:1788201666.938853:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (5242880->6291455) req@ffff9624ba285500 x1875064559737600/t30064772077(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:32/0 lens 488/448 e 0 to 0 dl 1788201677 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201666.938863:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba285500 with x1875064559737600 ext(5242880->6291455) 00002000:00010000:1.0:1788201666.938870:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba285500 00000100:00100000:1.0:1788201667.084793:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201667.089828:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559737728 00000100:00100000:2.0:1788201667.089844:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559737728 00002000:00100000:2.0:1788201667.089939:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (6291456->7340031) req@ffff9624ba284380 x1875064559737728/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/0 e 0 to 0 dl 1788201678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1788201667.089951:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1788201667.089952:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284380 with x1875064559737728 ext(6291456->7340031) 00002000:00010000:2.0:1788201667.089961:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284380 00000100:00100000:2.0:1788201667.089993:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1077 00000100:00100000:2.0:1788201667.090005:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559737728:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201667.112195:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2341:x1875064559737728:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22180us (27401us total) trans 30064772078 rc 0/0 00000100:00100000:2.0:1788201667.112211:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1077 00002000:00100000:2.0:1788201667.112255:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (6291456->7340031) req@ffff9624ba284380 x1875064559737728/t30064772078(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/448 e 0 to 0 dl 1788201678 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201667.112266:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba284380 with x1875064559737728 ext(6291456->7340031) 00002000:00010000:2.0:1788201667.112274:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba284380 00000100:00100000:1.0:1788201667.127221:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201667.127258:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962388ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570165120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201667.127382:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201667.130275:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570165120 00000100:00100000:3.0:1788201667.130298:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570165120 00000100:00100000:2.0:1788201667.130618:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788201667.130635:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570165120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201667.130693:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201667.131055:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875064570165120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 424us (3671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201667.131065:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00010000:00080000:0.0:1788201667.131229:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962388ba2300 x1875064570165120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201667.131261:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962388ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875064570165120:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201667.131324:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201667.210443:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201667.210712:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559737856 00000100:00100000:2.0:1788201667.210729:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559737856 00002000:00100000:2.0:1788201667.210822:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (7340032->8388607) req@ffff9624ba20d500 x1875064559737856/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/0 e 0 to 0 dl 1788201678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201667.210837:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20d500 with x1875064559737856 ext(7340032->8388607) 00002000:00010000:2.0:1788201667.210847:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20d500 00000100:00100000:2.0:1788201667.210893:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1078 00000100:00100000:2.0:1788201667.210907:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559737856:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201667.234639:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559737856:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23718us (24208us total) trans 30064772079 rc 0/0 00000100:00100000:2.0:1788201667.234658:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1078 00002000:00100000:2.0:1788201667.234676:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (7340032->8388607) req@ffff9624ba20d500 x1875064559737856/t30064772079(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/448 e 0 to 0 dl 1788201678 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201667.234688:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20d500 with x1875064559737856 ext(7340032->8388607) 00002000:00010000:2.0:1788201667.234714:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20d500 00000100:00100000:0.0:1788201667.335526:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201667.335797:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559737984 00000100:00100000:1.0:1788201667.335810:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559737984 00002000:00100000:1.0:1788201667.335878:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (8388608->9437183) req@ffff9623bb43a300 x1875064559737984/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/0 e 0 to 0 dl 1788201678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201667.335890:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb43a300 with x1875064559737984 ext(8388608->9437183) 00002000:00010000:1.0:1788201667.335896:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb43a300 00000100:00100000:1.0:1788201667.335950:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1079 00000100:00100000:1.0:1788201667.335962:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559737984:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201667.348476:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559737984:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12500us (12945us total) trans 30064772080 rc 0/0 00000100:00100000:1.0:1788201667.348512:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1079 00002000:00100000:1.0:1788201667.348527:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (8388608->9437183) req@ffff9623bb43a300 x1875064559737984/t30064772080(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/448 e 0 to 0 dl 1788201678 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201667.348873:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb43a300 with x1875064559737984 ext(8388608->9437183) 00002000:00010000:1.0:1788201667.348881:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb43a300 00010000:00010000:2.0:1788201667.383013:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201667.480862:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201667.481100:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559738112 00000100:00100000:1.0:1788201667.481170:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559738112 00002000:00100000:1.0:1788201667.481232:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (9437184->10485759) req@ffff962388ba1500 x1875064559738112/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/0 e 0 to 0 dl 1788201678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201667.481243:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba1500 with x1875064559738112 ext(9437184->10485759) 00002000:00010000:1.0:1788201667.481249:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba1500 00000100:00100000:1.0:1788201667.481285:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1080 00000100:00100000:1.0:1788201667.481296:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559738112:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201667.496525:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559738112:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15220us (15663us total) trans 30064772081 rc 0/0 00000100:00100000:2.0:1788201667.496537:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1080 00002000:00100000:2.0:1788201667.496547:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (9437184->10485759) req@ffff962388ba1500 x1875064559738112/t30064772081(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/448 e 0 to 0 dl 1788201678 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201667.496555:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba1500 with x1875064559738112 ext(9437184->10485759) 00002000:00010000:2.0:1788201667.496560:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba1500 00000100:00100000:3.0:1788201667.588832:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201667.589589:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559738240 00000100:00100000:2.0:1788201667.589600:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559738240 00002000:00100000:2.0:1788201667.589651:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (10485760->11534335) req@ffff962388ba0380 x1875064559738240/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/0 e 0 to 0 dl 1788201678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201667.589661:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0380 with x1875064559738240 ext(10485760->11534335) 00002000:00010000:2.0:1788201667.589666:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0380 00000100:00100000:2.0:1788201667.589755:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1081 00000100:00100000:2.0:1788201667.589765:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2341:x1875064559738240:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201667.602032:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2341:x1875064559738240:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12256us (13196us total) trans 30064772082 rc 0/0 00000100:00100000:2.0:1788201667.602047:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1081 00002000:00100000:2.0:1788201667.602059:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (10485760->11534335) req@ffff962388ba0380 x1875064559738240/t30064772082(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/448 e 0 to 0 dl 1788201678 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201667.602070:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba0380 with x1875064559738240 ext(10485760->11534335) 00002000:00010000:2.0:1788201667.602077:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba0380 00000100:00100000:3.0:1788201667.640681:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962388ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570165376:0@lo:400:kworker.0 00000100:00100000:3.0:1788201667.640756:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201667.640841:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788201667.640847:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962388ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570165248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201667.640878:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201667.641406:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570165376 00000100:00100000:2.0:1788201667.641415:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570165376 00000100:00100000:3.0:1788201667.641451:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962388ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570165760:0@lo:400:kworker.0 00000100:00100000:2.0:1788201667.641480:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1788201667.641484:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201667.641489:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570165376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201667.641530:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962388ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570165632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201667.641547:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570165376:12345-0@lo:400:kworker.0 Request processed in 60us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201667.641554:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1788201667.641569:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570165760 00000100:00100000:2.0:1788201667.641573:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570165760 00000100:00100000:3.0:1788201667.641599:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201667.641601:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1788201667.641606:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570165760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201667.641613:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201667.641618:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962388ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570165504:0@lo:400:kworker.0 00000100:00100000:0.0:1788201667.641688:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570165248 00000100:00100000:0.0:1788201667.641692:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570165248 00000100:00100000:0.0:1788201667.641841:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1788201667.641848:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570165248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201667.642317:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201667.643024:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962388ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570165376:0@lo:400:kworker.0 00000100:00100000:3.0:1788201667.643050:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570165632 00000100:00100000:3.0:1788201667.643053:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570165632 00000100:00100000:3.0:1788201667.643086:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1788201667.643092:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570165632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201667.643150:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570165632:12345-0@lo:400:kworker.0 Request processed in 58us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201667.643156:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1788201667.643184:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962388ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570165632:0@lo:400:kworker.0 00000100:00100000:1.0:1788201667.644608:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570165504 00000100:00100000:1.0:1788201667.644617:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570165504 00000100:00100000:1.0:1788201667.644668:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788201667.644677:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570165504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201667.644742:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570165504:12345-0@lo:400:kworker.0 Request processed in 67us (2425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201667.644748:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788201667.645138:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962388ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570165504:0@lo:400:kworker.0 00000100:00080000:1.0:1788201667.645171:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201667.645175:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201667.649597:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875064570165760:12345-0@lo:400:kworker.0 Request processed in 7980us (8101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201667.649614:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1788201667.649951:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3285:x1875064570165248:12345-0@lo:400:kworker.0 Request processed in 8102us (9069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201667.649961:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:3.0:1788201667.650590:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962388ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3285:1875064570165248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201667.650609:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962388ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875064570165760:0@lo:400:kworker.0 00000001:00080000:3.0:1788201667.706690:0:5847:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967387 is committed 00000100:00100000:3.0:1788201667.746323:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201667.747593:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559738368 00000100:00100000:2.0:1788201667.747609:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559738368 00002000:00100000:2.0:1788201667.747694:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (11534336->12582911) req@ffff9623939e3100 x1875064559738368/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/0 e 0 to 0 dl 1788201678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201667.747705:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3100 with x1875064559738368 ext(11534336->12582911) 00002000:00010000:2.0:1788201667.747710:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3100 00000100:00100000:2.0:1788201667.747755:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1082 00000100:00100000:2.0:1788201667.747767:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559738368:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201667.763715:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559738368:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15937us (17395us total) trans 30064772083 rc 0/0 00000100:00100000:2.0:1788201667.763731:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1082 00002000:00100000:2.0:1788201667.763747:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (11534336->12582911) req@ffff9623939e3100 x1875064559738368/t30064772083(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/448 e 0 to 0 dl 1788201678 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201667.763799:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3100 with x1875064559738368 ext(11534336->12582911) 00002000:00010000:2.0:1788201667.763807:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3100 00000100:00100000:1.0:1788201667.834264:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201667.835121:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559738496 00000100:00100000:2.0:1788201667.835136:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559738496 00002000:00100000:2.0:1788201667.835194:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (12582912->13631487) req@ffff9624ba20df80 x1875064559738496/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/0 e 0 to 0 dl 1788201678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201667.835205:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20df80 with x1875064559738496 ext(12582912->13631487) 00002000:00010000:2.0:1788201667.835212:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20df80 00000100:00100000:2.0:1788201667.835251:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1083 00000100:00100000:2.0:1788201667.835258:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559738496:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201667.851769:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2342:x1875064559738496:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16499us (17510us total) trans 30064772084 rc 0/0 00000100:00100000:2.0:1788201667.851783:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1083 00002000:00100000:2.0:1788201667.851796:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (12582912->13631487) req@ffff9624ba20df80 x1875064559738496/t30064772084(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:33/0 lens 488/448 e 0 to 0 dl 1788201678 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201667.851806:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20df80 with x1875064559738496 ext(12582912->13631487) 00002000:00010000:2.0:1788201667.851813:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20df80 00000100:00100000:1.0:1788201668.053184:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201668.064128:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559738624 00000100:00100000:2.0:1788201668.064144:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559738624 00002000:00100000:2.0:1788201668.064206:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (13631488->14680063) req@ffff9624ba20f480 x1875064559738624/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/0 e 0 to 0 dl 1788201679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201668.064217:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20f480 with x1875064559738624 ext(13631488->14680063) 00002000:00010000:2.0:1788201668.064223:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20f480 00000100:00100000:2.0:1788201668.064288:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1084 00000100:00100000:2.0:1788201668.064299:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559738624:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201668.090498:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559738624:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26187us (37310us total) trans 30064772085 rc 0/0 00000100:00100000:2.0:1788201668.090515:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1084 00002000:00100000:2.0:1788201668.090529:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (13631488->14680063) req@ffff9624ba20f480 x1875064559738624/t30064772085(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/448 e 0 to 0 dl 1788201679 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201668.090541:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20f480 with x1875064559738624 ext(13631488->14680063) 00002000:00010000:2.0:1788201668.090548:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20f480 00000100:00100000:0.0:1788201668.329571:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201668.330150:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559738752 00000100:00100000:1.0:1788201668.330167:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559738752 00002000:00100000:1.0:1788201668.330246:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (14680064->15728639) req@ffff9623bb439500 x1875064559738752/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/0 e 0 to 0 dl 1788201679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201668.330258:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb439500 with x1875064559738752 ext(14680064->15728639) 00002000:00010000:1.0:1788201668.330264:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb439500 00000100:00100000:1.0:1788201668.330484:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1085 00000100:00100000:1.0:1788201668.330495:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559738752:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201668.339832:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559738752:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9330us (10270us total) trans 30064772086 rc 0/0 00000100:00100000:2.0:1788201668.339843:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1085 00002000:00100000:2.0:1788201668.339857:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (14680064->15728639) req@ffff9623bb439500 x1875064559738752/t30064772086(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/448 e 0 to 0 dl 1788201679 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201668.339866:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb439500 with x1875064559738752 ext(14680064->15728639) 00002000:00010000:2.0:1788201668.339871:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb439500 00010000:00010000:0.0:1788201668.407560:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201668.465058:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201668.465329:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559738880 00000100:00100000:0.0:1788201668.465375:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559738880 00002000:00100000:0.0:1788201668.465467:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (15728640->16777215) req@ffff9623939e0000 x1875064559738880/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/0 e 0 to 0 dl 1788201679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201668.465478:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0000 with x1875064559738880 ext(15728640->16777215) 00002000:00010000:0.0:1788201668.465486:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0000 00000100:00100000:0.0:1788201668.465526:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1086 00000100:00100000:0.0:1788201668.465536:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559738880:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201668.476542:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559738880:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10186us (10673us total) trans 30064772087 rc 0/0 00000100:00100000:2.0:1788201668.476558:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1086 00002000:00100000:2.0:1788201668.476573:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (15728640->16777215) req@ffff9623939e0000 x1875064559738880/t30064772087(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/448 e 0 to 0 dl 1788201679 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201668.476584:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0000 with x1875064559738880 ext(15728640->16777215) 00002000:00010000:2.0:1788201668.476591:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0000 00000100:00100000:1.0:1788201668.559646:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201668.559830:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559739008 00000100:00100000:2.0:1788201668.559849:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559739008 00002000:00100000:2.0:1788201668.559960:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (16777216->17825791) req@ffff9624ba20c000 x1875064559739008/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/0 e 0 to 0 dl 1788201679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201668.559971:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20c000 with x1875064559739008 ext(16777216->17825791) 00002000:00010000:2.0:1788201668.559977:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20c000 00000100:00100000:2.0:1788201668.560014:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1087 00000100:00100000:2.0:1788201668.560025:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559739008:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201668.590856:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559739008:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30815us (31203us total) trans 30064772088 rc 0/0 00000100:00100000:2.0:1788201668.590873:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1087 00002000:00100000:2.0:1788201668.590890:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (16777216->17825791) req@ffff9624ba20c000 x1875064559739008/t30064772088(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/448 e 0 to 0 dl 1788201679 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201668.590902:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20c000 with x1875064559739008 ext(16777216->17825791) 00002000:00010000:2.0:1788201668.590910:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20c000 00000100:00100000:3.0:1788201668.671622:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201668.672279:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559739136 00000100:00100000:2.0:1788201668.672293:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559739136 00002000:00100000:2.0:1788201668.672469:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (17825792->18874367) req@ffff9623939e0e00 x1875064559739136/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/0 e 0 to 0 dl 1788201679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201668.672484:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0e00 with x1875064559739136 ext(17825792->18874367) 00002000:00010000:2.0:1788201668.672492:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0e00 00000100:00100000:2.0:1788201668.672597:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1088 00000100:00100000:2.0:1788201668.672609:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559739136:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201668.704576:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559739136:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31954us (32953us total) trans 30064772089 rc 0/0 00000100:00100000:3.0:1788201668.704593:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1088 00002000:00100000:3.0:1788201668.704610:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (17825792->18874367) req@ffff9623939e0e00 x1875064559739136/t30064772089(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/448 e 0 to 0 dl 1788201679 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201668.704646:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0e00 with x1875064559739136 ext(17825792->18874367) 00002000:00010000:3.0:1788201668.704654:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0e00 00000100:00100000:1.0:1788201668.825485:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201668.825677:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559739264 00000100:00100000:2.0:1788201668.825711:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559739264 00002000:00100000:2.0:1788201668.825795:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (18874368->19922943) req@ffff9624ba20ce00 x1875064559739264/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/0 e 0 to 0 dl 1788201679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201668.825808:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20ce00 with x1875064559739264 ext(18874368->19922943) 00002000:00010000:2.0:1788201668.825815:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20ce00 00000100:00100000:2.0:1788201668.825857:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1089 00000100:00100000:2.0:1788201668.825869:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559739264:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201668.867633:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559739264:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 41755us (42151us total) trans 30064772090 rc 0/0 00000100:00100000:2.0:1788201668.867647:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1089 00002000:00100000:2.0:1788201668.867671:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (18874368->19922943) req@ffff9624ba20ce00 x1875064559739264/t30064772090(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/448 e 0 to 0 dl 1788201679 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201668.867682:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20ce00 with x1875064559739264 ext(18874368->19922943) 00002000:00010000:2.0:1788201668.867690:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20ce00 00000100:00100000:1.0:1788201668.969690:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201668.969969:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559739392 00000100:00100000:0.0:1788201668.969998:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559739392 00002000:00100000:0.0:1788201668.970066:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (19922944->20971519) req@ffff9624ba20e680 x1875064559739392/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/0 e 0 to 0 dl 1788201679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201668.970081:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20e680 with x1875064559739392 ext(19922944->20971519) 00002000:00010000:0.0:1788201668.970087:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20e680 00000100:00100000:0.0:1788201668.970129:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1090 00000100:00100000:0.0:1788201668.970140:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2342:x1875064559739392:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201669.001211:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2342:x1875064559739392:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31056us (31521us total) trans 30064772091 rc 0/0 00000100:00100000:0.0:1788201669.001229:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1090 00002000:00100000:0.0:1788201669.001244:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (19922944->20971519) req@ffff9624ba20e680 x1875064559739392/t30064772091(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:34/0 lens 488/448 e 0 to 0 dl 1788201679 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201669.001257:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20e680 with x1875064559739392 ext(19922944->20971519) 00002000:00010000:0.0:1788201669.001265:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20e680 00000100:00100000:2.0:1788201669.083082:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201669.086127:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559739520 00000100:00100000:3.0:1788201669.086149:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559739520 00002000:00100000:3.0:1788201669.086253:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (20971520->22020095) req@ffff96248c9c6a00 x1875064559739520/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:35/0 lens 488/0 e 0 to 0 dl 1788201680 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201669.086268:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c6a00 with x1875064559739520 ext(20971520->22020095) 00002000:00010000:3.0:1788201669.086274:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c6a00 00000100:00100000:3.0:1788201669.086557:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1091 00000100:00100000:3.0:1788201669.086575:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559739520:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201669.086858:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201669.111470:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559739520:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24879us (28384us total) trans 30064772092 rc 0/0 00000100:00100000:2.0:1788201669.111496:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1091 00002000:00100000:2.0:1788201669.111519:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (20971520->22020095) req@ffff96248c9c6a00 x1875064559739520/t30064772092(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:35/0 lens 488/448 e 0 to 0 dl 1788201680 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201669.111535:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c6a00 with x1875064559739520 ext(20971520->22020095) 00002000:00010000:2.0:1788201669.111544:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c6a00 00000100:00100000:3.0:1788201669.207649:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201669.207789:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559739648 00000100:00100000:2.0:1788201669.207803:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559739648 00002000:00100000:2.0:1788201669.207901:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (22020096->23068671) req@ffff9623939e2680 x1875064559739648/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:35/0 lens 488/0 e 0 to 0 dl 1788201680 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201669.207913:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2680 with x1875064559739648 ext(22020096->23068671) 00002000:00010000:2.0:1788201669.207920:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2680 00000100:00100000:2.0:1788201669.207962:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1092 00000100:00100000:2.0:1788201669.207973:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2341:x1875064559739648:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201669.232379:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2341:x1875064559739648:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24361us (24700us total) trans 30064772093 rc 0/0 00000100:00100000:2.0:1788201669.232407:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1092 00002000:00100000:2.0:1788201669.232426:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (22020096->23068671) req@ffff9623939e2680 x1875064559739648/t30064772093(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:35/0 lens 488/448 e 0 to 0 dl 1788201680 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201669.232439:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2680 with x1875064559739648 ext(22020096->23068671) 00002000:00010000:2.0:1788201669.232448:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2680 00000100:00100000:3.0:1788201669.348910:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201669.349051:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559739776 00000100:00100000:2.0:1788201669.349067:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559739776 00002000:00100000:2.0:1788201669.349134:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (23068672->24117247) req@ffff9623939e2a00 x1875064559739776/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:35/0 lens 488/0 e 0 to 0 dl 1788201680 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201669.349145:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2a00 with x1875064559739776 ext(23068672->24117247) 00002000:00010000:2.0:1788201669.349151:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2a00 00000100:00100000:2.0:1788201669.349192:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1093 00000100:00100000:2.0:1788201669.349204:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2344:x1875064559739776:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201669.372775:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559739776:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23557us (23866us total) trans 30064772094 rc 0/0 00000100:00100000:2.0:1788201669.372815:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1093 00002000:00100000:2.0:1788201669.372833:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (23068672->24117247) req@ffff9623939e2a00 x1875064559739776/t30064772094(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:35/0 lens 488/448 e 0 to 0 dl 1788201680 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201669.372845:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e2a00 with x1875064559739776 ext(23068672->24117247) 00002000:00010000:2.0:1788201669.372853:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e2a00 00010000:00010000:2.0:1788201669.430657:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201669.503492:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201669.503627:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559739904 00000100:00100000:2.0:1788201669.503642:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559739904 00002000:00100000:2.0:1788201669.503722:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (24117248->25165823) req@ffff9623bb438380 x1875064559739904/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:35/0 lens 488/0 e 0 to 0 dl 1788201680 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201669.503736:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb438380 with x1875064559739904 ext(24117248->25165823) 00002000:00010000:2.0:1788201669.503743:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb438380 00000100:00100000:2.0:1788201669.503786:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1094 00000100:00100000:2.0:1788201669.503797:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559739904:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201669.533232:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559739904:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29415us (29886us total) trans 30064772095 rc 0/0 00000100:00100000:2.0:1788201669.533254:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1094 00002000:00100000:2.0:1788201669.533274:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (24117248->25165823) req@ffff9623bb438380 x1875064559739904/t30064772095(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:35/0 lens 488/448 e 0 to 0 dl 1788201680 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201669.533287:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb438380 with x1875064559739904 ext(24117248->25165823) 00002000:00010000:2.0:1788201669.533296:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb438380 00000100:00100000:0.0:1788201669.635265:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201669.635500:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559740032 00000100:00100000:3.0:1788201669.635510:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559740032 00002000:00100000:3.0:1788201669.635569:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (25165824->26214399) req@ffff9623bb439f80 x1875064559740032/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:35/0 lens 488/0 e 0 to 0 dl 1788201680 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201669.635581:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb439f80 with x1875064559740032 ext(25165824->26214399) 00002000:00010000:3.0:1788201669.635586:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb439f80 00000100:00100000:3.0:1788201669.635619:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1095 00000100:00100000:3.0:1788201669.635629:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559740032:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201669.687138:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201669.687179:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba20ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570165888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201669.687282:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201669.687828:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570165888 00000100:00100000:0.0:1788201669.687840:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570165888 00000100:00100000:0.0:1788201669.687947:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788201669.687958:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570165888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201669.687993:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 568655872 pending 42598400 free 2786066432 avail 2783969280 00000100:00100000:0.0:1788201669.688056:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570165888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201669.688064:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:0.0:1788201669.688091:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201669.689332:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba20ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570165888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201669.690251:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559740032:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 54614us (54988us total) trans 30064772096 rc 0/0 00000100:00100000:2.0:1788201669.690286:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1095 00002000:00100000:2.0:1788201669.690301:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (25165824->26214399) req@ffff9623bb439f80 x1875064559740032/t30064772096(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:35/0 lens 488/448 e 0 to 0 dl 1788201680 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201669.690313:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb439f80 with x1875064559740032 ext(25165824->26214399) 00002000:00010000:2.0:1788201669.690320:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb439f80 00000100:00100000:0.0:1788201669.812971:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201669.813099:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559740160 00000100:00100000:3.0:1788201669.813114:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559740160 00002000:00100000:3.0:1788201669.813207:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (26214400->27262975) req@ffff9623bb43b480 x1875064559740160/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:35/0 lens 488/0 e 0 to 0 dl 1788201680 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201669.813599:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb43b480 with x1875064559740160 ext(26214400->27262975) 00002000:00010000:3.0:1788201669.813608:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb43b480 00000100:00100000:3.0:1788201669.813662:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1096 00000100:00100000:3.0:1788201669.813676:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559740160:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201669.839276:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559740160:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25582us (26302us total) trans 30064772097 rc 0/0 00000100:00100000:2.0:1788201669.839296:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1096 00002000:00100000:2.0:1788201669.839311:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (26214400->27262975) req@ffff9623bb43b480 x1875064559740160/t30064772097(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:35/0 lens 488/448 e 0 to 0 dl 1788201680 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201669.839324:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb43b480 with x1875064559740160 ext(26214400->27262975) 00002000:00010000:2.0:1788201669.839332:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb43b480 00000100:00100000:1.0:1788201670.043048:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201670.043172:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559740288 00000100:00100000:2.0:1788201670.043186:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559740288 00002000:00100000:2.0:1788201670.043254:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (27262976->28311551) req@ffff9624ba20ed80 x1875064559740288/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/0 e 0 to 0 dl 1788201681 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201670.043266:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20ed80 with x1875064559740288 ext(27262976->28311551) 00002000:00010000:2.0:1788201670.043273:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20ed80 00000100:00100000:2.0:1788201670.043317:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1097 00000100:00100000:2.0:1788201670.043329:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2342:x1875064559740288:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201670.066123:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2342:x1875064559740288:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22780us (23077us total) trans 30064772098 rc 0/0 00000100:00100000:2.0:1788201670.066139:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1097 00002000:00100000:2.0:1788201670.066172:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (27262976->28311551) req@ffff9624ba20ed80 x1875064559740288/t30064772098(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/448 e 0 to 0 dl 1788201681 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201670.066184:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20ed80 with x1875064559740288 ext(27262976->28311551) 00002000:00010000:2.0:1788201670.066192:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20ed80 00000100:00100000:1.0:1788201670.182448:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201670.182997:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559740416 00000100:00100000:2.0:1788201670.183012:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559740416 00002000:00100000:2.0:1788201670.183088:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (28311552->29360127) req@ffff9624ba20fb80 x1875064559740416/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/0 e 0 to 0 dl 1788201681 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201670.183101:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20fb80 with x1875064559740416 ext(28311552->29360127) 00002000:00010000:2.0:1788201670.183108:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20fb80 00000100:00100000:2.0:1788201670.183157:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1098 00000100:00100000:2.0:1788201670.183170:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2344:x1875064559740416:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201670.202210:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2344:x1875064559740416:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19029us (19765us total) trans 30064772099 rc 0/0 00000100:00100000:2.0:1788201670.202224:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1098 00002000:00100000:2.0:1788201670.202237:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (28311552->29360127) req@ffff9624ba20fb80 x1875064559740416/t30064772099(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/448 e 0 to 0 dl 1788201681 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201670.202249:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20fb80 with x1875064559740416 ext(28311552->29360127) 00002000:00010000:2.0:1788201670.202255:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20fb80 00000100:00100000:2.0:1788201670.362468:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201670.362558:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559740544 00000100:00100000:0.0:1788201670.362567:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559740544 00002000:00100000:0.0:1788201670.362621:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (29360128->30408703) req@ffff96248c9c4a80 x1875064559740544/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/0 e 0 to 0 dl 1788201681 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201670.362633:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4a80 with x1875064559740544 ext(29360128->30408703) 00002000:00010000:0.0:1788201670.362639:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4a80 00000100:00100000:0.0:1788201670.362671:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1099 00000100:00100000:0.0:1788201670.362679:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2342:x1875064559740544:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201670.376060:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2342:x1875064559740544:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13368us (13588us total) trans 30064772100 rc 0/0 00000100:00100000:0.0:1788201670.376076:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1099 00002000:00100000:0.0:1788201670.376090:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (29360128->30408703) req@ffff96248c9c4a80 x1875064559740544/t30064772100(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/448 e 0 to 0 dl 1788201681 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201670.376102:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4a80 with x1875064559740544 ext(29360128->30408703) 00002000:00010000:0.0:1788201670.376108:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4a80 00010000:00010000:2.0:1788201670.454687:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201670.516930:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201670.517188:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559740672 00000100:00100000:3.0:1788201670.517198:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559740672 00002000:00100000:3.0:1788201670.517261:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (30408704->31457279) req@ffff9624ba20d180 x1875064559740672/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/0 e 0 to 0 dl 1788201681 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201670.517273:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20d180 with x1875064559740672 ext(30408704->31457279) 00002000:00010000:3.0:1788201670.517279:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20d180 00000100:00100000:3.0:1788201670.517315:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1100 00000100:00100000:3.0:1788201670.517327:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2343:x1875064559740672:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201670.538456:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2343:x1875064559740672:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21116us (21522us total) trans 30064772101 rc 0/0 00000100:00100000:3.0:1788201670.538473:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1100 00002000:00100000:3.0:1788201670.538488:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (30408704->31457279) req@ffff9624ba20d180 x1875064559740672/t30064772101(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/448 e 0 to 0 dl 1788201681 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201670.538499:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20d180 with x1875064559740672 ext(30408704->31457279) 00002000:00010000:3.0:1788201670.538505:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20d180 00000100:00100000:1.0:1788201670.620544:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201670.620683:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559740800 00000100:00100000:2.0:1788201670.620711:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559740800 00002000:00100000:2.0:1788201670.620777:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (31457280->32505855) req@ffff9624ba20ca80 x1875064559740800/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/0 e 0 to 0 dl 1788201681 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201670.620810:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20ca80 with x1875064559740800 ext(31457280->32505855) 00002000:00010000:2.0:1788201670.620816:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20ca80 00000100:00100000:2.0:1788201670.620864:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1101 00000100:00100000:2.0:1788201670.620875:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2344:x1875064559740800:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201670.663136:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2344:x1875064559740800:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 42246us (42591us total) trans 30064772102 rc 0/0 00000100:00100000:1.0:1788201670.664491:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1101 00002000:00100000:1.0:1788201670.664521:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (31457280->32505855) req@ffff9624ba20ca80 x1875064559740800/t30064772102(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/448 e 0 to 0 dl 1788201681 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201670.664561:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20ca80 with x1875064559740800 ext(31457280->32505855) 00002000:00010000:1.0:1788201670.664568:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20ca80 00000100:00100000:3.0:1788201670.785426:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201670.785596:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559740928 00000100:00100000:2.0:1788201670.785610:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559740928 00002000:00100000:2.0:1788201670.785687:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (32505856->33554431) req@ffff9623939e0a80 x1875064559740928/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/0 e 0 to 0 dl 1788201681 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201670.785698:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0a80 with x1875064559740928 ext(32505856->33554431) 00002000:00010000:2.0:1788201670.785705:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0a80 00000100:00100000:2.0:1788201670.785745:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1102 00000100:00100000:2.0:1788201670.785758:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2343:x1875064559740928:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201670.814599:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+70:2343:x1875064559740928:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28826us (29172us total) trans 30064772103 rc 0/0 00000100:00100000:2.0:1788201670.814616:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1102 00002000:00100000:2.0:1788201670.814633:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (32505856->33554431) req@ffff9623939e0a80 x1875064559740928/t30064772103(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/448 e 0 to 0 dl 1788201681 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201670.814644:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0a80 with x1875064559740928 ext(32505856->33554431) 00002000:00010000:2.0:1788201670.814651:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0a80 00000100:00100000:1.0:1788201670.936886:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201670.937012:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559741056 00000100:00100000:0.0:1788201670.937026:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559741056 00002000:00100000:0.0:1788201670.937110:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (33554432->34603007) req@ffff9624ba20d880 x1875064559741056/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/0 e 0 to 0 dl 1788201681 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201670.937124:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20d880 with x1875064559741056 ext(33554432->34603007) 00002000:00010000:0.0:1788201670.937130:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20d880 00000100:00100000:0.0:1788201670.937179:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1103 00000100:00100000:0.0:1788201670.937191:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+70:2344:x1875064559741056:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201670.958231:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+72:2344:x1875064559741056:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21027us (21346us total) trans 30064772104 rc 0/0 00000100:00100000:2.0:1788201670.958246:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1103 00002000:00100000:2.0:1788201670.958274:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (33554432->34603007) req@ffff9624ba20d880 x1875064559741056/t30064772104(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:36/0 lens 488/448 e 0 to 0 dl 1788201681 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201670.958286:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20d880 with x1875064559741056 ext(33554432->34603007) 00002000:00010000:2.0:1788201670.958293:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20d880 00000100:00100000:3.0:1788201671.112159:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201671.112389:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559741184 00000100:00100000:2.0:1788201671.112403:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559741184 00002000:00100000:2.0:1788201671.112496:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (34603008->35651583) req@ffff9623939e1180 x1875064559741184/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:37/0 lens 488/0 e 0 to 0 dl 1788201682 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201671.112511:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1180 with x1875064559741184 ext(34603008->35651583) 00002000:00010000:2.0:1788201671.112518:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1180 00000100:00100000:2.0:1788201671.112563:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1104 00000100:00100000:2.0:1788201671.112578:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+72:2343:x1875064559741184:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201671.112740:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201671.144898:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+74:2343:x1875064559741184:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32306us (32747us total) trans 30064772105 rc 0/0 00000100:00100000:2.0:1788201671.144915:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1104 00002000:00100000:2.0:1788201671.144930:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (34603008->35651583) req@ffff9623939e1180 x1875064559741184/t30064772105(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:37/0 lens 488/448 e 0 to 0 dl 1788201682 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201671.144943:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1180 with x1875064559741184 ext(34603008->35651583) 00002000:00010000:2.0:1788201671.144950:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1180 00000100:00100000:1.0:1788201671.247025:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201671.247079:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559741312 00000100:00100000:1.0:1788201671.247093:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559741312 00002000:00100000:1.0:1788201671.247181:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (35651584->36700159) req@ffff9624ba20f100 x1875064559741312/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:37/0 lens 488/0 e 0 to 0 dl 1788201682 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201671.247196:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20f100 with x1875064559741312 ext(35651584->36700159) 00002000:00010000:1.0:1788201671.247204:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20f100 00000100:00100000:1.0:1788201671.247241:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1105 00000100:00100000:1.0:1788201671.247253:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba20f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+74:2342:x1875064559741312:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201671.266984:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba20f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+76:2342:x1875064559741312:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19715us (19958us total) trans 30064772106 rc 0/0 00000100:00100000:1.0:1788201671.267002:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1105 00002000:00100000:1.0:1788201671.267019:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (35651584->36700159) req@ffff9624ba20f100 x1875064559741312/t30064772106(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:37/0 lens 488/448 e 0 to 0 dl 1788201682 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201671.267031:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba20f100 with x1875064559741312 ext(35651584->36700159) 00002000:00010000:1.0:1788201671.267039:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba20f100 00000001:00080000:3.0:1788201671.351882:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772100 is committed 00000001:00080000:3.0:1788201671.351935:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772102 is committed 00000001:00080000:3.0:1788201671.351953:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772105 is committed 00000100:00100000:1.0:1788201671.360245:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201671.360467:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559741440 00000100:00100000:3.0:1788201671.360477:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559741440 00002000:00100000:3.0:1788201671.360529:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (36700160->37748735) req@ffff9624ba1d4e00 x1875064559741440/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:37/0 lens 488/0 e 0 to 0 dl 1788201682 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201671.360651:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d4e00 with x1875064559741440 ext(36700160->37748735) 00002000:00010000:3.0:1788201671.360659:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d4e00 00000100:00100000:3.0:1788201671.360789:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1106 00000100:00100000:3.0:1788201671.360800:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2344:x1875064559741440:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201671.366451:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559741440:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 5640us (6204us total) trans 30064772107 rc 0/0 00000100:00100000:3.0:1788201671.366466:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1106 00002000:00100000:3.0:1788201671.366478:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (36700160->37748735) req@ffff9624ba1d4e00 x1875064559741440/t30064772107(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:37/0 lens 488/448 e 0 to 0 dl 1788201682 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201671.366490:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d4e00 with x1875064559741440 ext(36700160->37748735) 00002000:00010000:3.0:1788201671.366496:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d4e00 00000100:00100000:0.0:1788201671.475608:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201671.475689:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201671.475785:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559741696 00000100:00100000:2.0:1788201671.475796:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559741696 00000100:00100000:2.0:1788201671.475874:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 479 00000100:00100000:2.0:1788201671.475885:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559741696:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1788201671.475964:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559741696:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201671.475985:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 479 00000100:00080000:0.0:1788201671.476043:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201671.481478:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559741568 00000100:00100000:3.0:1788201671.481494:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559741568 00000100:00100000:3.0:1788201671.481907:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 582 00000100:00100000:3.0:1788201671.481919:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559741568:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201671.482011:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2343:x1875064559741568:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 94us (6414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201671.482019:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 582 00010000:00010000:0.0:1788201671.485257:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201671.523700:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201671.523943:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559741824 00000100:00100000:1.0:1788201671.523955:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559741824 00002000:00100000:1.0:1788201671.524051:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (37748736->38797311) req@ffff9623bb438000 x1875064559741824/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:37/0 lens 488/0 e 0 to 0 dl 1788201682 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201671.524083:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb438000 with x1875064559741824 ext(37748736->38797311) 00002000:00010000:1.0:1788201671.524090:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb438000 00000100:00100000:1.0:1788201671.524262:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1107 00000100:00100000:1.0:1788201671.524273:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559741824:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201671.538523:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559741824:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14240us (14822us total) trans 30064772108 rc 0/0 00000100:00100000:1.0:1788201671.538539:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1107 00002000:00100000:1.0:1788201671.538553:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (37748736->38797311) req@ffff9623bb438000 x1875064559741824/t30064772108(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:37/0 lens 488/448 e 0 to 0 dl 1788201682 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201671.538564:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb438000 with x1875064559741824 ext(37748736->38797311) 00002000:00010000:1.0:1788201671.538570:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb438000 00000100:00100000:0.0:1788201671.766436:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201671.767470:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559741952 00000100:00100000:2.0:1788201671.767483:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559741952 00002000:00100000:2.0:1788201671.767545:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (38797312->39845887) req@ffff9623bb438e00 x1875064559741952/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:37/0 lens 488/0 e 0 to 0 dl 1788201682 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201671.767556:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb438e00 with x1875064559741952 ext(38797312->39845887) 00002000:00010000:2.0:1788201671.767562:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb438e00 00000100:00100000:2.0:1788201671.767601:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1108 00000100:00100000:2.0:1788201671.767611:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559741952:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201671.798396:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559741952:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30776us (31961us total) trans 30064772109 rc 0/0 00000100:00100000:2.0:1788201671.798410:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1108 00002000:00100000:2.0:1788201671.798424:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (38797312->39845887) req@ffff9623bb438e00 x1875064559741952/t30064772109(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:37/0 lens 488/448 e 0 to 0 dl 1788201682 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201671.798437:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb438e00 with x1875064559741952 ext(38797312->39845887) 00002000:00010000:2.0:1788201671.798443:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb438e00 00000100:00100000:0.0:1788201672.061066:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201672.061247:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559742080 00000100:00100000:2.0:1788201672.061256:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559742080 00002000:00100000:2.0:1788201672.061306:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (39845888->40894463) req@ffff9623bb438a80 x1875064559742080/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:38/0 lens 488/0 e 0 to 0 dl 1788201683 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201672.061318:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb438a80 with x1875064559742080 ext(39845888->40894463) 00002000:00010000:2.0:1788201672.061324:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb438a80 00000100:00100000:2.0:1788201672.061409:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1109 00000100:00100000:2.0:1788201672.061433:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559742080:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201672.071131:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2343:x1875064559742080:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9690us (10066us total) trans 30064772110 rc 0/0 00000100:00100000:2.0:1788201672.071144:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1109 00002000:00100000:2.0:1788201672.071155:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (39845888->40894463) req@ffff9623bb438a80 x1875064559742080/t30064772110(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:38/0 lens 488/448 e 0 to 0 dl 1788201683 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201672.071166:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb438a80 with x1875064559742080 ext(39845888->40894463) 00002000:00010000:2.0:1788201672.071172:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb438a80 00000100:00100000:1.0:1788201672.246734:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201672.246762:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570166016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201672.246849:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201672.247059:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570166016 00000100:00100000:3.0:1788201672.247080:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570166016 00000100:00100000:3.0:1788201672.247152:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788201672.247163:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570166016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201672.247202:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201672.247255:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570166016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201672.247262:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00080000:3.0:1788201672.247305:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9623939e1500 x1875064570166016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201672.247322:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570166016:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201672.247452:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201672.364481:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201672.364609:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559742208 00000100:00100000:3.0:1788201672.364619:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559742208 00002000:00100000:3.0:1788201672.364672:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (40894464->41943039) req@ffff9624b9d27100 x1875064559742208/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:38/0 lens 488/0 e 0 to 0 dl 1788201683 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201672.364685:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27100 with x1875064559742208 ext(40894464->41943039) 00002000:00010000:3.0:1788201672.364692:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27100 00000100:00100000:3.0:1788201672.364729:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1110 00000100:00100000:3.0:1788201672.364740:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559742208:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201672.379561:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559742208:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14811us (15082us total) trans 30064772111 rc 0/0 00000100:00100000:3.0:1788201672.379576:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1110 00002000:00100000:3.0:1788201672.379588:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (40894464->41943039) req@ffff9624b9d27100 x1875064559742208/t30064772111(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:38/0 lens 488/448 e 0 to 0 dl 1788201683 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201672.379599:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27100 with x1875064559742208 ext(40894464->41943039) 00002000:00010000:3.0:1788201672.379617:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27100 00010000:00010000:2.0:1788201672.502670:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201672.543797:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201672.544171:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559742336 00000100:00100000:2.0:1788201672.544183:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559742336 00002000:00100000:2.0:1788201672.544242:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (41943040->42991615) req@ffff9624ba1d6d80 x1875064559742336/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:38/0 lens 488/0 e 0 to 0 dl 1788201683 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201672.544254:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d6d80 with x1875064559742336 ext(41943040->42991615) 00002000:00010000:2.0:1788201672.544260:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d6d80 00000100:00100000:2.0:1788201672.544295:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1111 00000100:00100000:2.0:1788201672.544305:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2344:x1875064559742336:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201672.557639:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559742336:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13322us (13838us total) trans 30064772112 rc 0/0 00000100:00100000:2.0:1788201672.557652:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1111 00002000:00100000:2.0:1788201672.557665:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (41943040->42991615) req@ffff9624ba1d6d80 x1875064559742336/t30064772112(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:38/0 lens 488/448 e 0 to 0 dl 1788201683 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201672.557675:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d6d80 with x1875064559742336 ext(41943040->42991615) 00002000:00010000:2.0:1788201672.557695:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d6d80 00000100:00100000:0.0:1788201672.683230:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201672.683864:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559742464 00000100:00100000:2.0:1788201672.683875:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559742464 00002000:00100000:2.0:1788201672.683930:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (42991616->44040191) req@ffff9624b9d27b80 x1875064559742464/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:38/0 lens 488/0 e 0 to 0 dl 1788201683 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201672.683943:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27b80 with x1875064559742464 ext(42991616->44040191) 00002000:00010000:2.0:1788201672.683948:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27b80 00000100:00100000:2.0:1788201672.683984:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1112 00000100:00100000:2.0:1788201672.683995:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559742464:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201672.705273:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559742464:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21269us (22043us total) trans 30064772113 rc 0/0 00000100:00100000:2.0:1788201672.705289:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1112 00002000:00100000:2.0:1788201672.705301:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (42991616->44040191) req@ffff9624b9d27b80 x1875064559742464/t30064772113(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:38/0 lens 488/448 e 0 to 0 dl 1788201683 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201672.705313:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27b80 with x1875064559742464 ext(42991616->44040191) 00002000:00010000:2.0:1788201672.705320:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27b80 00000100:00100000:3.0:1788201672.758642:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570166400:0@lo:400:kworker.0 00000100:00100000:3.0:1788201672.758733:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201672.758800:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201672.758808:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570166272:0@lo:400:kworker.0 00000100:00100000:3.0:1788201672.758834:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201672.758866:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570166400 00000100:00100000:3.0:1788201672.758874:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570166400 00000100:00100000:3.0:1788201672.758931:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788201672.758941:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570166400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201672.758995:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570166400:12345-0@lo:400:kworker.0 Request processed in 56us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201672.759002:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788201672.759068:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570166400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201672.759253:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570166272 00000100:00100000:1.0:1788201672.759258:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570166272 00000100:00100000:1.0:1788201672.759297:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1788201672.759304:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570166272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201672.759378:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875064570166272:12345-0@lo:400:kworker.0 Request processed in 75us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201672.759385:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00080000:1.0:1788201672.759403:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201672.759440:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875064570166272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201672.759458:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570166144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201672.759491:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201672.759514:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570166656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201672.759534:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201672.759551:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201672.759557:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623939e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570166528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201672.759579:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201672.759603:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570166656 00000100:00100000:1.0:1788201672.759607:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570166656 00000100:00100000:1.0:1788201672.759631:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570166528 00000100:00100000:1.0:1788201672.759634:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570166528 00000100:00100000:1.0:1788201672.759649:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1788201672.759655:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570166656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201672.759690:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570166656:12345-0@lo:400:kworker.0 Request processed in 35us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201672.759696:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1788201672.759708:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1788201672.759714:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570166528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201672.759754:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875064570166528:12345-0@lo:400:kworker.0 Request processed in 40us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201672.759761:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00080000:1.0:1788201672.759775:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201672.759805:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875064570166528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201672.759816:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570166656:0@lo:400:kworker.0 00000100:00100000:0.0:1788201672.760249:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570166144 00000100:00100000:0.0:1788201672.760254:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570166144 00000100:00100000:0.0:1788201672.760293:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1788201672.760301:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570166144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201672.760381:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3283:x1875064570166144:12345-0@lo:400:kworker.0 Request processed in 81us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201672.760387:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:3.0:1788201672.760470:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623939e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3283:1875064570166144:0@lo:400:kworker.0 00000100:00100000:0.0:1788201672.842016:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201672.842103:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559742592 00000100:00100000:1.0:1788201672.842112:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559742592 00002000:00100000:1.0:1788201672.842168:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (44040192->45088767) req@ffff9624b9d24700 x1875064559742592/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:38/0 lens 488/0 e 0 to 0 dl 1788201683 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201672.842180:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24700 with x1875064559742592 ext(44040192->45088767) 00002000:00010000:1.0:1788201672.842192:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24700 00000100:00100000:1.0:1788201672.842221:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1113 00000100:00100000:1.0:1788201672.842230:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559742592:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201672.856101:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559742592:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13852us (14074us total) trans 30064772114 rc 0/0 00000100:00100000:1.0:1788201672.856133:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1113 00002000:00100000:1.0:1788201672.856152:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (44040192->45088767) req@ffff9624b9d24700 x1875064559742592/t30064772114(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:38/0 lens 488/448 e 0 to 0 dl 1788201683 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201672.856164:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24700 with x1875064559742592 ext(44040192->45088767) 00002000:00010000:1.0:1788201672.856173:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24700 00000100:00100000:0.0:1788201673.008136:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201673.008463:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559742720 00000100:00100000:3.0:1788201673.008474:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559742720 00002000:00100000:3.0:1788201673.008555:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (45088768->46137343) req@ffff9624b9d25500 x1875064559742720/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/0 e 0 to 0 dl 1788201684 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201673.008568:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25500 with x1875064559742720 ext(45088768->46137343) 00002000:00010000:3.0:1788201673.008574:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25500 00000100:00080000:1.0:1788201673.008592:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201673.008626:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1114 00000100:00100000:3.0:1788201673.008639:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559742720:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201673.042612:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559742720:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33959us (34471us total) trans 30064772115 rc 0/0 00000100:00100000:2.0:1788201673.042630:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1114 00002000:00100000:2.0:1788201673.042648:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (45088768->46137343) req@ffff9624b9d25500 x1875064559742720/t30064772115(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/448 e 0 to 0 dl 1788201684 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201673.042660:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25500 with x1875064559742720 ext(45088768->46137343) 00002000:00010000:2.0:1788201673.042669:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25500 00000100:00100000:1.0:1788201673.193633:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201673.193806:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559742848 00000100:00100000:2.0:1788201673.193833:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559742848 00002000:00100000:2.0:1788201673.193884:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (46137344->47185919) req@ffff9624ba1d7b80 x1875064559742848/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/0 e 0 to 0 dl 1788201684 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201673.193894:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d7b80 with x1875064559742848 ext(46137344->47185919) 00002000:00010000:2.0:1788201673.193901:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d7b80 00000100:00100000:2.0:1788201673.193933:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1115 00000100:00100000:2.0:1788201673.193943:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559742848:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201673.213564:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559742848:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19603us (19924us total) trans 30064772116 rc 0/0 00000100:00100000:2.0:1788201673.213585:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1115 00002000:00100000:2.0:1788201673.213604:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (46137344->47185919) req@ffff9624ba1d7b80 x1875064559742848/t30064772116(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/448 e 0 to 0 dl 1788201684 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201673.213617:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d7b80 with x1875064559742848 ext(46137344->47185919) 00002000:00010000:2.0:1788201673.213626:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d7b80 00000100:00100000:3.0:1788201673.285304:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201673.287210:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559742976 00000100:00100000:2.0:1788201673.287227:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559742976 00002000:00100000:2.0:1788201673.287298:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (47185920->48234495) req@ffff9623939e1500 x1875064559742976/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/0 e 0 to 0 dl 1788201684 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201673.287311:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1500 with x1875064559742976 ext(47185920->48234495) 00002000:00010000:2.0:1788201673.287318:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1500 00000100:00100000:2.0:1788201673.287386:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1116 00000100:00100000:2.0:1788201673.287399:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559742976:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201673.303496:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2342:x1875064559742976:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16087us (18195us total) trans 30064772117 rc 0/0 00000100:00100000:2.0:1788201673.303532:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1116 00002000:00100000:2.0:1788201673.303546:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (47185920->48234495) req@ffff9623939e1500 x1875064559742976/t30064772117(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/448 e 0 to 0 dl 1788201684 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201673.303557:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1500 with x1875064559742976 ext(47185920->48234495) 00002000:00010000:2.0:1788201673.303563:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1500 00000100:00100000:3.0:1788201673.461535:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201673.461646:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559743104 00000100:00100000:1.0:1788201673.461656:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559743104 00002000:00100000:1.0:1788201673.461717:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (48234496->49283071) req@ffff9623939e0380 x1875064559743104/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/0 e 0 to 0 dl 1788201684 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201673.461727:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0380 with x1875064559743104 ext(48234496->49283071) 00002000:00010000:1.0:1788201673.461733:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0380 00000100:00100000:1.0:1788201673.461765:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1117 00000100:00100000:1.0:1788201673.461779:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559743104:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201673.474924:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559743104:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13135us (13392us total) trans 30064772118 rc 0/0 00000100:00100000:1.0:1788201673.474940:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1117 00002000:00100000:1.0:1788201673.474952:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (48234496->49283071) req@ffff9623939e0380 x1875064559743104/t30064772118(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/448 e 0 to 0 dl 1788201684 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201673.474963:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e0380 with x1875064559743104 ext(48234496->49283071) 00002000:00010000:1.0:1788201673.474969:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e0380 00010000:00010000:2.0:1788201673.529220:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201673.543142:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201673.548783:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559743232 00000100:00100000:2.0:1788201673.548798:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559743232 00002000:00100000:2.0:1788201673.548861:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (49283072->50331647) req@ffff9623939e3480 x1875064559743232/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/0 e 0 to 0 dl 1788201684 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201673.548873:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3480 with x1875064559743232 ext(49283072->50331647) 00002000:00010000:2.0:1788201673.548880:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3480 00000100:00100000:2.0:1788201673.549203:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1118 00000100:00100000:2.0:1788201673.549215:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2341:x1875064559743232:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201673.574221:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559743232:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24997us (31095us total) trans 30064772119 rc 0/0 00000100:00100000:2.0:1788201673.574235:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1118 00002000:00100000:2.0:1788201673.574251:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (49283072->50331647) req@ffff9623939e3480 x1875064559743232/t30064772119(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/448 e 0 to 0 dl 1788201684 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201673.574264:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3480 with x1875064559743232 ext(49283072->50331647) 00002000:00010000:2.0:1788201673.574271:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3480 00000100:00100000:3.0:1788201673.676887:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201673.677212:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559743360 00000100:00100000:2.0:1788201673.677222:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559743360 00002000:00100000:2.0:1788201673.677280:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (50331648->51380223) req@ffff9623939e1f80 x1875064559743360/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/0 e 0 to 0 dl 1788201684 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201673.677292:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1f80 with x1875064559743360 ext(50331648->51380223) 00002000:00010000:2.0:1788201673.677297:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1f80 00000100:00100000:2.0:1788201673.677421:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1119 00000100:00100000:2.0:1788201673.677431:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2342:x1875064559743360:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201673.690609:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2342:x1875064559743360:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13165us (13719us total) trans 30064772120 rc 0/0 00000100:00100000:2.0:1788201673.690626:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1119 00002000:00100000:2.0:1788201673.690642:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (50331648->51380223) req@ffff9623939e1f80 x1875064559743360/t30064772120(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/448 e 0 to 0 dl 1788201684 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201673.690653:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e1f80 with x1875064559743360 ext(50331648->51380223) 00002000:00010000:2.0:1788201673.690659:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e1f80 00000100:00100000:0.0:1788201673.895454:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201673.895602:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559743488 00000100:00100000:3.0:1788201673.895613:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559743488 00002000:00100000:3.0:1788201673.895666:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (51380224->52428799) req@ffff9624b9d25f80 x1875064559743488/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/0 e 0 to 0 dl 1788201684 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201673.895679:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25f80 with x1875064559743488 ext(51380224->52428799) 00002000:00010000:3.0:1788201673.895689:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25f80 00000100:00100000:3.0:1788201673.895725:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1120 00000100:00100000:3.0:1788201673.895735:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559743488:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201673.915128:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559743488:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19383us (19675us total) trans 30064772121 rc 0/0 00000100:00100000:2.0:1788201673.915146:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1120 00002000:00100000:2.0:1788201673.915162:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (51380224->52428799) req@ffff9624b9d25f80 x1875064559743488/t30064772121(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:39/0 lens 488/448 e 0 to 0 dl 1788201684 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201673.915174:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25f80 with x1875064559743488 ext(51380224->52428799) 00002000:00010000:2.0:1788201673.915181:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25f80 00000100:00100000:0.0:1788201674.025968:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201674.026056:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559743616 00000100:00100000:1.0:1788201674.026065:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559743616 00002000:00100000:1.0:1788201674.026110:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (52428800->53477375) req@ffff9624b9d27480 x1875064559743616/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/0 e 0 to 0 dl 1788201685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201674.026118:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27480 with x1875064559743616 ext(52428800->53477375) 00002000:00010000:1.0:1788201674.026122:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27480 00000100:00100000:1.0:1788201674.026192:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1121 00000100:00100000:1.0:1788201674.026200:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559743616:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201674.046189:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559743616:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19978us (20219us total) trans 30064772122 rc 0/0 00000100:00100000:1.0:1788201674.046203:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1121 00002000:00100000:1.0:1788201674.046215:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (52428800->53477375) req@ffff9624b9d27480 x1875064559743616/t30064772122(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/448 e 0 to 0 dl 1788201685 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201674.046226:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27480 with x1875064559743616 ext(52428800->53477375) 00002000:00010000:1.0:1788201674.046232:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27480 00000100:00100000:2.0:1788201674.169705:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201674.169918:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559743744 00000100:00100000:3.0:1788201674.169929:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559743744 00002000:00100000:3.0:1788201674.169977:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (53477376->54525951) req@ffff96248c9c4e00 x1875064559743744/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/0 e 0 to 0 dl 1788201685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201674.169989:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4e00 with x1875064559743744 ext(53477376->54525951) 00002000:00010000:3.0:1788201674.169995:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4e00 00000100:00100000:3.0:1788201674.170026:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1122 00000100:00100000:3.0:1788201674.170035:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2342:x1875064559743744:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201674.181867:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248c9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2342:x1875064559743744:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11706us (12045us total) trans 30064772123 rc 0/0 00000100:00100000:2.0:1788201674.181905:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1122 00002000:00100000:2.0:1788201674.181919:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (53477376->54525951) req@ffff96248c9c4e00 x1875064559743744/t30064772123(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/448 e 0 to 0 dl 1788201685 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201674.181930:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248c9c4e00 with x1875064559743744 ext(53477376->54525951) 00002000:00010000:2.0:1788201674.181961:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248c9c4e00 00000100:00100000:2.0:1788201674.274545:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201674.274710:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559743872 00000100:00100000:1.0:1788201674.274724:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559743872 00002000:00100000:1.0:1788201674.274791:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (54525952->55574527) req@ffff962485681f80 x1875064559743872/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/0 e 0 to 0 dl 1788201685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201674.274802:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681f80 with x1875064559743872 ext(54525952->55574527) 00002000:00010000:1.0:1788201674.274809:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681f80 00000100:00100000:1.0:1788201674.274845:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1123 00000100:00100000:1.0:1788201674.274857:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559743872:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201674.289134:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559743872:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14269us (14591us total) trans 30064772124 rc 0/0 00000100:00100000:1.0:1788201674.289149:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1123 00002000:00100000:1.0:1788201674.289162:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (54525952->55574527) req@ffff962485681f80 x1875064559743872/t30064772124(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/448 e 0 to 0 dl 1788201685 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201674.289173:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681f80 with x1875064559743872 ext(54525952->55574527) 00002000:00010000:1.0:1788201674.289179:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681f80 00000100:00100000:0.0:1788201674.493048:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201674.493183:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559744000 00000100:00100000:2.0:1788201674.493192:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559744000 00002000:00100000:2.0:1788201674.493239:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (55574528->56623103) req@ffff9624b9d27800 x1875064559744000/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/0 e 0 to 0 dl 1788201685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201674.493250:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27800 with x1875064559744000 ext(55574528->56623103) 00002000:00010000:2.0:1788201674.493256:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27800 00000100:00100000:2.0:1788201674.493394:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1124 00000100:00100000:2.0:1788201674.493404:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559744000:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201674.517194:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559744000:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23777us (24143us total) trans 30064772125 rc 0/0 00000100:00100000:2.0:1788201674.517211:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1124 00002000:00100000:2.0:1788201674.517233:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (55574528->56623103) req@ffff9624b9d27800 x1875064559744000/t30064772125(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/448 e 0 to 0 dl 1788201685 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201674.517243:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d27800 with x1875064559744000 ext(55574528->56623103) 00002000:00010000:2.0:1788201674.517249:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d27800 00010000:00010000:0.0:1788201674.551817:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201674.600213:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201674.600289:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559744128 00000100:00100000:2.0:1788201674.600316:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559744128 00002000:00100000:2.0:1788201674.600421:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (56623104->57671679) req@ffff9623939e3b80 x1875064559744128/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/0 e 0 to 0 dl 1788201685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201674.600433:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3b80 with x1875064559744128 ext(56623104->57671679) 00002000:00010000:2.0:1788201674.600439:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3b80 00000100:00100000:2.0:1788201674.600479:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1125 00000100:00100000:2.0:1788201674.600490:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623939e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559744128:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201674.625502:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623939e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559744128:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25003us (25292us total) trans 30064772126 rc 0/0 00000100:00100000:2.0:1788201674.625518:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1125 00002000:00100000:2.0:1788201674.625532:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (56623104->57671679) req@ffff9623939e3b80 x1875064559744128/t30064772126(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/448 e 0 to 0 dl 1788201685 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201674.625542:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623939e3b80 with x1875064559744128 ext(56623104->57671679) 00002000:00010000:2.0:1788201674.625548:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623939e3b80 00000100:00100000:3.0:1788201674.804808:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201674.805102:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559744256 00000100:00100000:0.0:1788201674.805113:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559744256 00002000:00100000:0.0:1788201674.805166:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (57671680->58720255) req@ffff962388ba2d80 x1875064559744256/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/0 e 0 to 0 dl 1788201685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201674.805391:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2d80 with x1875064559744256 ext(57671680->58720255) 00002000:00010000:0.0:1788201674.805397:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2d80 00000100:00100000:0.0:1788201674.805434:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1126 00000100:00100000:0.0:1788201674.805445:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559744256:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201674.806528:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201674.806566:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba1d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570166784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201674.806743:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201674.806778:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570166784 00000100:00100000:2.0:1788201674.806785:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570166784 00000100:00100000:2.0:1788201674.806854:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788201674.806864:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570166784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201674.806882:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 563675136 pending 37486592 free 2786066432 avail 2783969280 00000100:00100000:2.0:1788201674.806935:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570166784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201674.806943:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1788201674.806951:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201674.806991:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba1d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570166784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201674.815565:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559744256:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10109us (10757us total) trans 30064772127 rc 0/0 00000100:00100000:1.0:1788201674.815579:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1126 00002000:00100000:1.0:1788201674.815592:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (57671680->58720255) req@ffff962388ba2d80 x1875064559744256/t30064772127(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/448 e 0 to 0 dl 1788201685 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201674.815603:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2d80 with x1875064559744256 ext(57671680->58720255) 00002000:00010000:1.0:1788201674.815609:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2d80 00000100:00100000:2.0:1788201674.944115:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201674.955133:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559744384 00000100:00100000:1.0:1788201674.955166:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559744384 00002000:00100000:1.0:1788201674.955533:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (58720256->59768831) req@ffff962485683100 x1875064559744384/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/0 e 0 to 0 dl 1788201685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201674.955541:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683100 with x1875064559744384 ext(58720256->59768831) 00002000:00010000:1.0:1788201674.955546:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683100 00000100:00100000:1.0:1788201674.955577:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1127 00000100:00100000:1.0:1788201674.955586:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559744384:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201674.967442:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559744384:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11842us (23321us total) trans 30064772128 rc 0/0 00000100:00100000:1.0:1788201674.967459:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1127 00002000:00100000:1.0:1788201674.967472:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (58720256->59768831) req@ffff962485683100 x1875064559744384/t30064772128(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:40/0 lens 488/448 e 0 to 0 dl 1788201685 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201674.967480:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683100 with x1875064559744384 ext(58720256->59768831) 00002000:00010000:1.0:1788201674.967485:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683100 00000100:00100000:2.0:1788201675.078886:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201675.079287:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559744512 00000100:00100000:3.0:1788201675.079325:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559744512 00002000:00100000:3.0:1788201675.079538:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (59768832->60817407) req@ffff962485683b80 x1875064559744512/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:41/0 lens 488/0 e 0 to 0 dl 1788201686 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201675.079550:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683b80 with x1875064559744512 ext(59768832->60817407) 00002000:00010000:3.0:1788201675.079563:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683b80 00000100:00100000:3.0:1788201675.079599:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1128 00000100:00100000:3.0:1788201675.079609:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559744512:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201675.083557:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201675.101335:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2343:x1875064559744512:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21712us (22445us total) trans 30064772129 rc 0/0 00000100:00100000:3.0:1788201675.101366:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1128 00002000:00100000:3.0:1788201675.101381:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (59768832->60817407) req@ffff962485683b80 x1875064559744512/t30064772129(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:41/0 lens 488/448 e 0 to 0 dl 1788201686 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201675.101392:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683b80 with x1875064559744512 ext(59768832->60817407) 00002000:00010000:3.0:1788201675.101398:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683b80 00000100:00100000:2.0:1788201675.273567:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201675.273698:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559744640 00000100:00100000:1.0:1788201675.273707:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559744640 00002000:00100000:1.0:1788201675.273753:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (60817408->61865983) req@ffff962485681880 x1875064559744640/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:41/0 lens 488/0 e 0 to 0 dl 1788201686 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201675.273764:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681880 with x1875064559744640 ext(60817408->61865983) 00002000:00010000:1.0:1788201675.273770:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681880 00000100:00100000:1.0:1788201675.273807:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1129 00000100:00100000:1.0:1788201675.273818:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2341:x1875064559744640:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201675.284582:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2341:x1875064559744640:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10754us (11031us total) trans 30064772130 rc 0/0 00000100:00100000:1.0:1788201675.284609:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1129 00002000:00100000:1.0:1788201675.284622:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (60817408->61865983) req@ffff962485681880 x1875064559744640/t30064772130(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:41/0 lens 488/448 e 0 to 0 dl 1788201686 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201675.284632:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485681880 with x1875064559744640 ext(60817408->61865983) 00002000:00010000:1.0:1788201675.284639:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485681880 00000100:00100000:2.0:1788201675.423848:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201675.423992:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559744768 00000100:00100000:0.0:1788201675.424001:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559744768 00002000:00100000:0.0:1788201675.424052:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (61865984->62914559) req@ffff962485682a00 x1875064559744768/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:41/0 lens 488/0 e 0 to 0 dl 1788201686 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201675.424062:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485682a00 with x1875064559744768 ext(61865984->62914559) 00002000:00010000:0.0:1788201675.424067:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485682a00 00000100:00100000:0.0:1788201675.424097:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1130 00000100:00100000:0.0:1788201675.424105:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559744768:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201675.447557:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2342:x1875064559744768:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23441us (23716us total) trans 30064772131 rc 0/0 00000100:00100000:2.0:1788201675.447572:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1130 00002000:00100000:2.0:1788201675.447585:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (61865984->62914559) req@ffff962485682a00 x1875064559744768/t30064772131(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:41/0 lens 488/448 e 0 to 0 dl 1788201686 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201675.447595:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485682a00 with x1875064559744768 ext(61865984->62914559) 00002000:00010000:2.0:1788201675.447601:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485682a00 00010000:00010000:2.0:1788201675.576139:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201675.622708:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201675.623600:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559744896 00000100:00100000:2.0:1788201675.623617:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559744896 00002000:00100000:2.0:1788201675.623691:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (62914560->63963135) req@ffff9624b9d25c00 x1875064559744896/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:41/0 lens 488/0 e 0 to 0 dl 1788201686 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201675.623705:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25c00 with x1875064559744896 ext(62914560->63963135) 00002000:00010000:2.0:1788201675.623712:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25c00 00000100:00100000:2.0:1788201675.623763:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1131 00000100:00100000:2.0:1788201675.624156:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559744896:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201675.638031:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2343:x1875064559744896:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13871us (15328us total) trans 30064772132 rc 0/0 00000100:00100000:2.0:1788201675.638046:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1131 00002000:00100000:2.0:1788201675.638059:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (62914560->63963135) req@ffff9624b9d25c00 x1875064559744896/t30064772132(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:41/0 lens 488/448 e 0 to 0 dl 1788201686 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201675.638131:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25c00 with x1875064559744896 ext(62914560->63963135) 00002000:00010000:2.0:1788201675.638154:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25c00 00000100:00100000:1.0:1788201675.787970:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201675.794446:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559745024 00000100:00100000:3.0:1788201675.794464:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559745024 00002000:00100000:3.0:1788201675.794549:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (63963136->65011711) req@ffff9624ba1d6300 x1875064559745024/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:41/0 lens 488/0 e 0 to 0 dl 1788201686 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201675.794562:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d6300 with x1875064559745024 ext(63963136->65011711) 00002000:00010000:3.0:1788201675.794567:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d6300 00000100:00100000:3.0:1788201675.794937:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1132 00000100:00100000:3.0:1788201675.794949:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2341:x1875064559745024:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201675.807839:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2341:x1875064559745024:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12874us (19860us total) trans 30064772133 rc 0/0 00000100:00100000:3.0:1788201675.807858:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1132 00002000:00100000:3.0:1788201675.807876:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (63963136->65011711) req@ffff9624ba1d6300 x1875064559745024/t30064772133(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:41/0 lens 488/448 e 0 to 0 dl 1788201686 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201675.807913:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d6300 with x1875064559745024 ext(63963136->65011711) 00002000:00010000:3.0:1788201675.807921:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d6300 00000100:00100000:1.0:1788201675.994913:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201675.995373:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559745152 00000100:00100000:2.0:1788201675.995384:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559745152 00002000:00100000:2.0:1788201675.995435:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (65011712->66060287) req@ffff9624ba1d5500 x1875064559745152/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:41/0 lens 488/0 e 0 to 0 dl 1788201686 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201675.995447:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d5500 with x1875064559745152 ext(65011712->66060287) 00002000:00010000:2.0:1788201675.995453:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d5500 00000100:00100000:2.0:1788201675.995582:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1133 00000100:00100000:2.0:1788201675.995592:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2342:x1875064559745152:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201676.011857:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2342:x1875064559745152:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16252us (16950us total) trans 30064772134 rc 0/0 00000100:00100000:2.0:1788201676.011873:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1133 00002000:00100000:2.0:1788201676.011886:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (65011712->66060287) req@ffff9624ba1d5500 x1875064559745152/t30064772134(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:41/0 lens 488/448 e 0 to 0 dl 1788201686 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201676.011898:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d5500 with x1875064559745152 ext(65011712->66060287) 00002000:00010000:2.0:1788201676.011904:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d5500 00000100:00100000:1.0:1788201676.129868:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201676.130026:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559745280 00000100:00100000:2.0:1788201676.130038:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559745280 00002000:00100000:2.0:1788201676.130156:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (66060288->67108863) req@ffff9624ba1d4380 x1875064559745280/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:42/0 lens 488/0 e 0 to 0 dl 1788201687 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201676.130169:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d4380 with x1875064559745280 ext(66060288->67108863) 00002000:00010000:2.0:1788201676.130175:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d4380 00000100:00100000:2.0:1788201676.130249:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1134 00000100:00100000:2.0:1788201676.130260:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2344:x1875064559745280:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201676.141026:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2344:x1875064559745280:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10756us (11157us total) trans 30064772135 rc 0/0 00000100:00100000:1.0:1788201676.141040:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1134 00002000:00100000:1.0:1788201676.141054:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (66060288->67108863) req@ffff9624ba1d4380 x1875064559745280/t30064772135(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:42/0 lens 488/448 e 0 to 0 dl 1788201687 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201676.141064:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d4380 with x1875064559745280 ext(66060288->67108863) 00002000:00010000:1.0:1788201676.141069:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d4380 00000100:00100000:0.0:1788201676.300373:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201676.300467:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559745408 00000100:00100000:1.0:1788201676.300483:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559745408 00002000:00100000:1.0:1788201676.300544:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (67108864->68157439) req@ffff9624b9d26d80 x1875064559745408/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:42/0 lens 488/0 e 0 to 0 dl 1788201687 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201676.300557:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26d80 with x1875064559745408 ext(67108864->68157439) 00002000:00010000:1.0:1788201676.300562:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26d80 00000100:00100000:1.0:1788201676.300603:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1135 00000100:00100000:1.0:1788201676.300612:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2343:x1875064559745408:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201676.314670:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2343:x1875064559745408:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14049us (14330us total) trans 30064772136 rc 0/0 00000100:00100000:2.0:1788201676.314685:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1135 00002000:00100000:2.0:1788201676.314698:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (67108864->68157439) req@ffff9624b9d26d80 x1875064559745408/t30064772136(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:42/0 lens 488/448 e 0 to 0 dl 1788201687 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201676.314710:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26d80 with x1875064559745408 ext(67108864->68157439) 00002000:00010000:2.0:1788201676.314716:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26d80 00000001:00080000:3.0:1788201676.466147:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772135 is committed 00000001:00080000:3.0:1788201676.466564:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772136 is committed 00000100:00100000:1.0:1788201676.527202:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201676.527334:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559745536 00000100:00100000:3.0:1788201676.527380:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559745536 00002000:00100000:3.0:1788201676.527455:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (68157440->69206015) req@ffff9624ba1d5f80 x1875064559745536/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:42/0 lens 488/0 e 0 to 0 dl 1788201687 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201676.527468:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d5f80 with x1875064559745536 ext(68157440->69206015) 00002000:00010000:3.0:1788201676.527474:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d5f80 00000100:00100000:2.0:1788201676.527613:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1136 00000100:00100000:2.0:1788201676.527628:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+6:2341:x1875064559745536:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201676.548569:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2341:x1875064559745536:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20929us (21365us total) trans 30064772137 rc 0/0 00000100:00100000:0.0:1788201676.548586:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1136 00002000:00100000:0.0:1788201676.548602:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (68157440->69206015) req@ffff9624ba1d5f80 x1875064559745536/t30064772137(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:42/0 lens 488/448 e 0 to 0 dl 1788201687 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201676.548614:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d5f80 with x1875064559745536 ext(68157440->69206015) 00002000:00010000:0.0:1788201676.548640:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d5f80 00000100:00100000:1.0:1788201676.596052:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201676.597508:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559745664 00000100:00100000:3.0:1788201676.597530:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559745664 00000100:00100000:3.0:1788201676.597644:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 584 00000100:00100000:3.0:1788201676.597656:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559745664:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201676.597977:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559745664:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 320us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201676.597987:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 584 00000100:00100000:1.0:1788201676.598471:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201676.598682:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559745792 00000100:00100000:0.0:1788201676.598691:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559745792 00000100:00100000:0.0:1788201676.598778:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 483 00000100:00100000:0.0:1788201676.598789:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559745792:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201676.598848:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559745792:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 62us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201676.598856:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 483 00000100:00080000:1.0:1788201676.599063:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201676.599794:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201676.712669:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201676.713004:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559745920 00000100:00100000:2.0:1788201676.713017:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559745920 00002000:00100000:2.0:1788201676.713095:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (69206016->70254591) req@ffff9624ba1d7480 x1875064559745920/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:42/0 lens 488/0 e 0 to 0 dl 1788201687 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201676.713109:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d7480 with x1875064559745920 ext(69206016->70254591) 00002000:00010000:2.0:1788201676.713115:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d7480 00000100:00100000:2.0:1788201676.713159:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1137 00000100:00100000:2.0:1788201676.713171:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2342:x1875064559745920:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201676.731220:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2342:x1875064559745920:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18036us (18552us total) trans 30064772138 rc 0/0 00000100:00100000:0.0:1788201676.731237:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1137 00002000:00100000:0.0:1788201676.731254:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (69206016->70254591) req@ffff9624ba1d7480 x1875064559745920/t30064772138(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:42/0 lens 488/448 e 0 to 0 dl 1788201687 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201676.731275:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d7480 with x1875064559745920 ext(69206016->70254591) 00002000:00010000:0.0:1788201676.731285:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d7480 00000100:00100000:3.0:1788201676.891185:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201676.891396:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559746048 00000100:00100000:1.0:1788201676.891409:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559746048 00002000:00100000:1.0:1788201676.891475:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (70254592->71303167) req@ffff962388ba3480 x1875064559746048/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:42/0 lens 488/0 e 0 to 0 dl 1788201687 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201676.891488:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3480 with x1875064559746048 ext(70254592->71303167) 00002000:00010000:1.0:1788201676.891494:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3480 00000100:00100000:1.0:1788201676.891521:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1138 00000100:00100000:1.0:1788201676.891532:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559746048:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201676.916886:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559746048:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25339us (25702us total) trans 30064772139 rc 0/0 00000100:00100000:3.0:1788201676.916902:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1138 00002000:00100000:3.0:1788201676.916919:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (70254592->71303167) req@ffff962388ba3480 x1875064559746048/t30064772139(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:42/0 lens 488/448 e 0 to 0 dl 1788201687 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201676.916930:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3480 with x1875064559746048 ext(70254592->71303167) 00002000:00010000:3.0:1788201676.916956:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3480 00000100:00100000:1.0:1788201677.124314:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201677.125159:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559746176 00000100:00100000:2.0:1788201677.125170:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559746176 00002000:00100000:2.0:1788201677.125399:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (71303168->72351743) req@ffff9624ba1d7800 x1875064559746176/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:43/0 lens 488/0 e 0 to 0 dl 1788201688 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201677.125412:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d7800 with x1875064559746176 ext(71303168->72351743) 00002000:00010000:2.0:1788201677.125432:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d7800 00000100:00100000:2.0:1788201677.125472:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1139 00000100:00100000:2.0:1788201677.125483:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559746176:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:1.0:1788201677.128110:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201677.149119:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559746176:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23627us (24805us total) trans 30064772140 rc 0/0 00000100:00100000:2.0:1788201677.149134:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1139 00002000:00100000:2.0:1788201677.149148:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (71303168->72351743) req@ffff9624ba1d7800 x1875064559746176/t30064772140(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:43/0 lens 488/448 e 0 to 0 dl 1788201688 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201677.149159:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba1d7800 with x1875064559746176 ext(71303168->72351743) 00002000:00010000:2.0:1788201677.149165:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba1d7800 00000100:00100000:2.0:1788201677.366708:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962388ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570166912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201677.366800:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201677.367094:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570166912 00000100:00100000:0.0:1788201677.367102:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570166912 00000100:00100000:0.0:1788201677.367180:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788201677.367192:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570166912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201677.367230:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201677.367311:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875064570166912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201677.367318:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00010000:00080000:0.0:1788201677.367385:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962388ba2680 x1875064570166912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201677.367422:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962388ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875064570166912:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201677.367536:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201677.422525:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201677.428363:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559746304 00000100:00100000:0.0:1788201677.428388:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559746304 00002000:00100000:0.0:1788201677.428475:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (72351744->73400319) req@ffff962388ba1f80 x1875064559746304/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:43/0 lens 488/0 e 0 to 0 dl 1788201688 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201677.428489:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba1f80 with x1875064559746304 ext(72351744->73400319) 00002000:00010000:0.0:1788201677.428497:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba1f80 00000100:00100000:0.0:1788201677.428638:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1140 00000100:00100000:0.0:1788201677.428651:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559746304:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201677.457473:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559746304:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 28804us (34948us total) trans 30064772141 rc 0/0 00000100:00100000:0.0:1788201677.457490:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1140 00002000:00100000:0.0:1788201677.457507:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (72351744->73400319) req@ffff962388ba1f80 x1875064559746304/t30064772141(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:43/0 lens 488/448 e 0 to 0 dl 1788201688 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201677.457520:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba1f80 with x1875064559746304 ext(72351744->73400319) 00002000:00010000:0.0:1788201677.457527:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba1f80 00010000:00010000:0.0:1788201677.623785:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201677.765892:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201677.766171:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559746432 00000100:00100000:2.0:1788201677.766185:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559746432 00002000:00100000:2.0:1788201677.766263:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (73400320->74448895) req@ffff962388ba3800 x1875064559746432/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:43/0 lens 488/0 e 0 to 0 dl 1788201688 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201677.766277:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3800 with x1875064559746432 ext(73400320->74448895) 00002000:00010000:2.0:1788201677.766284:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3800 00000100:00100000:2.0:1788201677.766331:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1141 00000100:00100000:2.0:1788201677.766377:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559746432:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201677.782838:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559746432:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16479us (16945us total) trans 30064772142 rc 0/0 00000100:00100000:2.0:1788201677.782855:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1141 00002000:00100000:2.0:1788201677.782892:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (73400320->74448895) req@ffff962388ba3800 x1875064559746432/t30064772142(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:43/0 lens 488/448 e 0 to 0 dl 1788201688 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201677.782904:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba3800 with x1875064559746432 ext(73400320->74448895) 00002000:00010000:2.0:1788201677.782912:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba3800 00000100:00100000:3.0:1788201677.878651:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570167424:0@lo:400:kworker.0 00000100:00100000:3.0:1788201677.878756:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201677.878830:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570167296:0@lo:400:kworker.0 00000100:00100000:2.0:1788201677.878870:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201677.878973:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570167296 00000100:00100000:3.0:1788201677.878982:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570167296 00000100:00100000:3.0:1788201677.879077:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788201677.879089:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570167296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201677.879160:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570167296:12345-0@lo:400:kworker.0 Request processed in 72us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201677.879168:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788201677.879174:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570167168:0@lo:400:kworker.0 00000100:00080000:2.0:1788201677.879313:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201677.879359:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570167424 00000100:00100000:2.0:1788201677.879363:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570167424 00000100:00100000:3.0:1788201677.881176:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570167296:0@lo:400:kworker.0 00000100:00100000:3.0:1788201677.881259:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1788201677.881279:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570167424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201677.881402:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962388ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570167040:0@lo:400:kworker.0 00000100:00080000:2.0:1788201677.881999:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201677.887433:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201677.887530:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570167168 00000100:00100000:1.0:1788201677.887541:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570167168 00000100:00100000:1.0:1788201677.887606:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1788201677.887617:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba1d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570167168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201677.887718:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba1d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570167168:12345-0@lo:400:kworker.0 Request processed in 103us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201677.892550:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875064570167424:12345-0@lo:400:kworker.0 Request processed in 11267us (13780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201677.892571:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1788201677.892742:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875064570167424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201677.892841:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624ba19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570167168:0@lo:400:kworker.0 00000100:00100000:1.0:1788201677.892856:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1788201677.893031:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201677.893096:0:3282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624b9f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570167552:0@lo:400:kworker.0 00000100:00100000:2.0:1788201677.893290:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570167040 00000100:00100000:2.0:1788201677.893299:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570167040 00000100:00100000:2.0:1788201677.893399:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1788201677.893412:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570167040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201677.893501:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3282:x1875064570167040:12345-0@lo:400:kworker.0 Request processed in 93us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201677.893509:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:0.0:1788201677.895885:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201677.895956:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962388ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3282:1875064570167040:0@lo:400:kworker.0 00000100:00100000:2.0:1788201677.896395:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570167552 00000100:00100000:2.0:1788201677.896404:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570167552 00000100:00100000:2.0:1788201677.896484:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1788201677.896494:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570167552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201677.896582:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875064570167552:12345-0@lo:400:kworker.0 Request processed in 90us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201677.896590:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1788201677.896669:0:3282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624b9f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875064570167552:0@lo:400:kworker.0 00000100:00080000:0.0:1788201677.896906:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201677.958651:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201677.958777:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559746560 00000100:00100000:1.0:1788201677.958787:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559746560 00002000:00100000:1.0:1788201677.958850:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (74448896->75497471) req@ffff9624b9f68380 x1875064559746560/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:43/0 lens 488/0 e 0 to 0 dl 1788201688 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201677.958861:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68380 with x1875064559746560 ext(74448896->75497471) 00002000:00010000:1.0:1788201677.958867:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68380 00000100:00100000:1.0:1788201677.958901:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1142 00000100:00100000:1.0:1788201677.958910:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559746560:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201677.973786:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559746560:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14866us (15134us total) trans 30064772143 rc 0/0 00000100:00100000:1.0:1788201677.973798:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1142 00002000:00100000:1.0:1788201677.973816:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (74448896->75497471) req@ffff9624b9f68380 x1875064559746560/t30064772143(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:43/0 lens 488/448 e 0 to 0 dl 1788201688 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201677.973824:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68380 with x1875064559746560 ext(74448896->75497471) 00002000:00010000:1.0:1788201677.973829:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68380 00000100:00100000:3.0:1788201678.127335:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201678.128137:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559746688 00000100:00100000:1.0:1788201678.128146:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559746688 00002000:00100000:1.0:1788201678.128200:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (75497472->76546047) req@ffff9624b9f6b100 x1875064559746688/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:44/0 lens 488/0 e 0 to 0 dl 1788201689 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201678.128212:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6b100 with x1875064559746688 ext(75497472->76546047) 00002000:00010000:1.0:1788201678.128218:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6b100 00000100:00100000:1.0:1788201678.128260:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1143 00000100:00100000:1.0:1788201678.128271:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559746688:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201678.148492:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559746688:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20211us (21157us total) trans 30064772144 rc 0/0 00000100:00100000:1.0:1788201678.148677:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1143 00002000:00100000:1.0:1788201678.148690:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (75497472->76546047) req@ffff9624b9f6b100 x1875064559746688/t30064772144(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:44/0 lens 488/448 e 0 to 0 dl 1788201689 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201678.148700:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6b100 with x1875064559746688 ext(75497472->76546047) 00002000:00010000:1.0:1788201678.148706:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6b100 00000100:00100000:0.0:1788201678.287964:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201678.289852:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559746816 00000100:00100000:2.0:1788201678.289871:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559746816 00002000:00100000:2.0:1788201678.289947:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (76546048->77594623) req@ffff9624b9d24000 x1875064559746816/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:44/0 lens 488/0 e 0 to 0 dl 1788201689 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201678.289961:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24000 with x1875064559746816 ext(76546048->77594623) 00002000:00010000:2.0:1788201678.289967:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24000 00000100:00100000:2.0:1788201678.290017:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1144 00000100:00100000:2.0:1788201678.290103:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2341:x1875064559746816:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201678.304007:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2341:x1875064559746816:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13890us (16041us total) trans 30064772145 rc 0/0 00000100:00100000:2.0:1788201678.304024:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1144 00002000:00100000:2.0:1788201678.304041:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (76546048->77594623) req@ffff9624b9d24000 x1875064559746816/t30064772145(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:44/0 lens 488/448 e 0 to 0 dl 1788201689 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201678.305653:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d24000 with x1875064559746816 ext(76546048->77594623) 00002000:00010000:2.0:1788201678.305662:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d24000 00000100:00100000:3.0:1788201678.464852:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201678.464979:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559746944 00000100:00100000:2.0:1788201678.464993:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559746944 00002000:00100000:2.0:1788201678.465070:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (77594624->78643199) req@ffff9624b9f69c00 x1875064559746944/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:44/0 lens 488/0 e 0 to 0 dl 1788201689 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201678.465084:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69c00 with x1875064559746944 ext(77594624->78643199) 00002000:00010000:2.0:1788201678.465090:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69c00 00000100:00100000:2.0:1788201678.465134:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1145 00000100:00100000:2.0:1788201678.465147:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559746944:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201678.476492:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559746944:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11332us (11639us total) trans 30064772146 rc 0/0 00000100:00100000:2.0:1788201678.476524:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1145 00002000:00100000:2.0:1788201678.476542:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (77594624->78643199) req@ffff9624b9f69c00 x1875064559746944/t30064772146(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:44/0 lens 488/448 e 0 to 0 dl 1788201689 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201678.476553:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69c00 with x1875064559746944 ext(77594624->78643199) 00002000:00010000:2.0:1788201678.476560:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69c00 00000100:00100000:0.0:1788201678.636476:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201678.636650:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559747072 00000100:00100000:1.0:1788201678.636665:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559747072 00002000:00100000:1.0:1788201678.636744:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (78643200->79691775) req@ffff9624b9d26680 x1875064559747072/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:44/0 lens 488/0 e 0 to 0 dl 1788201689 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201678.636757:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26680 with x1875064559747072 ext(78643200->79691775) 00002000:00010000:1.0:1788201678.636764:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26680 00000100:00100000:1.0:1788201678.636807:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1146 00000100:00100000:1.0:1788201678.636819:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559747072:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:2.0:1788201678.646604:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201678.660796:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559747072:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23962us (24317us total) trans 30064772147 rc 0/0 00000100:00100000:1.0:1788201678.660814:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1146 00002000:00100000:1.0:1788201678.660831:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (78643200->79691775) req@ffff9624b9d26680 x1875064559747072/t30064772147(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:44/0 lens 488/448 e 0 to 0 dl 1788201689 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201678.660844:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26680 with x1875064559747072 ext(78643200->79691775) 00002000:00010000:1.0:1788201678.660852:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26680 00000100:00100000:2.0:1788201678.774727:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201678.774955:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559747200 00000100:00100000:1.0:1788201678.774985:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559747200 00002000:00100000:1.0:1788201678.775066:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (79691776->80740351) req@ffff962485683800 x1875064559747200/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:44/0 lens 488/0 e 0 to 0 dl 1788201689 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201678.775078:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683800 with x1875064559747200 ext(79691776->80740351) 00002000:00010000:1.0:1788201678.775085:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683800 00000100:00100000:1.0:1788201678.775123:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1147 00000100:00100000:1.0:1788201678.775136:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559747200:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201678.807174:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559747200:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32025us (32460us total) trans 30064772148 rc 0/0 00000100:00100000:1.0:1788201678.807191:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1147 00002000:00100000:1.0:1788201678.807207:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (79691776->80740351) req@ffff962485683800 x1875064559747200/t30064772148(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:44/0 lens 488/448 e 0 to 0 dl 1788201689 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201678.807220:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485683800 with x1875064559747200 ext(79691776->80740351) 00002000:00010000:1.0:1788201678.807227:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485683800 00000100:00100000:0.0:1788201678.992042:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201678.992170:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559747328 00000100:00100000:2.0:1788201678.992183:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559747328 00002000:00100000:2.0:1788201678.992263:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (80740352->81788927) req@ffff9624b9d26300 x1875064559747328/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:44/0 lens 488/0 e 0 to 0 dl 1788201689 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201678.992276:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26300 with x1875064559747328 ext(80740352->81788927) 00002000:00010000:2.0:1788201678.992283:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26300 00000100:00100000:2.0:1788201678.992326:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1148 00000100:00100000:2.0:1788201678.992338:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559747328:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201679.003627:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559747328:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11274us (11584us total) trans 30064772149 rc 0/0 00000100:00100000:2.0:1788201679.003645:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1148 00002000:00100000:2.0:1788201679.003662:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (80740352->81788927) req@ffff9624b9d26300 x1875064559747328/t30064772149(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:44/0 lens 488/448 e 0 to 0 dl 1788201689 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201679.003675:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d26300 with x1875064559747328 ext(80740352->81788927) 00002000:00010000:2.0:1788201679.003682:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d26300 00000100:00100000:3.0:1788201679.114300:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201679.115131:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559747456 00000100:00100000:2.0:1788201679.115164:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559747456 00002000:00100000:2.0:1788201679.115266:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (81788928->82837503) req@ffff9624b9f69880 x1875064559747456/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:45/0 lens 488/0 e 0 to 0 dl 1788201690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201679.115279:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69880 with x1875064559747456 ext(81788928->82837503) 00002000:00010000:2.0:1788201679.115286:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69880 00000100:00100000:2.0:1788201679.115329:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1149 00000100:00100000:2.0:1788201679.115367:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559747456:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201679.115721:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201679.131404:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559747456:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16048us (17102us total) trans 30064772150 rc 0/0 00000100:00100000:2.0:1788201679.131423:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1149 00002000:00100000:2.0:1788201679.131440:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (81788928->82837503) req@ffff9624b9f69880 x1875064559747456/t30064772150(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:45/0 lens 488/448 e 0 to 0 dl 1788201690 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201679.131454:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69880 with x1875064559747456 ext(81788928->82837503) 00002000:00010000:2.0:1788201679.131462:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69880 00000100:00100000:3.0:1788201679.293451:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201679.293549:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559747584 00000100:00100000:1.0:1788201679.293562:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559747584 00002000:00100000:1.0:1788201679.293627:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (82837504->83886079) req@ffff9624b9f69f80 x1875064559747584/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:45/0 lens 488/0 e 0 to 0 dl 1788201690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201679.293640:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69f80 with x1875064559747584 ext(82837504->83886079) 00002000:00010000:1.0:1788201679.293647:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69f80 00000100:00100000:1.0:1788201679.293689:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1150 00000100:00100000:1.0:1788201679.293700:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559747584:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201679.312440:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2344:x1875064559747584:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18723us (18988us total) trans 30064772151 rc 0/0 00000100:00100000:1.0:1788201679.312482:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1150 00002000:00100000:1.0:1788201679.312499:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (82837504->83886079) req@ffff9624b9f69f80 x1875064559747584/t30064772151(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:45/0 lens 488/448 e 0 to 0 dl 1788201690 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201679.312511:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f69f80 with x1875064559747584 ext(82837504->83886079) 00002000:00010000:1.0:1788201679.312519:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f69f80 00000100:00100000:3.0:1788201679.430302:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201679.431768:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559747712 00000100:00100000:1.0:1788201679.431788:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559747712 00002000:00100000:1.0:1788201679.431867:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (83886080->84934655) req@ffff9624b9f68a80 x1875064559747712/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:45/0 lens 488/0 e 0 to 0 dl 1788201690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201679.431880:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68a80 with x1875064559747712 ext(83886080->84934655) 00002000:00010000:1.0:1788201679.431887:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68a80 00000100:00100000:1.0:1788201679.431936:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1151 00000100:00100000:1.0:1788201679.431948:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559747712:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201679.448938:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559747712:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16976us (18635us total) trans 30064772152 rc 0/0 00000100:00100000:1.0:1788201679.448957:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1151 00002000:00100000:1.0:1788201679.448973:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (83886080->84934655) req@ffff9624b9f68a80 x1875064559747712/t30064772152(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:45/0 lens 488/448 e 0 to 0 dl 1788201690 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201679.448987:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68a80 with x1875064559747712 ext(83886080->84934655) 00002000:00010000:1.0:1788201679.448994:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68a80 00000100:00100000:3.0:1788201679.544199:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201679.544375:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559747840 00000100:00100000:2.0:1788201679.544387:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559747840 00002000:00100000:2.0:1788201679.544455:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (84934656->85983231) req@ffff9624b9f6b800 x1875064559747840/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:45/0 lens 488/0 e 0 to 0 dl 1788201690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201679.544470:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6b800 with x1875064559747840 ext(84934656->85983231) 00002000:00010000:2.0:1788201679.544476:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6b800 00000100:00100000:2.0:1788201679.544520:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1152 00000100:00100000:2.0:1788201679.544531:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2341:x1875064559747840:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201679.568753:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559747840:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24197us (24546us total) trans 30064772153 rc 0/0 00000100:00100000:1.0:1788201679.568775:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1152 00002000:00100000:1.0:1788201679.568822:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (84934656->85983231) req@ffff9624b9f6b800 x1875064559747840/t30064772153(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:45/0 lens 488/448 e 0 to 0 dl 1788201690 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201679.568835:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6b800 with x1875064559747840 ext(84934656->85983231) 00002000:00010000:1.0:1788201679.568843:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6b800 00000100:00100000:2.0:1788201679.661227:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201679.661525:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559747968 00000100:00100000:0.0:1788201679.661538:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559747968 00002000:00100000:0.0:1788201679.661607:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (85983232->87031807) req@ffff962485682d80 x1875064559747968/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:45/0 lens 488/0 e 0 to 0 dl 1788201690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201679.661621:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485682d80 with x1875064559747968 ext(85983232->87031807) 00002000:00010000:0.0:1788201679.661629:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485682d80 00000100:00100000:0.0:1788201679.661673:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1153 00000100:00100000:0.0:1788201679.661685:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2343:x1875064559747968:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:2.0:1788201679.671441:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201679.673168:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559747968:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11472us (11953us total) trans 30064772154 rc 0/0 00000100:00100000:2.0:1788201679.673185:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1153 00002000:00100000:2.0:1788201679.673199:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (85983232->87031807) req@ffff962485682d80 x1875064559747968/t30064772154(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:45/0 lens 488/448 e 0 to 0 dl 1788201690 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201679.673221:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485682d80 with x1875064559747968 ext(85983232->87031807) 00002000:00010000:2.0:1788201679.673228:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485682d80 00000100:00100000:0.0:1788201679.876629:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201679.876756:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559748096 00000100:00100000:1.0:1788201679.876770:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559748096 00002000:00100000:1.0:1788201679.876841:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (87031808->88080383) req@ffff9624b9d25880 x1875064559748096/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:45/0 lens 488/0 e 0 to 0 dl 1788201690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201679.876854:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25880 with x1875064559748096 ext(87031808->88080383) 00002000:00010000:1.0:1788201679.876860:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25880 00000100:00100000:1.0:1788201679.876910:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1154 00000100:00100000:1.0:1788201679.876921:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2342:x1875064559748096:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201679.889244:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2342:x1875064559748096:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12309us (12616us total) trans 30064772155 rc 0/0 00000100:00100000:1.0:1788201679.889260:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1154 00002000:00100000:1.0:1788201679.889275:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (87031808->88080383) req@ffff9624b9d25880 x1875064559748096/t30064772155(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:45/0 lens 488/448 e 0 to 0 dl 1788201690 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201679.889288:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9d25880 with x1875064559748096 ext(87031808->88080383) 00002000:00010000:1.0:1788201679.889294:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9d25880 00000100:00100000:2.0:1788201679.926701:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9624bfd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570167680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201679.926801:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201679.927160:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570167680 00000100:00100000:3.0:1788201679.927192:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570167680 00000100:00100000:3.0:1788201679.927289:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788201679.927301:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570167680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201679.927331:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 560136192 pending 32374784 free 2786066432 avail 2783969280 00000100:00100000:3.0:1788201679.927430:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570167680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201679.927439:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788201679.927500:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9624bfd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570167680:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201679.927632:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201680.130332:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201680.130555:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559748224 00000100:00100000:1.0:1788201680.130580:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559748224 00002000:00100000:1.0:1788201680.130650:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (88080384->89128959) req@ffff9624b9f6a680 x1875064559748224/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:46/0 lens 488/0 e 0 to 0 dl 1788201691 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201680.130663:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6a680 with x1875064559748224 ext(88080384->89128959) 00002000:00010000:1.0:1788201680.130871:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6a680 00000100:00100000:1.0:1788201680.130915:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1155 00000100:00100000:1.0:1788201680.130926:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559748224:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201680.181300:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559748224:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 50359us (50967us total) trans 30064772156 rc 0/0 00000100:00100000:1.0:1788201680.181319:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1155 00002000:00100000:1.0:1788201680.181336:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (88080384->89128959) req@ffff9624b9f6a680 x1875064559748224/t30064772156(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:46/0 lens 488/448 e 0 to 0 dl 1788201691 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201680.181382:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f6a680 with x1875064559748224 ext(88080384->89128959) 00002000:00010000:1.0:1788201680.181390:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f6a680 00000100:00100000:2.0:1788201680.183633:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201680.184722:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559748352 00000100:00100000:1.0:1788201680.184738:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559748352 00002000:00100000:1.0:1788201680.184812:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (89128960->89255935) req@ffff9624ba19aa00 x1875064559748352/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:46/0 lens 488/0 e 0 to 0 dl 1788201691 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201680.184826:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba19aa00 with x1875064559748352 ext(89128960->89255935) 00002000:00010000:1.0:1788201680.184833:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba19aa00 00000100:00100000:1.0:1788201680.184879:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1156 00000100:00100000:1.0:1788201680.184892:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559748352:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201680.201105:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba19aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559748352:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16202us (17472us total) trans 30064772157 rc 0/0 00000100:00100000:1.0:1788201680.201121:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1156 00002000:00100000:1.0:1788201680.201134:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (89128960->89255935) req@ffff9624ba19aa00 x1875064559748352/t30064772157(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:46/0 lens 488/448 e 0 to 0 dl 1788201691 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201680.201164:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba19aa00 with x1875064559748352 ext(89128960->89255935) 00002000:00010000:1.0:1788201680.201171:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba19aa00 00000100:00100000:0.0:1788201680.509776:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201680.509888:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559748480 00000100:00100000:2.0:1788201680.509903:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559748480 00002000:00100000:2.0:1788201680.509953:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (90177536->91226111) req@ffff962388ba2680 x1875064559748480/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:46/0 lens 488/0 e 0 to 0 dl 1788201691 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201680.509966:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2680 with x1875064559748480 ext(90177536->91226111) 00002000:00010000:2.0:1788201680.509971:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2680 00000100:00100000:2.0:1788201680.510011:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1157 00000100:00100000:2.0:1788201680.510020:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962388ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559748480:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201680.529893:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962388ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559748480:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19862us (20117us total) trans 30064772158 rc 0/0 00000100:00100000:1.0:1788201680.529908:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1157 00002000:00100000:1.0:1788201680.529921:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (90177536->91226111) req@ffff962388ba2680 x1875064559748480/t30064772158(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:46/0 lens 488/448 e 0 to 0 dl 1788201691 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201680.529931:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962388ba2680 with x1875064559748480 ext(90177536->91226111) 00002000:00010000:1.0:1788201680.529938:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962388ba2680 00000100:00100000:2.0:1788201680.651625:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201680.651714:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559748608 00000100:00100000:3.0:1788201680.651726:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559748608 00002000:00100000:3.0:1788201680.651784:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (91226112->92274687) req@ffff9624c1e54e00 x1875064559748608/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:46/0 lens 488/0 e 0 to 0 dl 1788201691 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201680.651794:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54e00 with x1875064559748608 ext(91226112->92274687) 00002000:00010000:3.0:1788201680.651799:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54e00 00000100:00100000:3.0:1788201680.651828:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1158 00000100:00100000:3.0:1788201680.651836:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559748608:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201680.670079:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2343:x1875064559748608:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18228us (18454us total) trans 30064772159 rc 0/0 00000100:00100000:1.0:1788201680.670092:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1158 00002000:00100000:1.0:1788201680.670106:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (91226112->92274687) req@ffff9624c1e54e00 x1875064559748608/t30064772159(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:46/0 lens 488/448 e 0 to 0 dl 1788201691 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201680.670115:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54e00 with x1875064559748608 ext(91226112->92274687) 00002000:00010000:1.0:1788201680.670122:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54e00 00010000:00010000:0.0:1788201680.695830:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201680.776635:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201680.776876:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559748736 00000100:00100000:1.0:1788201680.776889:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559748736 00002000:00100000:1.0:1788201680.777483:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (92274688->93323263) req@ffff962382b15500 x1875064559748736/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:46/0 lens 488/0 e 0 to 0 dl 1788201691 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201680.777497:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15500 with x1875064559748736 ext(92274688->93323263) 00002000:00010000:1.0:1788201680.777504:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15500 00000100:00100000:1.0:1788201680.777558:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1159 00000100:00100000:1.0:1788201680.777593:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2341:x1875064559748736:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201680.795412:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2341:x1875064559748736:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17804us (18773us total) trans 30064772160 rc 0/0 00000100:00100000:1.0:1788201680.795433:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1159 00002000:00100000:1.0:1788201680.795453:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (92274688->93323263) req@ffff962382b15500 x1875064559748736/t30064772160(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:46/0 lens 488/448 e 0 to 0 dl 1788201691 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201680.795466:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b15500 with x1875064559748736 ext(92274688->93323263) 00002000:00010000:1.0:1788201680.795474:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b15500 00000100:00100000:3.0:1788201680.908578:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201680.908936:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559748864 00000100:00100000:1.0:1788201680.908951:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559748864 00002000:00100000:1.0:1788201680.909034:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (93323264->94371839) req@ffff9624b9f68e00 x1875064559748864/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:46/0 lens 488/0 e 0 to 0 dl 1788201691 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201680.909049:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68e00 with x1875064559748864 ext(93323264->94371839) 00002000:00010000:1.0:1788201680.909056:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68e00 00000100:00100000:1.0:1788201680.909644:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1160 00000100:00100000:1.0:1788201680.909660:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624b9f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2342:x1875064559748864:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201680.945039:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624b9f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2342:x1875064559748864:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 35366us (36459us total) trans 30064772161 rc 0/0 00000100:00100000:1.0:1788201680.945058:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1160 00002000:00100000:1.0:1788201680.945074:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (93323264->94371839) req@ffff9624b9f68e00 x1875064559748864/t30064772161(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:46/0 lens 488/448 e 0 to 0 dl 1788201691 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201680.945087:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624b9f68e00 with x1875064559748864 ext(93323264->94371839) 00002000:00010000:1.0:1788201680.945094:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624b9f68e00 00000100:00100000:3.0:1788201681.016981:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201681.017106:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559748992 00000100:00100000:2.0:1788201681.017120:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559748992 00002000:00100000:2.0:1788201681.018391:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (94371840->95420415) req@ffff962487e7aa00 x1875064559748992/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/0 e 0 to 0 dl 1788201692 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201681.018408:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7aa00 with x1875064559748992 ext(94371840->95420415) 00002000:00010000:2.0:1788201681.018447:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7aa00 00000100:00100000:2.0:1788201681.018484:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1161 00000100:00100000:2.0:1788201681.018512:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2344:x1875064559748992:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:0.0:1788201681.020093:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201681.032711:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2344:x1875064559748992:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14201us (15730us total) trans 30064772162 rc 0/0 00000100:00100000:2.0:1788201681.032730:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1161 00002000:00100000:2.0:1788201681.032746:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (94371840->95420415) req@ffff962487e7aa00 x1875064559748992/t30064772162(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/448 e 0 to 0 dl 1788201692 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201681.032758:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7aa00 with x1875064559748992 ext(94371840->95420415) 00002000:00010000:2.0:1788201681.032766:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7aa00 00000100:00100000:3.0:1788201681.135472:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201681.135721:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559749120 00000100:00100000:1.0:1788201681.135735:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559749120 00002000:00100000:1.0:1788201681.135809:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (95420416->96468991) req@ffff962487e7b480 x1875064559749120/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/0 e 0 to 0 dl 1788201692 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201681.135824:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b480 with x1875064559749120 ext(95420416->96468991) 00002000:00010000:1.0:1788201681.135831:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b480 00000100:00100000:1.0:1788201681.135875:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1162 00000100:00100000:1.0:1788201681.135888:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2341:x1875064559749120:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201681.152672:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2341:x1875064559749120:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16768us (17197us total) trans 30064772163 rc 0/0 00000100:00100000:1.0:1788201681.152696:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1162 00002000:00100000:1.0:1788201681.152715:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (95420416->96468991) req@ffff962487e7b480 x1875064559749120/t30064772163(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/448 e 0 to 0 dl 1788201692 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201681.152728:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b480 with x1875064559749120 ext(95420416->96468991) 00002000:00010000:1.0:1788201681.152737:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b480 00000100:00100000:3.0:1788201681.218256:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201681.218593:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559749248 00000100:00100000:1.0:1788201681.218606:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559749248 00002000:00100000:1.0:1788201681.218680:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (96468992->97517567) req@ffff962487e7b800 x1875064559749248/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/0 e 0 to 0 dl 1788201692 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201681.218693:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b800 with x1875064559749248 ext(96468992->97517567) 00002000:00010000:1.0:1788201681.218701:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b800 00000100:00100000:1.0:1788201681.218745:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1163 00000100:00100000:1.0:1788201681.218756:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2344:x1875064559749248:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201681.241610:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2344:x1875064559749248:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22837us (23351us total) trans 30064772164 rc 0/0 00000100:00100000:1.0:1788201681.241649:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1163 00002000:00100000:1.0:1788201681.241668:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (96468992->97517567) req@ffff962487e7b800 x1875064559749248/t30064772164(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/448 e 0 to 0 dl 1788201692 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201681.241679:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7b800 with x1875064559749248 ext(96468992->97517567) 00002000:00010000:1.0:1788201681.241686:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7b800 00000100:00100000:0.0:1788201681.341175:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201681.341924:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559749376 00000100:00100000:2.0:1788201681.341942:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559749376 00002000:00100000:2.0:1788201681.342079:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (97517568->98566143) req@ffff962382b17480 x1875064559749376/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/0 e 0 to 0 dl 1788201692 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201681.342092:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17480 with x1875064559749376 ext(97517568->98566143) 00002000:00010000:2.0:1788201681.342099:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17480 00000100:00100000:2.0:1788201681.342144:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1164 00000100:00100000:2.0:1788201681.342157:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2343:x1875064559749376:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201681.357422:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2343:x1875064559749376:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15246us (16242us total) trans 30064772165 rc 0/0 00000100:00100000:1.0:1788201681.357440:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1164 00002000:00100000:1.0:1788201681.357457:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (97517568->98566143) req@ffff962382b17480 x1875064559749376/t30064772165(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/448 e 0 to 0 dl 1788201692 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201681.357469:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b17480 with x1875064559749376 ext(97517568->98566143) 00002000:00010000:1.0:1788201681.357477:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b17480 00000100:00100000:2.0:1788201681.522624:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201681.522712:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559749504 00000100:00100000:1.0:1788201681.522730:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559749504 00002000:00100000:1.0:1788201681.523075:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (98566144->99614719) req@ffff9624c1e56680 x1875064559749504/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/0 e 0 to 0 dl 1788201692 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201681.523089:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56680 with x1875064559749504 ext(98566144->99614719) 00002000:00010000:1.0:1788201681.523097:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56680 00000100:00100000:1.0:1788201681.523137:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1165 00000100:00100000:1.0:1788201681.523150:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2344:x1875064559749504:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201681.563936:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2344:x1875064559749504:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 40774us (41308us total) trans 30064772166 rc 0/0 00000100:00100000:1.0:1788201681.563954:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1165 00002000:00100000:1.0:1788201681.563985:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (98566144->99614719) req@ffff9624c1e56680 x1875064559749504/t30064772166(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/448 e 0 to 0 dl 1788201692 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201681.563996:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56680 with x1875064559749504 ext(98566144->99614719) 00002000:00010000:1.0:1788201681.564002:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56680 00000001:00080000:2.0:1788201681.625866:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772141 is committed 00000001:00080000:2.0:1788201681.626131:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772165 is committed 00000100:00100000:2.0:1788201681.695660:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201681.695819:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559749632 00000100:00100000:1.0:1788201681.695835:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559749632 00002000:00100000:1.0:1788201681.696064:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (99614720->100663295) req@ffff9624c1e56d80 x1875064559749632/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/0 e 0 to 0 dl 1788201692 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201681.696075:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56d80 with x1875064559749632 ext(99614720->100663295) 00002000:00010000:1.0:1788201681.696080:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56d80 00000100:00100000:1.0:1788201681.696117:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1166 00000100:00100000:1.0:1788201681.696126:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+8:2343:x1875064559749632:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201681.710881:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559749632:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14738us (15218us total) trans 30064772167 rc 0/0 00000100:00100000:3.0:1788201681.710899:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1166 00002000:00100000:3.0:1788201681.710917:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (99614720->100663295) req@ffff9624c1e56d80 x1875064559749632/t30064772167(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/448 e 0 to 0 dl 1788201692 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201681.710946:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e56d80 with x1875064559749632 ext(99614720->100663295) 00002000:00010000:3.0:1788201681.710955:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e56d80 00010000:00010000:2.0:1788201681.718842:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201681.720929:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201681.720995:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201681.721135:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559749760 00000100:00100000:3.0:1788201681.721149:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559749760 00000100:00100000:3.0:1788201681.721275:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 586 00000100:00100000:3.0:1788201681.721289:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559749760:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1788201681.721425:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559749760:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 140us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201681.721433:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 586 00000100:00100000:2.0:1788201681.722936:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559749888 00000100:00100000:2.0:1788201681.722988:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559749888 00000100:00100000:2.0:1788201681.723083:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 487 00000100:00100000:2.0:1788201681.723093:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559749888:12345-192.168.201.56@tcp:400:kworker.0 00000100:00080000:0.0:1788201681.723611:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201681.723819:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559749888:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 725us (2900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201681.723829:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 487 00000100:00100000:1.0:1788201681.904068:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201681.904563:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559750016 00000100:00100000:2.0:1788201681.904577:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559750016 00002000:00100000:2.0:1788201681.904653:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (100663296->101711871) req@ffff9624bfd2ca80 x1875064559750016/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/0 e 0 to 0 dl 1788201692 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201681.904677:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2ca80 with x1875064559750016 ext(100663296->101711871) 00002000:00010000:2.0:1788201681.904685:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2ca80 00000100:00100000:2.0:1788201681.904735:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1167 00000100:00100000:2.0:1788201681.904747:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559750016:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201681.925199:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2344:x1875064559750016:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20425us (21122us total) trans 30064772168 rc 0/0 00000100:00100000:2.0:1788201681.925218:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1167 00002000:00100000:2.0:1788201681.925236:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (100663296->101711871) req@ffff9624bfd2ca80 x1875064559750016/t30064772168(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:47/0 lens 488/448 e 0 to 0 dl 1788201692 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201681.925249:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2ca80 with x1875064559750016 ext(100663296->101711871) 00002000:00010000:2.0:1788201681.925257:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2ca80 00000100:00100000:1.0:1788201682.051112:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201682.051245:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559750144 00000100:00100000:2.0:1788201682.051258:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559750144 00002000:00100000:2.0:1788201682.051326:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (101711872->102760447) req@ffff9624bfd2f800 x1875064559750144/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/0 e 0 to 0 dl 1788201693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201682.051415:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2f800 with x1875064559750144 ext(101711872->102760447) 00002000:00010000:2.0:1788201682.051421:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2f800 00000100:00100000:2.0:1788201682.051458:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1168 00000100:00100000:2.0:1788201682.051469:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624bfd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559750144:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201682.073314:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624bfd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559750144:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21827us (22200us total) trans 30064772169 rc 0/0 00000100:00100000:2.0:1788201682.073333:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1168 00002000:00100000:2.0:1788201682.073377:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (101711872->102760447) req@ffff9624bfd2f800 x1875064559750144/t30064772169(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/448 e 0 to 0 dl 1788201693 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201682.073391:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624bfd2f800 with x1875064559750144 ext(101711872->102760447) 00002000:00010000:2.0:1788201682.073398:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624bfd2f800 00000100:00100000:1.0:1788201682.227744:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201682.227974:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559750272 00000100:00100000:0.0:1788201682.227989:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559750272 00002000:00100000:0.0:1788201682.228063:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (102760448->103809023) req@ffff962485aaf480 x1875064559750272/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/0 e 0 to 0 dl 1788201693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201682.228076:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaf480 with x1875064559750272 ext(102760448->103809023) 00002000:00010000:0.0:1788201682.228082:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaf480 00000100:00100000:0.0:1788201682.228148:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1169 00000100:00100000:0.0:1788201682.228161:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2344:x1875064559750272:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201682.267189:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2344:x1875064559750272:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 39000us (39433us total) trans 30064772170 rc 0/0 00000100:00100000:0.0:1788201682.267207:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1169 00002000:00100000:0.0:1788201682.267227:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (102760448->103809023) req@ffff962485aaf480 x1875064559750272/t30064772170(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/448 e 0 to 0 dl 1788201693 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201682.267238:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaf480 with x1875064559750272 ext(102760448->103809023) 00002000:00010000:0.0:1788201682.267246:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaf480 00000100:00100000:3.0:1788201682.332325:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201682.332516:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559750400 00000100:00100000:1.0:1788201682.332530:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559750400 00002000:00100000:1.0:1788201682.332613:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (103809024->104857599) req@ffff962487e78000 x1875064559750400/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/0 e 0 to 0 dl 1788201693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201682.332626:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78000 with x1875064559750400 ext(103809024->104857599) 00002000:00010000:1.0:1788201682.332634:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78000 00000100:00100000:1.0:1788201682.332684:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1170 00000100:00100000:1.0:1788201682.332697:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559750400:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201682.350718:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559750400:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18007us (18391us total) trans 30064772171 rc 0/0 00000100:00100000:3.0:1788201682.350736:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1170 00002000:00100000:3.0:1788201682.350753:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (103809024->104857599) req@ffff962487e78000 x1875064559750400/t30064772171(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/448 e 0 to 0 dl 1788201693 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201682.350766:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78000 with x1875064559750400 ext(103809024->104857599) 00002000:00010000:3.0:1788201682.350774:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78000 00000100:00100000:2.0:1788201682.433926:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201682.434120:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559750528 00000100:00100000:1.0:1788201682.434135:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559750528 00002000:00100000:1.0:1788201682.434235:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (104857600->105906175) req@ffff9624c1e55c00 x1875064559750528/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/0 e 0 to 0 dl 1788201693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201682.434249:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55c00 with x1875064559750528 ext(104857600->105906175) 00002000:00010000:1.0:1788201682.434257:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55c00 00000100:00100000:1.0:1788201682.434299:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1171 00000100:00100000:1.0:1788201682.434310:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2343:x1875064559750528:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201682.469265:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559750528:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 34937us (35336us total) trans 30064772172 rc 0/0 00000100:00100000:0.0:1788201682.469285:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1171 00002000:00100000:0.0:1788201682.469303:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (104857600->105906175) req@ffff9624c1e55c00 x1875064559750528/t30064772172(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/448 e 0 to 0 dl 1788201693 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201682.469315:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55c00 with x1875064559750528 ext(104857600->105906175) 00002000:00010000:0.0:1788201682.469323:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55c00 00000100:00100000:3.0:1788201682.500922:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570167808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201682.501036:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201682.501189:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570167808 00000100:00100000:0.0:1788201682.501199:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570167808 00000100:00100000:0.0:1788201682.501275:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788201682.501286:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570167808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201682.501359:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788201682.502050:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201682.508140:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570167808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6839us (7087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201682.508160:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00010000:00080000:2.0:1788201682.510321:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962485aac000 x1875064570167808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201682.510389:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570167808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201682.592800:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201682.592931:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559750656 00000100:00100000:1.0:1788201682.592946:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559750656 00002000:00100000:1.0:1788201682.593011:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (105906176->106954751) req@ffff9624c1e57100 x1875064559750656/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/0 e 0 to 0 dl 1788201693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201682.593026:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57100 with x1875064559750656 ext(105906176->106954751) 00002000:00010000:1.0:1788201682.593032:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57100 00000100:00100000:1.0:1788201682.593072:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1172 00000100:00100000:1.0:1788201682.593083:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2344:x1875064559750656:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201682.616985:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559750656:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23889us (24188us total) trans 30064772173 rc 0/0 00000100:00100000:3.0:1788201682.616999:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1172 00002000:00100000:3.0:1788201682.617012:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (105906176->106954751) req@ffff9624c1e57100 x1875064559750656/t30064772173(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/448 e 0 to 0 dl 1788201693 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201682.617039:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57100 with x1875064559750656 ext(105906176->106954751) 00002000:00010000:3.0:1788201682.617047:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57100 00010000:00010000:2.0:1788201682.750307:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201682.786388:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201682.786601:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559750784 00000100:00100000:0.0:1788201682.786611:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559750784 00002000:00100000:0.0:1788201682.786676:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (106954752->108003327) req@ffff9624c1e54a80 x1875064559750784/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/0 e 0 to 0 dl 1788201693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201682.786688:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54a80 with x1875064559750784 ext(106954752->108003327) 00002000:00010000:0.0:1788201682.786692:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54a80 00000100:00100000:0.0:1788201682.786730:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1173 00000100:00100000:0.0:1788201682.786748:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2342:x1875064559750784:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201682.811690:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2342:x1875064559750784:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24924us (25294us total) trans 30064772174 rc 0/0 00000100:00100000:0.0:1788201682.811707:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1173 00002000:00100000:0.0:1788201682.811721:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (106954752->108003327) req@ffff9624c1e54a80 x1875064559750784/t30064772174(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/448 e 0 to 0 dl 1788201693 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201682.811743:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e54a80 with x1875064559750784 ext(106954752->108003327) 00002000:00010000:0.0:1788201682.811750:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e54a80 00000100:00100000:2.0:1788201682.900623:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201682.900861:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559750912 00000100:00100000:3.0:1788201682.900875:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559750912 00002000:00100000:3.0:1788201682.901017:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (108003328->109051903) req@ffff9624c1e57b80 x1875064559750912/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/0 e 0 to 0 dl 1788201693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201682.901030:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57b80 with x1875064559750912 ext(108003328->109051903) 00002000:00010000:3.0:1788201682.901037:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57b80 00000100:00100000:3.0:1788201682.901166:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1174 00000100:00100000:3.0:1788201682.901179:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559750912:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201682.950078:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559750912:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 48882us (49451us total) trans 30064772175 rc 0/0 00000100:00100000:3.0:1788201682.950096:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1174 00002000:00100000:3.0:1788201682.950115:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (108003328->109051903) req@ffff9624c1e57b80 x1875064559750912/t30064772175(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:48/0 lens 488/448 e 0 to 0 dl 1788201693 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201682.950127:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e57b80 with x1875064559750912 ext(108003328->109051903) 00002000:00010000:3.0:1788201682.950135:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e57b80 00000100:00100000:3.0:1788201682.998938:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570168320:0@lo:400:kworker.0 00000100:00100000:3.0:1788201682.999048:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201682.999143:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788201682.999151:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570167936:0@lo:400:kworker.0 00000100:00100000:3.0:1788201682.999195:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201682.999247:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570168448:0@lo:400:kworker.0 00000100:00100000:3.0:1788201682.999277:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201682.999306:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570168192:0@lo:400:kworker.0 00000100:00100000:3.0:1788201682.999330:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201682.999385:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201682.999391:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570168064:0@lo:400:kworker.0 00000100:00100000:3.0:1788201682.999415:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201682.999432:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570168576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201682.999453:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201682.999485:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570167936 00000100:00100000:3.0:1788201682.999496:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570167936 00000100:00100000:3.0:1788201682.999556:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:3.0:1788201682.999566:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570167936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201682.999627:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570167936:12345-0@lo:400:kworker.0 Request processed in 62us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201682.999635:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1788201682.999977:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570168320 00000100:00100000:1.0:1788201682.999983:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570168320 00000100:00100000:1.0:1788201683.000024:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570168064 00000100:00100000:1.0:1788201683.000026:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570168064 00000100:00100000:1.0:1788201683.000038:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570168576 00000100:00100000:1.0:1788201683.000040:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570168576 00000100:00100000:1.0:1788201683.000055:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1788201683.000061:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570168320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201683.000103:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570168320:12345-0@lo:400:kworker.0 Request processed in 42us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201683.000129:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1788201683.000149:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1788201683.000155:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570168064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201683.000221:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570168064:12345-0@lo:400:kworker.0 Request processed in 66us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201683.000226:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1788201683.000236:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1788201683.000242:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570168576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201683.000266:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570168576:12345-0@lo:400:kworker.0 Request processed in 25us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201683.000271:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1788201683.000317:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570168448 00000100:00100000:1.0:1788201683.000320:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570168448 00000100:00100000:3.0:1788201683.000552:0:8088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570168192 00000100:00100000:3.0:1788201683.000557:0:8088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570168192 00000100:00100000:3.0:1788201683.000582:0:8088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788201683.000590:0:8088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570168448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.000625:0:8088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570168448:12345-0@lo:400:kworker.0 Request processed in 36us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.000632:0:8088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788201683.000781:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788201683.000790:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570168192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201683.000824:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570168192:12345-0@lo:400:kworker.0 Request processed in 36us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201683.000830:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788201683.000895:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570168064:0@lo:400:kworker.0 00000100:00100000:1.0:1788201683.000908:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570168576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201683.000934:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570168192:0@lo:400:kworker.0 00000100:00100000:1.0:1788201683.001036:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570167936:0@lo:400:kworker.0 00010000:00080000:1.0:1788201683.001053:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962485aaea00 x1875064570168448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201683.001075:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570168448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201683.001091:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570168320:0@lo:400:kworker.0 00000100:00080000:2.0:1788201683.002094:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201683.002103:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201683.055766:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201683.061841:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559751040 00000100:00100000:1.0:1788201683.061862:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559751040 00002000:00100000:1.0:1788201683.061986:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (109051904->110100479) req@ffff962487e7a680 x1875064559751040/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/0 e 0 to 0 dl 1788201694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201683.061999:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7a680 with x1875064559751040 ext(109051904->110100479) 00002000:00010000:1.0:1788201683.062007:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7a680 00000100:00100000:1.0:1788201683.062039:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1175 00000100:00100000:1.0:1788201683.062052:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2342:x1875064559751040:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201683.063756:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201683.084980:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2342:x1875064559751040:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22915us (29211us total) trans 30064772176 rc 0/0 00000100:00100000:0.0:1788201683.084997:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1175 00002000:00100000:0.0:1788201683.085013:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (109051904->110100479) req@ffff962487e7a680 x1875064559751040/t30064772176(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/448 e 0 to 0 dl 1788201694 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201683.085027:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e7a680 with x1875064559751040 ext(109051904->110100479) 00002000:00010000:0.0:1788201683.085034:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e7a680 00000100:00100000:3.0:1788201683.214199:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201683.214530:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559751168 00000100:00100000:1.0:1788201683.214544:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559751168 00002000:00100000:1.0:1788201683.214612:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (110100480->111149055) req@ffff962487e78e00 x1875064559751168/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/0 e 0 to 0 dl 1788201694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201683.214626:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78e00 with x1875064559751168 ext(110100480->111149055) 00002000:00010000:1.0:1788201683.214644:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78e00 00000100:00100000:1.0:1788201683.214742:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1176 00000100:00100000:1.0:1788201683.214753:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962487e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559751168:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201683.231532:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962487e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559751168:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16761us (18572us total) trans 30064772177 rc 0/0 00000100:00100000:0.0:1788201683.231573:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1176 00002000:00100000:0.0:1788201683.231592:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (110100480->111149055) req@ffff962487e78e00 x1875064559751168/t30064772177(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/448 e 0 to 0 dl 1788201694 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201683.231605:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962487e78e00 with x1875064559751168 ext(110100480->111149055) 00002000:00010000:0.0:1788201683.231613:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962487e78e00 00000100:00100000:3.0:1788201683.383797:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201683.384053:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559751296 00000100:00100000:0.0:1788201683.384066:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559751296 00002000:00100000:0.0:1788201683.384141:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (111149056->112197631) req@ffff962393aa3b80 x1875064559751296/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/0 e 0 to 0 dl 1788201694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201683.384183:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa3b80 with x1875064559751296 ext(111149056->112197631) 00002000:00010000:0.0:1788201683.384190:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa3b80 00000100:00100000:0.0:1788201683.384235:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1177 00000100:00100000:0.0:1788201683.384247:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559751296:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201683.408000:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559751296:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23739us (24202us total) trans 30064772178 rc 0/0 00000100:00100000:2.0:1788201683.408019:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1177 00002000:00100000:2.0:1788201683.408037:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (111149056->112197631) req@ffff962393aa3b80 x1875064559751296/t30064772178(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/448 e 0 to 0 dl 1788201694 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201683.408049:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa3b80 with x1875064559751296 ext(111149056->112197631) 00002000:00010000:2.0:1788201683.408057:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa3b80 00000100:00100000:1.0:1788201683.556778:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201683.556886:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559751424 00000100:00100000:0.0:1788201683.556897:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559751424 00002000:00100000:0.0:1788201683.556964:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (112197632->113246207) req@ffff962485aafb80 x1875064559751424/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/0 e 0 to 0 dl 1788201694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201683.556979:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aafb80 with x1875064559751424 ext(112197632->113246207) 00002000:00010000:0.0:1788201683.556987:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aafb80 00000100:00100000:0.0:1788201683.557062:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1178 00000100:00100000:0.0:1788201683.557071:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559751424:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201683.576167:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2344:x1875064559751424:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19062us (19370us total) trans 30064772179 rc 0/0 00000100:00100000:0.0:1788201683.576219:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1178 00002000:00100000:0.0:1788201683.576241:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (112197632->113246207) req@ffff962485aafb80 x1875064559751424/t30064772179(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/448 e 0 to 0 dl 1788201694 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201683.576254:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aafb80 with x1875064559751424 ext(112197632->113246207) 00002000:00010000:0.0:1788201683.576262:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aafb80 00000100:00100000:1.0:1788201683.671596:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201683.671841:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559751552 00000100:00100000:0.0:1788201683.671854:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559751552 00002000:00100000:0.0:1788201683.671922:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (113246208->114294783) req@ffff962485aaea00 x1875064559751552/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/0 e 0 to 0 dl 1788201694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201683.671947:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaea00 with x1875064559751552 ext(113246208->114294783) 00002000:00010000:0.0:1788201683.671954:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaea00 00000100:00100000:0.0:1788201683.671997:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1179 00000100:00100000:0.0:1788201683.672008:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2341:x1875064559751552:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201683.699655:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2341:x1875064559751552:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 27631us (28058us total) trans 30064772180 rc 0/0 00000100:00100000:0.0:1788201683.699674:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1179 00002000:00100000:0.0:1788201683.699692:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (113246208->114294783) req@ffff962485aaea00 x1875064559751552/t30064772180(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/448 e 0 to 0 dl 1788201694 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201683.699705:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaea00 with x1875064559751552 ext(113246208->114294783) 00002000:00010000:0.0:1788201683.699715:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaea00 00010000:00010000:0.0:1788201683.766649:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201683.840501:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201683.840619:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559751680 00000100:00100000:1.0:1788201683.840648:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559751680 00002000:00100000:1.0:1788201683.840719:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (114294784->115343359) req@ffff9624c1e55500 x1875064559751680/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/0 e 0 to 0 dl 1788201694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201683.840760:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55500 with x1875064559751680 ext(114294784->115343359) 00002000:00010000:1.0:1788201683.840767:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55500 00000100:00100000:1.0:1788201683.840798:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1180 00000100:00100000:1.0:1788201683.840809:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559751680:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201683.869037:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559751680:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 25528us (25851us total) trans 30064772181 rc 0/0 00000100:00100000:1.0:1788201683.869057:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1180 00002000:00100000:1.0:1788201683.869081:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (114294784->115343359) req@ffff9624c1e55500 x1875064559751680/t30064772181(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/448 e 0 to 0 dl 1788201694 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201683.869094:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55500 with x1875064559751680 ext(114294784->115343359) 00002000:00010000:1.0:1788201683.869103:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55500 00000100:00100000:3.0:1788201683.996907:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201683.997153:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559751808 00000100:00100000:2.0:1788201683.997166:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559751808 00002000:00100000:2.0:1788201683.997233:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (115343360->116391935) req@ffff962393aa1880 x1875064559751808/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/0 e 0 to 0 dl 1788201694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201683.997245:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1880 with x1875064559751808 ext(115343360->116391935) 00002000:00010000:2.0:1788201683.997253:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1880 00000100:00100000:2.0:1788201683.997294:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1181 00000100:00100000:2.0:1788201683.997304:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2342:x1875064559751808:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201684.017629:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2342:x1875064559751808:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20307us (20720us total) trans 30064772182 rc 0/0 00000100:00100000:0.0:1788201684.017668:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1181 00002000:00100000:0.0:1788201684.017685:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (115343360->116391935) req@ffff962393aa1880 x1875064559751808/t30064772182(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:49/0 lens 488/448 e 0 to 0 dl 1788201694 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201684.017697:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1880 with x1875064559751808 ext(115343360->116391935) 00002000:00010000:0.0:1788201684.017705:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1880 00000100:00100000:3.0:1788201684.169777:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201684.169873:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559751936 00000100:00100000:0.0:1788201684.169890:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559751936 00002000:00100000:0.0:1788201684.169966:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (116391936->117440511) req@ffff962393aa2a00 x1875064559751936/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:50/0 lens 488/0 e 0 to 0 dl 1788201695 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201684.169980:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2a00 with x1875064559751936 ext(116391936->117440511) 00002000:00010000:0.0:1788201684.169986:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2a00 00000100:00100000:0.0:1788201684.170026:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1182 00000100:00100000:0.0:1788201684.170039:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559751936:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201684.189813:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2341:x1875064559751936:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19418us (19689us total) trans 30064772183 rc 0/0 00000100:00100000:0.0:1788201684.191814:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1182 00002000:00100000:0.0:1788201684.192052:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (116391936->117440511) req@ffff962393aa2a00 x1875064559751936/t30064772183(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:50/0 lens 488/448 e 0 to 0 dl 1788201695 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201684.192065:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2a00 with x1875064559751936 ext(116391936->117440511) 00002000:00010000:0.0:1788201684.192072:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2a00 00000100:00100000:3.0:1788201684.364742:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201684.365308:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559752064 00000100:00100000:0.0:1788201684.365318:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559752064 00002000:00100000:0.0:1788201684.365408:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (117440512->118489087) req@ffff962393aa1180 x1875064559752064/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:50/0 lens 488/0 e 0 to 0 dl 1788201695 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201684.365431:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1180 with x1875064559752064 ext(117440512->118489087) 00002000:00010000:0.0:1788201684.365437:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1180 00000100:00100000:0.0:1788201684.365481:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1183 00000100:00100000:0.0:1788201684.365491:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2344:x1875064559752064:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201684.389706:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559752064:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24204us (24963us total) trans 30064772184 rc 0/0 00000100:00100000:0.0:1788201684.389723:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1183 00002000:00100000:0.0:1788201684.389737:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (117440512->118489087) req@ffff962393aa1180 x1875064559752064/t30064772184(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:50/0 lens 488/448 e 0 to 0 dl 1788201695 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201684.389748:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1180 with x1875064559752064 ext(117440512->118489087) 00002000:00010000:0.0:1788201684.389754:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1180 00000100:00100000:3.0:1788201684.516621:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201684.516710:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559752192 00000100:00100000:1.0:1788201684.516721:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559752192 00002000:00100000:1.0:1788201684.516774:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (118489088->119537663) req@ffff962393aa0700 x1875064559752192/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:50/0 lens 488/0 e 0 to 0 dl 1788201695 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201684.516786:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa0700 with x1875064559752192 ext(118489088->119537663) 00002000:00010000:1.0:1788201684.516792:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa0700 00000100:00100000:1.0:1788201684.516817:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1184 00000100:00100000:1.0:1788201684.516827:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559752192:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201684.530765:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2343:x1875064559752192:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13928us (14143us total) trans 30064772185 rc 0/0 00000100:00100000:1.0:1788201684.530780:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1184 00002000:00100000:1.0:1788201684.530805:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (118489088->119537663) req@ffff962393aa0700 x1875064559752192/t30064772185(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:50/0 lens 488/448 e 0 to 0 dl 1788201695 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201684.530816:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa0700 with x1875064559752192 ext(118489088->119537663) 00002000:00010000:1.0:1788201684.530822:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa0700 00000100:00100000:3.0:1788201684.636056:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201684.636471:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559752320 00000100:00100000:2.0:1788201684.636484:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559752320 00002000:00100000:2.0:1788201684.636552:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (119537664->120586239) req@ffff962393aa2300 x1875064559752320/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:50/0 lens 488/0 e 0 to 0 dl 1788201695 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201684.636565:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2300 with x1875064559752320 ext(119537664->120586239) 00002000:00010000:2.0:1788201684.636572:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2300 00000100:00100000:0.0:1788201684.636778:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1185 00000100:00100000:0.0:1788201684.636794:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559752320:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201684.667793:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2344:x1875064559752320:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30987us (31732us total) trans 30064772186 rc 0/0 00000100:00100000:0.0:1788201684.667813:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1185 00002000:00100000:0.0:1788201684.667829:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (119537664->120586239) req@ffff962393aa2300 x1875064559752320/t30064772186(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:50/0 lens 488/448 e 0 to 0 dl 1788201695 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201684.667841:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2300 with x1875064559752320 ext(119537664->120586239) 00002000:00010000:0.0:1788201684.667848:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2300 00000100:00100000:3.0:1788201684.743891:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201684.748590:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559752448 00000100:00100000:0.0:1788201684.748687:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559752448 00002000:00100000:1.0:1788201684.752265:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (120586240->121634815) req@ffff962393aa0380 x1875064559752448/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:50/0 lens 488/0 e 0 to 0 dl 1788201695 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201684.752285:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa0380 with x1875064559752448 ext(120586240->121634815) 00002000:00010000:1.0:1788201684.752294:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa0380 00000100:00100000:1.0:1788201684.752470:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1186 00000100:00100000:1.0:1788201684.752485:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559752448:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201684.790192:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559752448:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 37686us (46292us total) trans 30064772187 rc 0/0 00000100:00100000:1.0:1788201684.790215:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1186 00002000:00100000:1.0:1788201684.790237:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (120586240->121634815) req@ffff962393aa0380 x1875064559752448/t30064772187(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:50/0 lens 488/448 e 0 to 0 dl 1788201695 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201684.790249:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa0380 with x1875064559752448 ext(120586240->121634815) 00002000:00010000:1.0:1788201684.790257:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa0380 00010000:00010000:1.0:1788201684.796834:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201684.883719:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201684.883849:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559752576 00000100:00100000:0.0:1788201684.883862:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559752576 00002000:00100000:0.0:1788201684.883943:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (121634816->122683391) req@ffff9624c1e55f80 x1875064559752576/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:50/0 lens 488/0 e 0 to 0 dl 1788201695 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201684.883956:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55f80 with x1875064559752576 ext(121634816->122683391) 00002000:00010000:0.0:1788201684.883963:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55f80 00000100:00100000:0.0:1788201684.884006:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1187 00000100:00100000:0.0:1788201684.884018:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559752576:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201684.907642:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2342:x1875064559752576:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23609us (23923us total) trans 30064772188 rc 0/0 00000100:00100000:0.0:1788201684.907661:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1187 00002000:00100000:0.0:1788201684.907676:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (121634816->122683391) req@ffff9624c1e55f80 x1875064559752576/t30064772188(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:50/0 lens 488/448 e 0 to 0 dl 1788201695 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201684.907687:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e55f80 with x1875064559752576 ext(121634816->122683391) 00002000:00010000:0.0:1788201684.907695:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e55f80 00000100:00100000:2.0:1788201685.008505:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201685.011601:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559752704 00000100:00100000:0.0:1788201685.011692:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559752704 00002000:00100000:0.0:1788201685.011950:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (122683392->123731967) req@ffff9624c1cc5f80 x1875064559752704/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/0 e 0 to 0 dl 1788201696 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201685.011960:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5f80 with x1875064559752704 ext(122683392->123731967) 00002000:00010000:0.0:1788201685.011966:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5f80 00000100:00100000:0.0:1788201685.012001:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1188 00000100:00100000:0.0:1788201685.012013:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559752704:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201685.019568:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201685.025666:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559752704:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13635us (17155us total) trans 30064772189 rc 0/0 00000100:00100000:0.0:1788201685.025687:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1188 00002000:00100000:0.0:1788201685.025708:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (122683392->123731967) req@ffff9624c1cc5f80 x1875064559752704/t30064772189(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/448 e 0 to 0 dl 1788201696 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201685.025720:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5f80 with x1875064559752704 ext(122683392->123731967) 00002000:00010000:0.0:1788201685.025728:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5f80 00000100:00100000:3.0:1788201685.049826:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff962485aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570168704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201685.050003:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201685.054012:0:20417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570168704 00000100:00100000:0.0:1788201685.054033:0:20417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570168704 00000100:00100000:0.0:1788201685.054231:0:20417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788201685.054244:0:20417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570168704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201685.054280:0:20417:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 568655872 pending 40894464 free 2786066432 avail 2783969280 00000100:00100000:0.0:1788201685.054414:0:20417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570168704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (4411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201685.054422:0:20417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788201685.056719:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff962485aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570168704:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201685.059208:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201685.124862:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201685.129237:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559752832 00000100:00100000:1.0:1788201685.129260:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559752832 00002000:00100000:0.0:1788201685.129847:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (123731968->124780543) req@ffff9624c1cc7800 x1875064559752832/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/0 e 0 to 0 dl 1788201696 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201685.129862:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc7800 with x1875064559752832 ext(123731968->124780543) 00002000:00010000:0.0:1788201685.129870:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc7800 00000100:00100000:0.0:1788201685.129979:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1189 00000100:00100000:0.0:1788201685.129992:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2341:x1875064559752832:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201685.144532:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2341:x1875064559752832:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14526us (19669us total) trans 30064772190 rc 0/0 00000100:00100000:0.0:1788201685.144572:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1189 00002000:00100000:0.0:1788201685.144592:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (123731968->124780543) req@ffff9624c1cc7800 x1875064559752832/t30064772190(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/448 e 0 to 0 dl 1788201696 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201685.144874:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc7800 with x1875064559752832 ext(123731968->124780543) 00002000:00010000:0.0:1788201685.144883:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc7800 00000100:00100000:3.0:1788201685.219168:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201685.219408:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559752960 00000100:00100000:1.0:1788201685.219422:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559752960 00002000:00100000:1.0:1788201685.219496:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (124780544->125829119) req@ffff962393aa3480 x1875064559752960/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/0 e 0 to 0 dl 1788201696 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201685.219528:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa3480 with x1875064559752960 ext(124780544->125829119) 00002000:00010000:1.0:1788201685.219536:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa3480 00000100:00100000:1.0:1788201685.219570:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1190 00000100:00100000:1.0:1788201685.219581:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559752960:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201685.249875:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559752960:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30279us (30708us total) trans 30064772191 rc 0/0 00000100:00100000:2.0:1788201685.249892:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1190 00002000:00100000:2.0:1788201685.249908:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (124780544->125829119) req@ffff962393aa3480 x1875064559752960/t30064772191(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/448 e 0 to 0 dl 1788201696 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201685.249921:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa3480 with x1875064559752960 ext(124780544->125829119) 00002000:00010000:2.0:1788201685.249928:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa3480 00000100:00100000:1.0:1788201685.416338:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201685.416553:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559753088 00000100:00100000:2.0:1788201685.416566:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559753088 00002000:00100000:2.0:1788201685.416633:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (125829120->126877695) req@ffff962485aace00 x1875064559753088/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/0 e 0 to 0 dl 1788201696 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201685.416646:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aace00 with x1875064559753088 ext(125829120->126877695) 00002000:00010000:2.0:1788201685.416653:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aace00 00000100:00100000:2.0:1788201685.416751:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1191 00000100:00100000:2.0:1788201685.416779:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559753088:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201685.443670:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2343:x1875064559753088:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 26887us (27323us total) trans 30064772192 rc 0/0 00000100:00100000:2.0:1788201685.443762:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1191 00002000:00100000:2.0:1788201685.443782:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (125829120->126877695) req@ffff962485aace00 x1875064559753088/t30064772192(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/448 e 0 to 0 dl 1788201696 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201685.443794:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aace00 with x1875064559753088 ext(125829120->126877695) 00002000:00010000:2.0:1788201685.443800:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aace00 00000100:00100000:3.0:1788201685.585236:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201685.585329:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559753216 00000100:00100000:0.0:1788201685.585377:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559753216 00002000:00100000:0.0:1788201685.585506:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (126877696->127926271) req@ffff962393aa3800 x1875064559753216/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/0 e 0 to 0 dl 1788201696 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201685.585521:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa3800 with x1875064559753216 ext(126877696->127926271) 00002000:00010000:0.0:1788201685.585529:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa3800 00000100:00100000:0.0:1788201685.585568:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1192 00000100:00100000:0.0:1788201685.585582:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2343:x1875064559753216:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201685.605666:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2343:x1875064559753216:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20070us (20430us total) trans 30064772193 rc 0/0 00000100:00100000:0.0:1788201685.605685:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1192 00002000:00100000:0.0:1788201685.605702:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (126877696->127926271) req@ffff962393aa3800 x1875064559753216/t30064772193(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/448 e 0 to 0 dl 1788201696 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201685.605716:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa3800 with x1875064559753216 ext(126877696->127926271) 00002000:00010000:0.0:1788201685.605724:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa3800 00000100:00100000:3.0:1788201685.783993:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201685.784276:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559753344 00000100:00100000:0.0:1788201685.784291:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559753344 00002000:00100000:0.0:1788201685.784400:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (127926272->128974847) req@ffff962393aa0000 x1875064559753344/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/0 e 0 to 0 dl 1788201696 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201685.784481:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa0000 with x1875064559753344 ext(127926272->128974847) 00002000:00010000:0.0:1788201685.784490:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa0000 00000100:00100000:0.0:1788201685.784582:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1193 00000100:00100000:0.0:1788201685.784604:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2344:x1875064559753344:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201685.801630:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2344:x1875064559753344:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17011us (17635us total) trans 30064772194 rc 0/0 00000100:00100000:2.0:1788201685.801652:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1193 00002000:00100000:2.0:1788201685.801673:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (127926272->128974847) req@ffff962393aa0000 x1875064559753344/t30064772194(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/448 e 0 to 0 dl 1788201696 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201685.801685:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa0000 with x1875064559753344 ext(127926272->128974847) 00002000:00010000:2.0:1788201685.801693:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa0000 00010000:00010000:2.0:1788201685.817660:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201685.945750:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201685.945861:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559753472 00000100:00100000:2.0:1788201685.945876:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559753472 00002000:00100000:2.0:1788201685.945944:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (128974848->130023423) req@ffff962485aaca80 x1875064559753472/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/0 e 0 to 0 dl 1788201696 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201685.945958:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaca80 with x1875064559753472 ext(128974848->130023423) 00002000:00010000:2.0:1788201685.945966:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaca80 00000100:00100000:2.0:1788201685.946019:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1194 00000100:00100000:2.0:1788201685.946030:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2343:x1875064559753472:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201685.958687:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2343:x1875064559753472:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12639us (12933us total) trans 30064772195 rc 0/0 00000100:00100000:2.0:1788201685.958705:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1194 00002000:00100000:2.0:1788201685.958721:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (128974848->130023423) req@ffff962485aaca80 x1875064559753472/t30064772195(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:51/0 lens 488/448 e 0 to 0 dl 1788201696 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201685.958733:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaca80 with x1875064559753472 ext(128974848->130023423) 00002000:00010000:2.0:1788201685.958741:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaca80 00000100:00100000:1.0:1788201686.155004:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201686.155238:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559753600 00000100:00100000:2.0:1788201686.155275:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559753600 00002000:00100000:2.0:1788201686.155685:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (130023424->131071999) req@ffff962485aad180 x1875064559753600/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/0 e 0 to 0 dl 1788201697 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201686.155700:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aad180 with x1875064559753600 ext(130023424->131071999) 00002000:00010000:2.0:1788201686.155708:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aad180 00000100:00100000:2.0:1788201686.155754:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1195 00000100:00100000:2.0:1788201686.155767:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2344:x1875064559753600:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201686.170570:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2344:x1875064559753600:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14791us (15569us total) trans 30064772196 rc 0/0 00000100:00100000:2.0:1788201686.170593:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1195 00002000:00100000:2.0:1788201686.170610:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (130023424->131071999) req@ffff962485aad180 x1875064559753600/t30064772196(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/448 e 0 to 0 dl 1788201697 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201686.170624:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aad180 with x1875064559753600 ext(130023424->131071999) 00002000:00010000:2.0:1788201686.170631:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aad180 00000100:00100000:3.0:1788201686.294064:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201686.294215:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559753728 00000100:00100000:0.0:1788201686.294228:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559753728 00002000:00100000:0.0:1788201686.294293:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (131072000->132120575) req@ffff962393aa2680 x1875064559753728/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/0 e 0 to 0 dl 1788201697 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201686.294305:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2680 with x1875064559753728 ext(131072000->132120575) 00002000:00010000:0.0:1788201686.294312:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2680 00000100:00100000:0.0:1788201686.294392:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1196 00000100:00100000:0.0:1788201686.294405:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2343:x1875064559753728:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201686.314689:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+70:2343:x1875064559753728:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20271us (20625us total) trans 30064772197 rc 0/0 00000100:00100000:0.0:1788201686.314705:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1196 00002000:00100000:0.0:1788201686.314720:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (131072000->132120575) req@ffff962393aa2680 x1875064559753728/t30064772197(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/448 e 0 to 0 dl 1788201697 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201686.314732:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2680 with x1875064559753728 ext(131072000->132120575) 00002000:00010000:0.0:1788201686.314740:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2680 00000100:00100000:3.0:1788201686.424542:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201686.425384:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559753856 00000100:00100000:0.0:1788201686.425399:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559753856 00002000:00100000:0.0:1788201686.425472:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (132120576->133169151) req@ffff962393aa1c00 x1875064559753856/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/0 e 0 to 0 dl 1788201697 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201686.425518:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1c00 with x1875064559753856 ext(132120576->133169151) 00002000:00010000:0.0:1788201686.425526:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1c00 00000100:00100000:0.0:1788201686.425574:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1197 00000100:00100000:0.0:1788201686.425597:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+70:2342:x1875064559753856:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201686.449912:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+72:2342:x1875064559753856:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24302us (25371us total) trans 30064772198 rc 0/0 00000100:00100000:0.0:1788201686.449930:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1197 00002000:00100000:0.0:1788201686.449947:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (132120576->133169151) req@ffff962393aa1c00 x1875064559753856/t30064772198(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/448 e 0 to 0 dl 1788201697 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201686.449961:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa1c00 with x1875064559753856 ext(132120576->133169151) 00002000:00010000:0.0:1788201686.449969:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa1c00 00000100:00100000:3.0:1788201686.600847:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201686.600892:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559753984 00000100:00100000:3.0:1788201686.600901:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559753984 00002000:00100000:3.0:1788201686.601119:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (133169152->134217727) req@ffff962393aa2d80 x1875064559753984/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/0 e 0 to 0 dl 1788201697 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201686.601132:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2d80 with x1875064559753984 ext(133169152->134217727) 00002000:00010000:3.0:1788201686.601138:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2d80 00000100:00100000:3.0:1788201686.601173:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1198 00000100:00100000:3.0:1788201686.601183:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962393aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+72:2344:x1875064559753984:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201686.642840:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962393aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+74:2344:x1875064559753984:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 41641us (41984us total) trans 30064772199 rc 0/0 00000100:00100000:3.0:1788201686.642860:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1198 00002000:00100000:3.0:1788201686.642878:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (133169152->134217727) req@ffff962393aa2d80 x1875064559753984/t30064772199(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/448 e 0 to 0 dl 1788201697 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201686.642906:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962393aa2d80 with x1875064559753984 ext(133169152->134217727) 00002000:00010000:3.0:1788201686.642914:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962393aa2d80 00000100:00100000:1.0:1788201686.774338:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201686.774615:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559754112 00000100:00100000:0.0:1788201686.774628:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559754112 00002000:00100000:0.0:1788201686.774694:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (134217728->135266303) req@ffff962485aae680 x1875064559754112/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/0 e 0 to 0 dl 1788201697 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201686.774703:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aae680 with x1875064559754112 ext(134217728->135266303) 00002000:00010000:0.0:1788201686.774709:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aae680 00000100:00100000:0.0:1788201686.774738:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1199 00000100:00100000:0.0:1788201686.774747:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+74:2343:x1875064559754112:12345-192.168.201.56@tcp:4:iozone.0 00000001:00080000:2.0:1788201686.794119:0:19762:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 30064772198 is committed 00000100:00100000:1.0:1788201686.794987:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2343:x1875064559754112:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 20230us (20651us total) trans 30064772200 rc 0/0 00000100:00100000:1.0:1788201686.795002:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1199 00002000:00100000:1.0:1788201686.795019:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (134217728->135266303) req@ffff962485aae680 x1875064559754112/t30064772200(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/448 e 0 to 0 dl 1788201697 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201686.795031:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aae680 with x1875064559754112 ext(134217728->135266303) 00002000:00010000:1.0:1788201686.795038:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aae680 00000100:00100000:1.0:1788201686.836420:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201686.836473:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201686.836767:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559754240 00000100:00100000:0.0:1788201686.836779:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559754240 00000100:00100000:0.0:1788201686.836843:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 588 00000100:00100000:0.0:1788201686.836854:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559754240:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1788201686.837037:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:961d4966-9b2e-4bca-bd35-8d9493e230e8+10:2344:x1875064559754240:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 185us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201686.837043:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 588 00010000:00010000:0.0:1788201686.838635:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201686.839996:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559754368 00000100:00100000:2.0:1788201686.840009:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559754368 00000100:00100000:2.0:1788201686.840106:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 491 00000100:00100000:2.0:1788201686.840118:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559754368:12345-192.168.201.56@tcp:400:kworker.0 00000100:00080000:0.0:1788201686.840288:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201686.840963:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2344:x1875064559754368:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 844us (4484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201686.840971:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 491 00000100:00100000:1.0:1788201686.844318:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201686.844459:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559754496 00000100:00100000:3.0:1788201686.844468:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559754496 00002000:00100000:3.0:1788201686.844522:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (135266304->136314879) req@ffff962485aad880 x1875064559754496/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/0 e 0 to 0 dl 1788201697 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201686.844531:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aad880 with x1875064559754496 ext(135266304->136314879) 00002000:00010000:3.0:1788201686.844536:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aad880 00000100:00100000:3.0:1788201686.844568:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1200 00000100:00100000:3.0:1788201686.844576:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+10:2341:x1875064559754496:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201686.863168:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2341:x1875064559754496:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 18573us (18843us total) trans 30064772201 rc 0/0 00000100:00100000:0.0:1788201686.863187:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1200 00002000:00100000:0.0:1788201686.863206:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (135266304->136314879) req@ffff962485aad880 x1875064559754496/t30064772201(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/448 e 0 to 0 dl 1788201697 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201686.863218:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aad880 with x1875064559754496 ext(135266304->136314879) 00002000:00010000:0.0:1788201686.863226:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aad880 00000100:00100000:3.0:1788201686.960909:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201686.961095:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559754624 00000100:00100000:2.0:1788201686.961108:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559754624 00002000:00100000:2.0:1788201686.961181:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (136314880->137363455) req@ffff9623bb561c00 x1875064559754624/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/0 e 0 to 0 dl 1788201697 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201686.961212:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561c00 with x1875064559754624 ext(136314880->137363455) 00002000:00010000:2.0:1788201686.961220:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561c00 00000100:00100000:2.0:1788201686.961264:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1201 00000100:00100000:2.0:1788201686.961276:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+12:2343:x1875064559754624:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201686.975162:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2343:x1875064559754624:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13868us (14250us total) trans 30064772202 rc 0/0 00000100:00100000:0.0:1788201686.975179:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1201 00002000:00100000:0.0:1788201686.975194:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (136314880->137363455) req@ffff9623bb561c00 x1875064559754624/t30064772202(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:52/0 lens 488/448 e 0 to 0 dl 1788201697 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201686.975207:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561c00 with x1875064559754624 ext(136314880->137363455) 00002000:00010000:0.0:1788201686.975214:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561c00 00000100:00100000:2.0:1788201687.095329:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201687.095843:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559754752 00000100:00100000:0.0:1788201687.095856:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559754752 00002000:00100000:0.0:1788201687.095952:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (137363456->138412031) req@ffff9624c1cc4a80 x1875064559754752/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/0 e 0 to 0 dl 1788201698 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201687.095966:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4a80 with x1875064559754752 ext(137363456->138412031) 00002000:00010000:0.0:1788201687.095994:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4a80 00000100:00100000:0.0:1788201687.096044:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1202 00000100:00100000:0.0:1788201687.096059:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+14:2342:x1875064559754752:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201687.096408:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201687.118545:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2342:x1875064559754752:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22473us (23214us total) trans 30064772203 rc 0/0 00000100:00100000:0.0:1788201687.118561:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1202 00002000:00100000:0.0:1788201687.118578:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (137363456->138412031) req@ffff9624c1cc4a80 x1875064559754752/t30064772203(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/448 e 0 to 0 dl 1788201698 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201687.118591:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4a80 with x1875064559754752 ext(137363456->138412031) 00002000:00010000:0.0:1788201687.118598:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4a80 00000100:00100000:1.0:1788201687.246077:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201687.246251:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559754880 00000100:00100000:0.0:1788201687.246265:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559754880 00002000:00100000:0.0:1788201687.246335:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (138412032->139460607) req@ffff962485aaf100 x1875064559754880/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/0 e 0 to 0 dl 1788201698 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201687.246385:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaf100 with x1875064559754880 ext(138412032->139460607) 00002000:00010000:0.0:1788201687.246393:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaf100 00000100:00100000:0.0:1788201687.246435:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1203 00000100:00100000:0.0:1788201687.246448:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+16:2341:x1875064559754880:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201687.267494:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2341:x1875064559754880:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21033us (21430us total) trans 30064772204 rc 0/0 00000100:00100000:0.0:1788201687.267510:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1203 00002000:00100000:0.0:1788201687.267526:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (138412032->139460607) req@ffff962485aaf100 x1875064559754880/t30064772204(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/448 e 0 to 0 dl 1788201698 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201687.267559:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aaf100 with x1875064559754880 ext(138412032->139460607) 00002000:00010000:0.0:1788201687.267568:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aaf100 00000100:00100000:1.0:1788201687.378548:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201687.378699:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559755008 00000100:00100000:3.0:1788201687.378711:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559755008 00002000:00100000:3.0:1788201687.378780:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (139460608->140509183) req@ffff962485aac000 x1875064559755008/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/0 e 0 to 0 dl 1788201698 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201687.378793:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aac000 with x1875064559755008 ext(139460608->140509183) 00002000:00010000:3.0:1788201687.378800:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aac000 00000100:00100000:3.0:1788201687.378844:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1204 00000100:00100000:3.0:1788201687.378857:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+18:2342:x1875064559755008:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201687.408589:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2342:x1875064559755008:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 29719us (30041us total) trans 30064772205 rc 0/0 00000100:00100000:3.0:1788201687.408607:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1204 00002000:00100000:3.0:1788201687.408624:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (139460608->140509183) req@ffff962485aac000 x1875064559755008/t30064772205(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/448 e 0 to 0 dl 1788201698 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201687.408651:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962485aac000 with x1875064559755008 ext(139460608->140509183) 00002000:00010000:3.0:1788201687.408660:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962485aac000 00000100:00100000:1.0:1788201687.540322:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201687.541148:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559755136 00000100:00100000:2.0:1788201687.541164:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559755136 00002000:00100000:2.0:1788201687.541237:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (140509184->141557759) req@ffff96248cd57100 x1875064559755136/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/0 e 0 to 0 dl 1788201698 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201687.541250:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd57100 with x1875064559755136 ext(140509184->141557759) 00002000:00010000:2.0:1788201687.541257:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd57100 00000100:00100000:2.0:1788201687.541305:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1205 00000100:00100000:2.0:1788201687.541317:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+20:2343:x1875064559755136:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201687.566279:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2343:x1875064559755136:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24949us (25956us total) trans 30064772206 rc 0/0 00000100:00100000:0.0:1788201687.566296:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1205 00002000:00100000:0.0:1788201687.566312:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (140509184->141557759) req@ffff96248cd57100 x1875064559755136/t30064772206(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/448 e 0 to 0 dl 1788201698 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201687.566324:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96248cd57100 with x1875064559755136 ext(140509184->141557759) 00002000:00010000:0.0:1788201687.566332:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96248cd57100 00000100:00100000:3.0:1788201687.607175:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570168832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201687.607300:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201687.607540:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570168832 00000100:00100000:1.0:1788201687.607552:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570168832 00000100:00100000:1.0:1788201687.607694:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788201687.607727:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570168832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201687.607775:0:6673:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201687.607832:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570168832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201687.607840:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:3.0:1788201687.608032:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96248cd54700 x1875064570168832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201687.608053:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96248cd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570168832:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201687.615689:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201687.694584:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201687.694705:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559755264 00000100:00100000:0.0:1788201687.694717:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559755264 00002000:00100000:0.0:1788201687.694789:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (141557760->142606335) req@ffff9624c1cc5500 x1875064559755264/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/0 e 0 to 0 dl 1788201698 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201687.694802:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5500 with x1875064559755264 ext(141557760->142606335) 00002000:00010000:0.0:1788201687.694809:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5500 00000100:00100000:0.0:1788201687.694842:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1206 00000100:00100000:0.0:1788201687.694855:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+22:2344:x1875064559755264:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201687.706484:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2344:x1875064559755264:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11616us (11911us total) trans 30064772207 rc 0/0 00000100:00100000:0.0:1788201687.706506:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1206 00002000:00100000:0.0:1788201687.706524:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (141557760->142606335) req@ffff9624c1cc5500 x1875064559755264/t30064772207(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/448 e 0 to 0 dl 1788201698 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201687.706558:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5500 with x1875064559755264 ext(141557760->142606335) 00002000:00010000:0.0:1788201687.706565:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5500 00000100:00100000:3.0:1788201687.852308:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201687.852612:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559755392 00000100:00100000:0.0:1788201687.852625:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559755392 00002000:00100000:0.0:1788201687.852698:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (142606336->143654911) req@ffff9623bb560a80 x1875064559755392/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/0 e 0 to 0 dl 1788201698 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201687.852711:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560a80 with x1875064559755392 ext(142606336->143654911) 00002000:00010000:0.0:1788201687.852718:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560a80 00000100:00100000:0.0:1788201687.852762:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1207 00000100:00100000:0.0:1788201687.852773:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+24:2343:x1875064559755392:12345-192.168.201.56@tcp:4:iozone.0 00010000:00010000:1.0:1788201687.864034:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201687.884690:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2343:x1875064559755392:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 31901us (32380us total) trans 30064772208 rc 0/0 00000100:00100000:0.0:1788201687.884709:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1207 00002000:00100000:0.0:1788201687.884726:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (142606336->143654911) req@ffff9623bb560a80 x1875064559755392/t30064772208(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/448 e 0 to 0 dl 1788201698 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201687.884740:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560a80 with x1875064559755392 ext(142606336->143654911) 00002000:00010000:0.0:1788201687.884749:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560a80 00000100:00100000:2.0:1788201687.998089:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201687.998471:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559755520 00000100:00100000:3.0:1788201687.998485:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559755520 00002000:00100000:3.0:1788201687.998555:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (143654912->144703487) req@ffff9624c1cc4700 x1875064559755520/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/0 e 0 to 0 dl 1788201698 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201687.998567:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4700 with x1875064559755520 ext(143654912->144703487) 00002000:00010000:3.0:1788201687.998574:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4700 00000100:00100000:3.0:1788201687.998617:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1208 00000100:00100000:3.0:1788201687.998628:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+26:2344:x1875064559755520:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201688.018043:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2344:x1875064559755520:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 19399us (19962us total) trans 30064772209 rc 0/0 00000100:00100000:3.0:1788201688.019785:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1208 00002000:00100000:3.0:1788201688.019807:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (143654912->144703487) req@ffff9624c1cc4700 x1875064559755520/t30064772209(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:53/0 lens 488/448 e 0 to 0 dl 1788201698 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201688.019820:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4700 with x1875064559755520 ext(143654912->144703487) 00002000:00010000:3.0:1788201688.019847:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4700 00000100:00100000:3.0:1788201688.119939:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570169344:0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.120039:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201688.120137:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788201688.120143:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570168960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.120177:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201688.120202:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570169472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.120226:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201688.120262:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570168960 00000100:00100000:3.0:1788201688.120270:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570168960 00000100:00100000:3.0:1788201688.120323:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:3.0:1788201688.120333:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570168960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.120415:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962485084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64683b94-32c1-4e22-b29e-6bf9fd5f0adf+19:3284:x1875064570168960:12345-0@lo:400:kworker.0 Request processed in 83us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201688.120424:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:3.0:1788201688.120483:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64683b94-32c1-4e22-b29e-6bf9fd5f0adf:3284:1875064570168960:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.120770:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570169216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.120805:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.120837:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201688.120842:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570169088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.120882:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.120909:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570169600:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.120929:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.120959:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570169344 00000100:00100000:1.0:1788201688.120963:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570169344 00000100:00100000:1.0:1788201688.121004:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570169088 00000100:00100000:1.0:1788201688.121007:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570169088 00000100:00100000:1.0:1788201688.121019:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570169600 00000100:00100000:1.0:1788201688.121022:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570169600 00000100:00100000:1.0:1788201688.121039:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1788201688.121046:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570169344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.121108:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875064570169344:12345-0@lo:400:kworker.0 Request processed in 62us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201688.121115:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1788201688.121130:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1788201688.121137:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570169088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.121167:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875064570169088:12345-0@lo:400:kworker.0 Request processed in 31us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201688.121192:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1788201688.121204:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1788201688.121210:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570169600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.121238:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875064570169600:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201688.121245:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1788201688.121264:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570169472 00000100:00100000:1.0:1788201688.121268:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570169472 00000100:00100000:1.0:1788201688.121293:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788201688.121299:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570169472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.121329:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875064570169472:12345-0@lo:400:kworker.0 Request processed in 31us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201688.121335:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788201688.121369:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570169216 00000100:00100000:1.0:1788201688.121373:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570169216 00000100:00100000:1.0:1788201688.121400:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788201688.121406:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570169216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.121434:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96248cd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570169216:12345-0@lo:400:kworker.0 Request processed in 28us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201688.121441:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788201688.121490:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875064570169088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.121500:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875064570169600:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.121509:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570169216:0@lo:400:kworker.0 00010000:00080000:1.0:1788201688.121544:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9623bb561500 x1875064570169472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201688.121716:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201688.121723:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201688.121785:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875064570169472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.121802:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875064570169344:0@lo:400:kworker.0 00000100:00100000:2.0:1788201688.158968:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201688.159162:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559755648 00000100:00100000:0.0:1788201688.159174:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559755648 00002000:00100000:0.0:1788201688.159242:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (144703488->145752063) req@ffff9624c1cc5880 x1875064559755648/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/0 e 0 to 0 dl 1788201699 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201688.159282:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5880 with x1875064559755648 ext(144703488->145752063) 00002000:00010000:0.0:1788201688.159289:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5880 00000100:00100000:0.0:1788201688.159333:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1209 00000100:00100000:0.0:1788201688.159384:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+28:2343:x1875064559755648:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201688.189421:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2343:x1875064559755648:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 30061us (30450us total) trans 30064772210 rc 0/0 00000100:00100000:0.0:1788201688.189440:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1209 00002000:00100000:0.0:1788201688.189458:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (144703488->145752063) req@ffff9624c1cc5880 x1875064559755648/t30064772210(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/448 e 0 to 0 dl 1788201699 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201688.189471:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5880 with x1875064559755648 ext(144703488->145752063) 00002000:00010000:0.0:1788201688.189478:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5880 00000100:00100000:2.0:1788201688.354850:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201688.355047:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559755776 00000100:00100000:0.0:1788201688.355072:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559755776 00002000:00100000:0.0:1788201688.355145:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (145752064->146800639) req@ffff9624c1cc4380 x1875064559755776/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/0 e 0 to 0 dl 1788201699 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201688.355157:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4380 with x1875064559755776 ext(145752064->146800639) 00002000:00010000:0.0:1788201688.355163:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4380 00000100:00100000:0.0:1788201688.355207:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1210 00000100:00100000:0.0:1788201688.355219:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+30:2344:x1875064559755776:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201688.389146:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2344:x1875064559755776:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 33914us (34296us total) trans 30064772211 rc 0/0 00000100:00100000:0.0:1788201688.389164:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1210 00002000:00100000:0.0:1788201688.389197:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (145752064->146800639) req@ffff9624c1cc4380 x1875064559755776/t30064772211(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/448 e 0 to 0 dl 1788201699 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201688.389210:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4380 with x1875064559755776 ext(145752064->146800639) 00002000:00010000:0.0:1788201688.389217:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4380 00000100:00100000:3.0:1788201688.495782:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201688.496131:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559755904 00000100:00100000:1.0:1788201688.496144:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559755904 00002000:00100000:1.0:1788201688.496209:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (146800640->147849215) req@ffff9623bb563b80 x1875064559755904/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/0 e 0 to 0 dl 1788201699 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201688.496223:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb563b80 with x1875064559755904 ext(146800640->147849215) 00002000:00010000:1.0:1788201688.496229:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb563b80 00000100:00100000:1.0:1788201688.496280:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1211 00000100:00100000:1.0:1788201688.496292:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+32:2343:x1875064559755904:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201688.528310:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559755904:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 32004us (32528us total) trans 30064772212 rc 0/0 00000100:00100000:1.0:1788201688.528326:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1211 00002000:00100000:1.0:1788201688.528365:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (146800640->147849215) req@ffff9623bb563b80 x1875064559755904/t30064772212(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/448 e 0 to 0 dl 1788201699 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201688.528378:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb563b80 with x1875064559755904 ext(146800640->147849215) 00002000:00010000:1.0:1788201688.528385:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb563b80 00000100:00100000:3.0:1788201688.623543:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201688.623678:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559756032 00000100:00100000:0.0:1788201688.623689:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559756032 00002000:00100000:0.0:1788201688.623746:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (147849216->148897791) req@ffff9623bb563800 x1875064559756032/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/0 e 0 to 0 dl 1788201699 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201688.623756:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb563800 with x1875064559756032 ext(147849216->148897791) 00002000:00010000:0.0:1788201688.623762:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb563800 00000100:00100000:0.0:1788201688.623794:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1212 00000100:00100000:0.0:1788201688.623802:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+34:2343:x1875064559756032:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201688.648713:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559756032:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 24894us (25168us total) trans 30064772213 rc 0/0 00000100:00100000:0.0:1788201688.648732:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1212 00002000:00100000:0.0:1788201688.648750:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (147849216->148897791) req@ffff9623bb563800 x1875064559756032/t30064772213(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/448 e 0 to 0 dl 1788201699 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201688.648762:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb563800 with x1875064559756032 ext(147849216->148897791) 00002000:00010000:0.0:1788201688.648769:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb563800 00000100:00100000:3.0:1788201688.729513:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201688.729675:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559756160 00000100:00100000:0.0:1788201688.729687:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559756160 00002000:00100000:0.0:1788201688.729754:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (148897792->149946367) req@ffff9623bb562d80 x1875064559756160/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/0 e 0 to 0 dl 1788201699 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201688.729766:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb562d80 with x1875064559756160 ext(148897792->149946367) 00002000:00010000:0.0:1788201688.729791:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb562d80 00000100:00100000:0.0:1788201688.729897:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1213 00000100:00100000:0.0:1788201688.729909:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+36:2343:x1875064559756160:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201688.741219:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2343:x1875064559756160:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11296us (11705us total) trans 30064772214 rc 0/0 00000100:00100000:0.0:1788201688.741237:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1213 00002000:00100000:0.0:1788201688.741253:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (148897792->149946367) req@ffff9623bb562d80 x1875064559756160/t30064772214(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/448 e 0 to 0 dl 1788201699 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201688.741266:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb562d80 with x1875064559756160 ext(148897792->149946367) 00002000:00010000:0.0:1788201688.741273:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb562d80 00000100:00100000:2.0:1788201688.859914:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201688.860028:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559756288 00000100:00100000:3.0:1788201688.860042:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559756288 00002000:00100000:3.0:1788201688.860123:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (149946368->150994943) req@ffff9624c1cc6300 x1875064559756288/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/0 e 0 to 0 dl 1788201699 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201688.860135:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6300 with x1875064559756288 ext(149946368->150994943) 00002000:00010000:3.0:1788201688.860141:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6300 00000100:00100000:3.0:1788201688.860198:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1214 00000100:00100000:3.0:1788201688.860209:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+38:2344:x1875064559756288:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201688.877174:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2344:x1875064559756288:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16950us (17257us total) trans 30064772215 rc 0/0 00000100:00100000:0.0:1788201688.877192:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1214 00002000:00100000:0.0:1788201688.877208:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (149946368->150994943) req@ffff9624c1cc6300 x1875064559756288/t30064772215(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/448 e 0 to 0 dl 1788201699 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201688.877220:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6300 with x1875064559756288 ext(149946368->150994943) 00002000:00010000:0.0:1788201688.877229:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6300 00010000:00010000:2.0:1788201688.886798:0:5814:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201688.951998:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201688.952321:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559756416 00000100:00100000:1.0:1788201688.952332:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559756416 00002000:00100000:1.0:1788201688.952428:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (150994944->152043519) req@ffff9624c1cc7b80 x1875064559756416/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/0 e 0 to 0 dl 1788201699 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201688.952437:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc7b80 with x1875064559756416 ext(150994944->152043519) 00002000:00010000:1.0:1788201688.952459:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc7b80 00000100:00100000:1.0:1788201688.952493:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1215 00000100:00100000:1.0:1788201688.952502:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+40:2341:x1875064559756416:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201688.966023:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2341:x1875064559756416:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13505us (14021us total) trans 30064772216 rc 0/0 00000100:00100000:1.0:1788201688.966040:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1215 00002000:00100000:1.0:1788201688.967161:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (150994944->152043519) req@ffff9624c1cc7b80 x1875064559756416/t30064772216(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:54/0 lens 488/448 e 0 to 0 dl 1788201699 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201688.967178:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc7b80 with x1875064559756416 ext(150994944->152043519) 00002000:00010000:1.0:1788201688.967186:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc7b80 00000100:00100000:3.0:1788201689.050747:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201689.050924:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559756544 00000100:00100000:0.0:1788201689.050936:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559756544 00002000:00100000:0.0:1788201689.051026:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (152043520->153092095) req@ffff9623bb560000 x1875064559756544/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/0 e 0 to 0 dl 1788201700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201689.051039:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560000 with x1875064559756544 ext(152043520->153092095) 00002000:00010000:0.0:1788201689.051046:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560000 00000100:00100000:0.0:1788201689.051094:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1216 00000100:00100000:0.0:1788201689.051126:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+42:2343:x1875064559756544:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201689.051441:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201689.072269:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2343:x1875064559756544:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 21131us (21521us total) trans 30064772217 rc 0/0 00000100:00100000:0.0:1788201689.072285:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1216 00002000:00100000:0.0:1788201689.072301:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (152043520->153092095) req@ffff9623bb560000 x1875064559756544/t30064772217(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/448 e 0 to 0 dl 1788201700 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201689.072312:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560000 with x1875064559756544 ext(152043520->153092095) 00002000:00010000:0.0:1788201689.072320:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560000 00000100:00100000:3.0:1788201689.169239:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201689.169423:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559756672 00000100:00100000:0.0:1788201689.169436:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559756672 00002000:00100000:0.0:1788201689.169499:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (153092096->154140671) req@ffff9623bb560380 x1875064559756672/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/0 e 0 to 0 dl 1788201700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201689.169511:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560380 with x1875064559756672 ext(153092096->154140671) 00002000:00010000:0.0:1788201689.169518:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560380 00000100:00100000:0.0:1788201689.169624:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1217 00000100:00100000:0.0:1788201689.169636:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb560380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+44:2344:x1875064559756672:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201689.184265:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb560380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2344:x1875064559756672:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14614us (15024us total) trans 30064772218 rc 0/0 00000100:00100000:0.0:1788201689.185426:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1217 00002000:00100000:0.0:1788201689.185595:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (153092096->154140671) req@ffff9623bb560380 x1875064559756672/t30064772218(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/448 e 0 to 0 dl 1788201700 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201689.185609:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560380 with x1875064559756672 ext(153092096->154140671) 00002000:00010000:0.0:1788201689.185617:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560380 00000100:00100000:3.0:1788201689.268299:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201689.268515:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559756800 00000100:00100000:0.0:1788201689.268528:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559756800 00002000:00100000:0.0:1788201689.268596:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (154140672->155189247) req@ffff9623bb562300 x1875064559756800/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/0 e 0 to 0 dl 1788201700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201689.268609:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb562300 with x1875064559756800 ext(154140672->155189247) 00002000:00010000:0.0:1788201689.268616:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb562300 00000100:00100000:0.0:1788201689.268657:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1218 00000100:00100000:0.0:1788201689.268669:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+46:2342:x1875064559756800:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201689.292206:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2342:x1875064559756800:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23518us (23911us total) trans 30064772219 rc 0/0 00000100:00100000:0.0:1788201689.292226:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1218 00002000:00100000:0.0:1788201689.292247:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (154140672->155189247) req@ffff9623bb562300 x1875064559756800/t30064772219(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/448 e 0 to 0 dl 1788201700 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201689.292260:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb562300 with x1875064559756800 ext(154140672->155189247) 00002000:00010000:0.0:1788201689.292268:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb562300 00000100:00100000:2.0:1788201689.370434:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201689.372559:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559756928 00000100:00100000:1.0:1788201689.372576:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559756928 00002000:00100000:1.0:1788201689.372657:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (155189248->156237823) req@ffff9624c1cc5c00 x1875064559756928/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/0 e 0 to 0 dl 1788201700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201689.372671:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5c00 with x1875064559756928 ext(155189248->156237823) 00002000:00010000:1.0:1788201689.372678:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5c00 00000100:00100000:1.0:1788201689.372715:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1219 00000100:00100000:1.0:1788201689.372732:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+48:2343:x1875064559756928:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201689.396724:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2343:x1875064559756928:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 23978us (26289us total) trans 30064772220 rc 0/0 00000100:00100000:1.0:1788201689.396741:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1219 00002000:00100000:1.0:1788201689.396757:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (155189248->156237823) req@ffff9624c1cc5c00 x1875064559756928/t30064772220(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/448 e 0 to 0 dl 1788201700 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201689.396794:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5c00 with x1875064559756928 ext(155189248->156237823) 00002000:00010000:1.0:1788201689.396801:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5c00 00000100:00100000:2.0:1788201689.473314:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201689.474959:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559757056 00000100:00100000:3.0:1788201689.474975:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559757056 00002000:00100000:3.0:1788201689.475059:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (156237824->157286399) req@ffff9624c1cc4e00 x1875064559757056/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/0 e 0 to 0 dl 1788201700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201689.475071:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4e00 with x1875064559757056 ext(156237824->157286399) 00002000:00010000:3.0:1788201689.475078:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4e00 00000100:00100000:3.0:1788201689.475171:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1220 00000100:00100000:3.0:1788201689.475184:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+50:2342:x1875064559757056:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201689.497249:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2342:x1875064559757056:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 22052us (23933us total) trans 30064772221 rc 0/0 00000100:00100000:2.0:1788201689.497266:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1220 00002000:00100000:2.0:1788201689.497282:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (156237824->157286399) req@ffff9624c1cc4e00 x1875064559757056/t30064772221(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/448 e 0 to 0 dl 1788201700 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201689.497294:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc4e00 with x1875064559757056 ext(156237824->157286399) 00002000:00010000:2.0:1788201689.497301:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc4e00 00000100:00100000:0.0:1788201689.561519:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201689.561798:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559757184 00000100:00100000:2.0:1788201689.561810:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559757184 00002000:00100000:2.0:1788201689.561940:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (157286400->158334975) req@ffff962382b14000 x1875064559757184/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/0 e 0 to 0 dl 1788201700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201689.561952:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14000 with x1875064559757184 ext(157286400->158334975) 00002000:00010000:2.0:1788201689.561959:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14000 00000100:00100000:2.0:1788201689.562000:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1221 00000100:00100000:2.0:1788201689.562011:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+52:2344:x1875064559757184:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201689.575930:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2344:x1875064559757184:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 13904us (14409us total) trans 30064772222 rc 0/0 00000100:00100000:2.0:1788201689.575947:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1221 00002000:00100000:2.0:1788201689.575963:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (157286400->158334975) req@ffff962382b14000 x1875064559757184/t30064772222(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/448 e 0 to 0 dl 1788201700 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201689.575975:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14000 with x1875064559757184 ext(157286400->158334975) 00002000:00010000:2.0:1788201689.575982:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14000 00000100:00100000:3.0:1788201689.651540:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201689.651678:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559757312 00000100:00100000:0.0:1788201689.651691:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559757312 00002000:00100000:0.0:1788201689.651760:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (158334976->159383551) req@ffff9623bb560700 x1875064559757312/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/0 e 0 to 0 dl 1788201700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201689.651773:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560700 with x1875064559757312 ext(158334976->159383551) 00002000:00010000:0.0:1788201689.651780:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560700 00000100:00100000:0.0:1788201689.651824:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1222 00000100:00100000:0.0:1788201689.651844:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb560700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+54:2341:x1875064559757312:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201689.661722:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb560700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2341:x1875064559757312:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9872us (10192us total) trans 30064772223 rc 0/0 00000100:00100000:0.0:1788201689.661739:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1222 00002000:00100000:0.0:1788201689.661756:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (158334976->159383551) req@ffff9623bb560700 x1875064559757312/t30064772223(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/448 e 0 to 0 dl 1788201700 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201689.661768:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb560700 with x1875064559757312 ext(158334976->159383551) 00002000:00010000:0.0:1788201689.661775:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb560700 00000100:00100000:3.0:1788201689.726987:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201689.730220:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559757440 00000100:00100000:1.0:1788201689.730240:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559757440 00002000:00100000:1.0:1788201689.730307:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (159383552->160432127) req@ffff9623bb561500 x1875064559757440/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/0 e 0 to 0 dl 1788201700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201689.730316:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561500 with x1875064559757440 ext(159383552->160432127) 00002000:00010000:1.0:1788201689.730322:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561500 00000100:00100000:1.0:1788201689.730383:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1223 00000100:00100000:1.0:1788201689.730395:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+56:2343:x1875064559757440:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201689.740844:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2343:x1875064559757440:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10438us (13857us total) trans 30064772224 rc 0/0 00000100:00100000:0.0:1788201689.740856:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1223 00002000:00100000:0.0:1788201689.740868:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (159383552->160432127) req@ffff9623bb561500 x1875064559757440/t30064772224(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/448 e 0 to 0 dl 1788201700 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201689.740877:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561500 with x1875064559757440 ext(159383552->160432127) 00002000:00010000:0.0:1788201689.740883:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561500 00000100:00100000:2.0:1788201689.818778:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201689.818894:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559757568 00000100:00100000:0.0:1788201689.818907:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559757568 00002000:00100000:0.0:1788201689.818973:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (160432128->161480703) req@ffff9624c1cc6d80 x1875064559757568/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/0 e 0 to 0 dl 1788201700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201689.818987:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6d80 with x1875064559757568 ext(160432128->161480703) 00002000:00010000:0.0:1788201689.818995:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6d80 00000100:00100000:0.0:1788201689.819046:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1224 00000100:00100000:0.0:1788201689.819060:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+58:2341:x1875064559757568:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201689.830638:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2341:x1875064559757568:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 11567us (11863us total) trans 30064772225 rc 0/0 00000100:00100000:0.0:1788201689.830664:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1224 00002000:00100000:0.0:1788201689.830686:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (160432128->161480703) req@ffff9624c1cc6d80 x1875064559757568/t30064772225(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/448 e 0 to 0 dl 1788201700 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201689.830704:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6d80 with x1875064559757568 ext(160432128->161480703) 00002000:00010000:0.0:1788201689.830712:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6d80 00000100:00100000:2.0:1788201689.873190:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201689.873378:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559757696 00000100:00100000:0.0:1788201689.873391:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559757696 00002000:00100000:0.0:1788201689.873455:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (161480704->162529279) req@ffff9624c1cc6a00 x1875064559757696/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/0 e 0 to 0 dl 1788201700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201689.873469:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6a00 with x1875064559757696 ext(161480704->162529279) 00002000:00010000:0.0:1788201689.873476:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6a00 00000100:00100000:0.0:1788201689.873520:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1225 00000100:00100000:0.0:1788201689.873532:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+60:2342:x1875064559757696:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201689.882030:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2342:x1875064559757696:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8488us (8841us total) trans 30064772226 rc 0/0 00000100:00100000:0.0:1788201689.882054:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1225 00002000:00100000:0.0:1788201689.882069:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (161480704->162529279) req@ffff9624c1cc6a00 x1875064559757696/t30064772226(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/448 e 0 to 0 dl 1788201700 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201689.882080:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc6a00 with x1875064559757696 ext(161480704->162529279) 00002000:00010000:0.0:1788201689.882086:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc6a00 00010000:00010000:0.0:1788201689.910617:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201689.969563:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201689.969699:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559757824 00000100:00100000:3.0:1788201689.969709:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559757824 00002000:00100000:3.0:1788201689.969767:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (162529280->163577855) req@ffff9624c1cc5180 x1875064559757824/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/0 e 0 to 0 dl 1788201700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201689.969778:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5180 with x1875064559757824 ext(162529280->163577855) 00002000:00010000:3.0:1788201689.969784:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5180 00000100:00100000:3.0:1788201689.969851:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1226 00000100:00100000:3.0:1788201689.969861:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+62:2344:x1875064559757824:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201689.979046:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2344:x1875064559757824:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9166us (9473us total) trans 30064772227 rc 0/0 00000100:00100000:3.0:1788201689.979751:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1226 00002000:00100000:3.0:1788201689.979765:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (162529280->163577855) req@ffff9624c1cc5180 x1875064559757824/t30064772227(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:55/0 lens 488/448 e 0 to 0 dl 1788201700 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201689.979777:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1cc5180 with x1875064559757824 ext(162529280->163577855) 00002000:00010000:3.0:1788201689.979785:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1cc5180 00000100:00100000:1.0:1788201690.043752:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201690.043857:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559757952 00000100:00100000:2.0:1788201690.043867:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559757952 00002000:00100000:2.0:1788201690.043918:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (163577856->164626431) req@ffff9623bb432680 x1875064559757952/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201690.043930:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb432680 with x1875064559757952 ext(163577856->164626431) 00002000:00010000:2.0:1788201690.043936:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb432680 00000100:00100000:2.0:1788201690.043983:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1227 00000100:00100000:2.0:1788201690.043994:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+64:2341:x1875064559757952:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201690.058107:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2341:x1875064559757952:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 14104us (14354us total) trans 30064772228 rc 0/0 00000100:00100000:0.0:1788201690.058136:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1227 00002000:00100000:0.0:1788201690.058149:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (163577856->164626431) req@ffff9623bb432680 x1875064559757952/t30064772228(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.058753:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb432680 with x1875064559757952 ext(163577856->164626431) 00002000:00010000:0.0:1788201690.058760:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb432680 00000100:00100000:3.0:1788201690.125747:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201690.129744:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559758080 00000100:00100000:0.0:1788201690.129761:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559758080 00002000:00100000:0.0:1788201690.129819:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (164626432->165675007) req@ffff9623bb561180 x1875064559758080/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.129831:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561180 with x1875064559758080 ext(164626432->165675007) 00002000:00010000:0.0:1788201690.129837:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561180 00000100:00100000:0.0:1788201690.129937:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1228 00000100:00100000:0.0:1788201690.129948:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+66:2342:x1875064559758080:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201690.139413:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2342:x1875064559758080:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9456us (13666us total) trans 30064772229 rc 0/0 00000100:00100000:0.0:1788201690.139428:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1228 00002000:00100000:0.0:1788201690.139439:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (164626432->165675007) req@ffff9623bb561180 x1875064559758080/t30064772229(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.139450:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561180 with x1875064559758080 ext(164626432->165675007) 00002000:00010000:0.0:1788201690.139456:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561180 00000100:00100000:2.0:1788201690.166737:0:3283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9623bb432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570169728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201690.166814:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201690.166955:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064570169728 00000100:00100000:0.0:1788201690.166962:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064570169728 00000100:00100000:0.0:1788201690.167072:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788201690.167102:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570169728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201690.167131:0:6672:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 1703936 granted 580714496 pending 52822016 free 2786066432 avail 2783969280 00000100:00100000:0.0:1788201690.167195:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875064570169728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201690.167202:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788201690.167294:0:3283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9623bb432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875064570169728:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201690.167542:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201690.198313:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201690.198752:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559758208 00000100:00100000:0.0:1788201690.198764:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559758208 00002000:00100000:0.0:1788201690.198833:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (165675008->166723583) req@ffff9624c1e70380 x1875064559758208/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.198847:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70380 with x1875064559758208 ext(165675008->166723583) 00002000:00010000:0.0:1788201690.198853:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70380 00000100:00100000:0.0:1788201690.198931:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1229 00000100:00100000:0.0:1788201690.198943:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+68:2342:x1875064559758208:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201690.209741:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+70:2342:x1875064559758208:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10783us (11429us total) trans 30064772230 rc 0/0 00000100:00100000:0.0:1788201690.209759:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1229 00002000:00100000:0.0:1788201690.209774:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (165675008->166723583) req@ffff9624c1e70380 x1875064559758208/t30064772230(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.209788:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70380 with x1875064559758208 ext(165675008->166723583) 00002000:00010000:0.0:1788201690.209795:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70380 00000100:00100000:2.0:1788201690.271427:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201690.271861:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559758336 00000100:00100000:3.0:1788201690.271873:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559758336 00002000:00100000:3.0:1788201690.271936:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (166723584->167772159) req@ffff9624c1e72300 x1875064559758336/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201690.271949:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72300 with x1875064559758336 ext(166723584->167772159) 00002000:00010000:3.0:1788201690.271955:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72300 00000100:00100000:3.0:1788201690.271995:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1230 00000100:00100000:3.0:1788201690.272006:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+70:2342:x1875064559758336:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:3.0:1788201690.280494:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+72:2342:x1875064559758336:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8474us (9067us total) trans 30064772231 rc 0/0 00000100:00100000:3.0:1788201690.280510:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1230 00002000:00100000:3.0:1788201690.280526:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (166723584->167772159) req@ffff9624c1e72300 x1875064559758336/t30064772231(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201690.280539:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72300 with x1875064559758336 ext(166723584->167772159) 00002000:00010000:3.0:1788201690.280546:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72300 00000100:00100000:1.0:1788201690.330052:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201690.330212:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559758464 00000100:00100000:2.0:1788201690.330224:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559758464 00002000:00100000:2.0:1788201690.330292:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (167772160->168820735) req@ffff9623bb431c00 x1875064559758464/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201690.330305:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431c00 with x1875064559758464 ext(167772160->168820735) 00002000:00010000:2.0:1788201690.330311:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431c00 00000100:00100000:2.0:1788201690.330426:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1231 00000100:00100000:2.0:1788201690.330437:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+72:2341:x1875064559758464:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201690.338879:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+74:2341:x1875064559758464:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8427us (8835us total) trans 30064772232 rc 0/0 00000100:00100000:2.0:1788201690.338894:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1231 00002000:00100000:2.0:1788201690.338922:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (167772160->168820735) req@ffff9623bb431c00 x1875064559758464/t30064772232(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201690.338934:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431c00 with x1875064559758464 ext(167772160->168820735) 00002000:00010000:2.0:1788201690.338952:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431c00 00000100:00100000:1.0:1788201690.396248:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201690.398312:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559758592 00000100:00100000:0.0:1788201690.398329:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559758592 00002000:00100000:0.0:1788201690.398592:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (168820736->169869311) req@ffff9623bb433100 x1875064559758592/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.398627:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb433100 with x1875064559758592 ext(168820736->169869311) 00002000:00010000:0.0:1788201690.398634:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb433100 00000100:00100000:0.0:1788201690.398679:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1232 00000100:00100000:0.0:1788201690.398690:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+74:2342:x1875064559758592:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201690.408391:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+76:2342:x1875064559758592:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9686us (12142us total) trans 30064772233 rc 0/0 00000100:00100000:0.0:1788201690.408417:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1232 00002000:00100000:0.0:1788201690.408433:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (168820736->169869311) req@ffff9623bb433100 x1875064559758592/t30064772233(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.408454:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb433100 with x1875064559758592 ext(168820736->169869311) 00002000:00010000:0.0:1788201690.408462:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb433100 00000100:00100000:2.0:1788201690.465103:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201690.465263:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559758720 00000100:00100000:0.0:1788201690.465274:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559758720 00002000:00100000:0.0:1788201690.465380:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (169869312->170917887) req@ffff9624c1e73480 x1875064559758720/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.465392:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73480 with x1875064559758720 ext(169869312->170917887) 00002000:00010000:0.0:1788201690.465400:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73480 00000100:00100000:0.0:1788201690.465468:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1233 00000100:00100000:0.0:1788201690.465480:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+76:2343:x1875064559758720:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201690.471854:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+78:2343:x1875064559758720:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 6361us (6750us total) trans 30064772234 rc 0/0 00000100:00100000:0.0:1788201690.471869:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1233 00002000:00100000:0.0:1788201690.471901:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (169869312->170917887) req@ffff9624c1e73480 x1875064559758720/t30064772234(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.471912:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73480 with x1875064559758720 ext(169869312->170917887) 00002000:00010000:0.0:1788201690.471919:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73480 00000100:00100000:2.0:1788201690.532542:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201690.532747:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559758848 00000100:00100000:3.0:1788201690.532760:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559758848 00002000:00100000:3.0:1788201690.532841:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (170917888->171966463) req@ffff9624c1e72680 x1875064559758848/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201690.532853:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72680 with x1875064559758848 ext(170917888->171966463) 00002000:00010000:3.0:1788201690.532860:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72680 00000100:00100000:3.0:1788201690.532971:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1234 00000100:00100000:3.0:1788201690.532984:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+78:2342:x1875064559758848:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201690.542914:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+80:2342:x1875064559758848:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9918us (10368us total) trans 30064772235 rc 0/0 00000100:00100000:0.0:1788201690.542932:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1234 00002000:00100000:0.0:1788201690.542949:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (170917888->171966463) req@ffff9624c1e72680 x1875064559758848/t30064772235(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.542962:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72680 with x1875064559758848 ext(170917888->171966463) 00002000:00010000:0.0:1788201690.542968:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72680 00000100:00100000:2.0:1788201690.586327:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201690.586466:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559758976 00000100:00100000:0.0:1788201690.586478:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559758976 00002000:00100000:0.0:1788201690.586544:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (171966464->173015039) req@ffff9624c1e72d80 x1875064559758976/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.586557:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72d80 with x1875064559758976 ext(171966464->173015039) 00002000:00010000:0.0:1788201690.586563:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72d80 00000100:00100000:0.0:1788201690.586667:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1235 00000100:00100000:0.0:1788201690.586679:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+80:2341:x1875064559758976:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201690.599295:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+82:2341:x1875064559758976:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12604us (12969us total) trans 30064772236 rc 0/0 00000100:00100000:0.0:1788201690.599313:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1235 00002000:00100000:0.0:1788201690.599466:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (171966464->173015039) req@ffff9624c1e72d80 x1875064559758976/t30064772236(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.599499:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e72d80 with x1875064559758976 ext(171966464->173015039) 00002000:00010000:0.0:1788201690.599505:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e72d80 00000100:00100000:1.0:1788201690.650168:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201690.650248:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559759104 00000100:00100000:0.0:1788201690.650262:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559759104 00002000:00100000:0.0:1788201690.650329:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (173015040->174063615) req@ffff9623bb430a80 x1875064559759104/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.650374:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb430a80 with x1875064559759104 ext(173015040->174063615) 00002000:00010000:0.0:1788201690.650381:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb430a80 00000100:00100000:0.0:1788201690.650423:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1236 00000100:00100000:0.0:1788201690.650437:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+82:2342:x1875064559759104:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201690.656552:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+84:2342:x1875064559759104:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 6105us (6382us total) trans 30064772237 rc 0/0 00000100:00100000:0.0:1788201690.656569:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1236 00002000:00100000:0.0:1788201690.656584:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (173015040->174063615) req@ffff9623bb430a80 x1875064559759104/t30064772237(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.656596:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb430a80 with x1875064559759104 ext(173015040->174063615) 00002000:00010000:0.0:1788201690.656604:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb430a80 00000100:00100000:1.0:1788201690.720976:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201690.721159:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559759232 00000100:00100000:2.0:1788201690.721169:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559759232 00002000:00100000:2.0:1788201690.721219:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (174063616->175112191) req@ffff9623bb433b80 x1875064559759232/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201690.721231:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb433b80 with x1875064559759232 ext(174063616->175112191) 00002000:00010000:2.0:1788201690.721237:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb433b80 00000100:00100000:2.0:1788201690.721325:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1237 00000100:00100000:2.0:1788201690.721337:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+84:2343:x1875064559759232:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201690.726429:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+86:2343:x1875064559759232:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 5083us (5450us total) trans 30064772238 rc 0/0 00000100:00100000:2.0:1788201690.726443:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1237 00002000:00100000:2.0:1788201690.726457:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (174063616->175112191) req@ffff9623bb433b80 x1875064559759232/t30064772238(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201690.726468:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb433b80 with x1875064559759232 ext(174063616->175112191) 00002000:00010000:2.0:1788201690.726475:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb433b80 00000100:00100000:3.0:1788201690.794472:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201690.794663:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559759360 00000100:00100000:0.0:1788201690.794672:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559759360 00002000:00100000:0.0:1788201690.794723:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (175112192->176160767) req@ffff9623bb561f80 x1875064559759360/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.794734:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561f80 with x1875064559759360 ext(175112192->176160767) 00002000:00010000:0.0:1788201690.794740:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561f80 00000100:00100000:0.0:1788201690.794789:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1238 00000100:00100000:0.0:1788201690.794799:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+86:2343:x1875064559759360:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201690.812166:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+88:2343:x1875064559759360:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17345us (17680us total) trans 30064772239 rc 0/0 00000100:00100000:0.0:1788201690.812183:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1238 00002000:00100000:0.0:1788201690.812201:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (175112192->176160767) req@ffff9623bb561f80 x1875064559759360/t30064772239(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.812214:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561f80 with x1875064559759360 ext(175112192->176160767) 00002000:00010000:0.0:1788201690.812222:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561f80 00000100:00100000:1.0:1788201690.895237:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201690.895577:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559759488 00000100:00100000:0.0:1788201690.895591:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559759488 00002000:00100000:0.0:1788201690.895663:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (176160768->177209343) req@ffff9623bb431880 x1875064559759488/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.895677:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431880 with x1875064559759488 ext(176160768->177209343) 00002000:00010000:0.0:1788201690.895684:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431880 00000100:00100000:0.0:1788201690.895728:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1239 00000100:00100000:0.0:1788201690.895742:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+88:2344:x1875064559759488:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201690.907889:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+90:2344:x1875064559759488:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 12136us (12652us total) trans 30064772240 rc 0/0 00000100:00100000:0.0:1788201690.907905:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1239 00002000:00100000:0.0:1788201690.907920:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (176160768->177209343) req@ffff9623bb431880 x1875064559759488/t30064772240(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.907931:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431880 with x1875064559759488 ext(176160768->177209343) 00002000:00010000:0.0:1788201690.907951:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431880 00010000:00010000:1.0:1788201690.935058:0:16319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201690.957293:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201690.958088:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559759616 00000100:00100000:0.0:1788201690.958102:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559759616 00002000:00100000:0.0:1788201690.958167:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (177209344->178257919) req@ffff9624c1e71180 x1875064559759616/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/0 e 0 to 0 dl 1788201701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.958180:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71180 with x1875064559759616 ext(177209344->178257919) 00002000:00010000:0.0:1788201690.958186:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71180 00000100:00100000:0.0:1788201690.958231:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1240 00000100:00100000:0.0:1788201690.958242:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+90:2342:x1875064559759616:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201690.975626:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+92:2342:x1875064559759616:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 17369us (18330us total) trans 30064772241 rc 0/0 00000100:00100000:0.0:1788201690.975644:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1240 00002000:00100000:0.0:1788201690.975659:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (177209344->178257919) req@ffff9624c1e71180 x1875064559759616/t30064772241(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:56/0 lens 488/448 e 0 to 0 dl 1788201701 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201690.975671:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71180 with x1875064559759616 ext(177209344->178257919) 00002000:00010000:0.0:1788201690.975678:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71180 00000100:00100000:2.0:1788201691.017993:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201691.018410:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559759744 00000100:00100000:0.0:1788201691.018424:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559759744 00002000:00100000:0.0:1788201691.018553:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (178257920->179306495) req@ffff9624c1e71c00 x1875064559759744/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/0 e 0 to 0 dl 1788201702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201691.018567:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71c00 with x1875064559759744 ext(178257920->179306495) 00002000:00010000:0.0:1788201691.018574:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71c00 00000100:00100000:0.0:1788201691.018620:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1241 00000100:00100000:0.0:1788201691.018632:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+92:2341:x1875064559759744:12345-192.168.201.56@tcp:4:iozone.0 00000100:00080000:2.0:1788201691.019704:0:5821:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201691.028095:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+94:2341:x1875064559759744:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 9450us (10102us total) trans 30064772242 rc 0/0 00000100:00100000:0.0:1788201691.028111:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1241 00002000:00100000:0.0:1788201691.028127:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (178257920->179306495) req@ffff9624c1e71c00 x1875064559759744/t30064772242(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/448 e 0 to 0 dl 1788201702 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201691.028140:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e71c00 with x1875064559759744 ext(178257920->179306495) 00002000:00010000:0.0:1788201691.028147:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e71c00 00000100:00100000:1.0:1788201691.085409:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201691.085634:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559759872 00000100:00100000:3.0:1788201691.085647:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559759872 00002000:00100000:3.0:1788201691.085714:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (179306496->180355071) req@ffff9623bb432a00 x1875064559759872/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/0 e 0 to 0 dl 1788201702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201691.085726:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb432a00 with x1875064559759872 ext(179306496->180355071) 00002000:00010000:3.0:1788201691.085733:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb432a00 00000100:00100000:3.0:1788201691.085834:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1242 00000100:00100000:3.0:1788201691.085847:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+94:2343:x1875064559759872:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201691.102736:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+96:2343:x1875064559759872:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 16876us (17327us total) trans 30064772243 rc 0/0 00000100:00100000:0.0:1788201691.102754:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1242 00002000:00100000:0.0:1788201691.102771:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (179306496->180355071) req@ffff9623bb432a00 x1875064559759872/t30064772243(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/448 e 0 to 0 dl 1788201702 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201691.102784:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb432a00 with x1875064559759872 ext(179306496->180355071) 00002000:00010000:0.0:1788201691.102791:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb432a00 00000100:00100000:1.0:1788201691.160580:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201691.160927:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559760000 00000100:00100000:0.0:1788201691.160941:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559760000 00002000:00100000:0.0:1788201691.161069:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (180355072->181403647) req@ffff9623bb431180 x1875064559760000/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/0 e 0 to 0 dl 1788201702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201691.161083:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431180 with x1875064559760000 ext(180355072->181403647) 00002000:00010000:0.0:1788201691.161089:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431180 00000100:00100000:0.0:1788201691.161458:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1243 00000100:00100000:0.0:1788201691.161471:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+96:2344:x1875064559760000:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201691.169684:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+98:2344:x1875064559760000:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8199us (9101us total) trans 30064772244 rc 0/0 00000100:00100000:1.0:1788201691.169701:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1243 00002000:00100000:1.0:1788201691.169718:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (180355072->181403647) req@ffff9623bb431180 x1875064559760000/t30064772244(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/448 e 0 to 0 dl 1788201702 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201691.169751:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb431180 with x1875064559760000 ext(180355072->181403647) 00002000:00010000:1.0:1788201691.169759:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb431180 00000100:00100000:0.0:1788201691.227111:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201691.227633:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559760128 00000100:00100000:2.0:1788201691.227647:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559760128 00002000:00100000:2.0:1788201691.227713:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (181403648->182452223) req@ffff962382b14e00 x1875064559760128/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/0 e 0 to 0 dl 1788201702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201691.227727:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14e00 with x1875064559760128 ext(181403648->182452223) 00002000:00010000:2.0:1788201691.227734:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14e00 00000100:00100000:2.0:1788201691.227771:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1244 00000100:00100000:2.0:1788201691.227784:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+98:2343:x1875064559760128:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:2.0:1788201691.243428:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+100:2343:x1875064559760128:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 15638us (16322us total) trans 30064772245 rc 0/0 00000100:00100000:2.0:1788201691.243442:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1244 00002000:00100000:2.0:1788201691.243454:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (181403648->182452223) req@ffff962382b14e00 x1875064559760128/t30064772245(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/448 e 0 to 0 dl 1788201702 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201691.243465:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b14e00 with x1875064559760128 ext(181403648->182452223) 00002000:00010000:2.0:1788201691.243471:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b14e00 00000100:00100000:3.0:1788201691.289679:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201691.289781:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559760256 00000100:00100000:1.0:1788201691.289798:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559760256 00002000:00100000:1.0:1788201691.289858:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (182452224->183500799) req@ffff9623bb561880 x1875064559760256/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/0 e 0 to 0 dl 1788201702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201691.289869:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561880 with x1875064559760256 ext(182452224->183500799) 00002000:00010000:1.0:1788201691.289875:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561880 00000100:00100000:1.0:1788201691.289977:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1245 00000100:00100000:1.0:1788201691.289987:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9623bb561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+100:2344:x1875064559760256:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201691.296287:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9623bb561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+102:2344:x1875064559760256:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 6289us (6612us total) trans 30064772246 rc 0/0 00000100:00100000:0.0:1788201691.296300:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1245 00002000:00100000:0.0:1788201691.296314:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (182452224->183500799) req@ffff9623bb561880 x1875064559760256/t30064772246(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/448 e 0 to 0 dl 1788201702 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201691.296335:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9623bb561880 with x1875064559760256 ext(182452224->183500799) 00002000:00010000:0.0:1788201691.296363:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9623bb561880 00000100:00100000:2.0:1788201691.345858:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201691.346057:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559760384 00000100:00100000:0.0:1788201691.346075:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559760384 00002000:00100000:0.0:1788201691.346298:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (183500800->184549375) req@ffff9624c1e73100 x1875064559760384/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/0 e 0 to 0 dl 1788201702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201691.346312:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73100 with x1875064559760384 ext(183500800->184549375) 00002000:00010000:0.0:1788201691.346319:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73100 00000100:00100000:0.0:1788201691.346524:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1246 00000100:00100000:0.0:1788201691.346539:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+102:2343:x1875064559760384:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201691.354278:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+104:2343:x1875064559760384:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 7731us (8417us total) trans 30064772247 rc 0/0 00000100:00100000:0.0:1788201691.354294:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1246 00002000:00100000:0.0:1788201691.354309:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (183500800->184549375) req@ffff9624c1e73100 x1875064559760384/t30064772247(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/448 e 0 to 0 dl 1788201702 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201691.354322:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73100 with x1875064559760384 ext(183500800->184549375) 00002000:00010000:0.0:1788201691.354329:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73100 00000100:00100000:3.0:1788201691.410782:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201691.411080:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559760512 00000100:00100000:0.0:1788201691.411093:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559760512 00002000:00100000:0.0:1788201691.411173:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (184549376->185597951) req@ffff9624ba859880 x1875064559760512/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/0 e 0 to 0 dl 1788201702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201691.411188:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba859880 with x1875064559760512 ext(184549376->185597951) 00002000:00010000:0.0:1788201691.411194:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba859880 00000100:00100000:0.0:1788201691.411243:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1247 00000100:00100000:0.0:1788201691.411254:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+104:2344:x1875064559760512:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201691.421425:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+106:2344:x1875064559760512:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 10159us (10646us total) trans 30064772248 rc 0/0 00000100:00100000:1.0:1788201691.421437:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1247 00002000:00100000:1.0:1788201691.421450:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (184549376->185597951) req@ffff9624ba859880 x1875064559760512/t30064772248(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/448 e 0 to 0 dl 1788201702 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201691.421459:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba859880 with x1875064559760512 ext(184549376->185597951) 00002000:00010000:1.0:1788201691.421465:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba859880 00000100:00100000:0.0:1788201691.476189:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1788201691.476266:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559760640 00000100:00100000:2.0:1788201691.476278:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559760640 00002000:00100000:2.0:1788201691.476379:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (185597952->186646527) req@ffff962382b16d80 x1875064559760640/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/0 e 0 to 0 dl 1788201702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201691.476391:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b16d80 with x1875064559760640 ext(185597952->186646527) 00002000:00010000:2.0:1788201691.476398:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b16d80 00000100:00100000:2.0:1788201691.476432:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1248 00000100:00100000:2.0:1788201691.476443:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962382b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+106:2343:x1875064559760640:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201691.482845:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962382b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+108:2343:x1875064559760640:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 6389us (6657us total) trans 30064772249 rc 0/0 00000100:00100000:0.0:1788201691.482861:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1248 00002000:00100000:0.0:1788201691.482878:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (185597952->186646527) req@ffff962382b16d80 x1875064559760640/t30064772249(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/448 e 0 to 0 dl 1788201702 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201691.482890:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff962382b16d80 with x1875064559760640 ext(185597952->186646527) 00002000:00010000:0.0:1788201691.482898:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962382b16d80 00000100:00100000:3.0:1788201691.540405:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1788201691.540509:0:17700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559760768 00000100:00100000:1.0:1788201691.540529:0:17700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559760768 00002000:00100000:1.0:1788201691.540616:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (186646528->187695103) req@ffff9624ba85b100 x1875064559760768/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/0 e 0 to 0 dl 1788201702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201691.540630:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85b100 with x1875064559760768 ext(186646528->187695103) 00002000:00010000:1.0:1788201691.540637:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85b100 00000100:00100000:1.0:1788201691.540688:0:17700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1249 00000100:00100000:1.0:1788201691.540699:0:17700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+108:2344:x1875064559760768:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:1.0:1788201691.549154:0:17700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624ba85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:986744c8-ee81-4a47-8d91-97f81ede1f3e+110:2344:x1875064559760768:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 8440us (8743us total) trans 30064772250 rc 0/0 00000100:00100000:1.0:1788201691.549172:0:17700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1249 00002000:00100000:1.0:1788201691.549190:0:17700:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (186646528->187695103) req@ffff9624ba85b100 x1875064559760768/t30064772250(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/448 e 0 to 0 dl 1788201702 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201691.549203:0:17700:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba85b100 with x1875064559760768 ext(186646528->187695103) 00002000:00010000:1.0:1788201691.549211:0:17700:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba85b100 00000100:00100000:2.0:1788201691.592155:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201691.592272:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559760896 00000100:00100000:0.0:1788201691.592281:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559760896 00002000:00100000:0.0:1788201691.592329:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (187695104->188743679) req@ffff9624c1e70a80 x1875064559760896/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/0 e 0 to 0 dl 1788201702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201691.592368:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70a80 with x1875064559760896 ext(187695104->188743679) 00002000:00010000:0.0:1788201691.592375:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70a80 00000100:00100000:0.0:1788201691.592445:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1250 00000100:00100000:0.0:1788201691.592456:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+110:2344:x1875064559760896:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201691.597229:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:986744c8-ee81-4a47-8d91-97f81ede1f3e+112:2344:x1875064559760896:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 4765us (5073us total) trans 30064772251 rc 0/0 00000100:00100000:0.0:1788201691.597252:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1250 00002000:00100000:0.0:1788201691.597265:0:6675:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (187695104->188743679) req@ffff9624c1e70a80 x1875064559760896/t30064772251(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/448 e 0 to 0 dl 1788201702 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201691.597275:0:6675:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e70a80 with x1875064559760896 ext(187695104->188743679) 00002000:00010000:0.0:1788201691.597281:0:6675:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e70a80 00000100:00100000:2.0:1788201691.637498:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1788201691.637554:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559761024 00000100:00100000:0.0:1788201691.637564:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559761024 00002000:00100000:0.0:1788201691.637614:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (188743680->189792255) req@ffff9624c1e73b80 x1875064559761024/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/0 e 0 to 0 dl 1788201702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201691.637626:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73b80 with x1875064559761024 ext(188743680->189792255) 00002000:00010000:0.0:1788201691.637631:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73b80 00000100:00100000:0.0:1788201691.637667:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1251 00000100:00100000:0.0:1788201691.637676:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624c1e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+112:2343:x1875064559761024:12345-192.168.201.56@tcp:4:iozone.0 00000100:00100000:0.0:1788201691.645276:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624c1e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:986744c8-ee81-4a47-8d91-97f81ede1f3e+114:2343:x1875064559761024:12345-192.168.201.56@tcp:4:iozone.0 Request processed in 7591us (7777us total) trans 30064772252 rc 0/0 00000100:00100000:0.0:1788201691.645292:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1251 00002000:00100000:0.0:1788201691.645305:0:6676:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (188743680->189792255) req@ffff9624c1e73b80 x1875064559761024/t30064772252(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/448 e 0 to 0 dl 1788201702 ref 1 fl Complete:/600/0 rc 0/0 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201691.645316:0:6676:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624c1e73b80 with x1875064559761024 ext(188743680->189792255) 00002000:00010000:0.0:1788201691.645584:0:6676:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624c1e73b80 00000100:00100000:2.0:1788201691.704212:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1788201691.704338:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064559761152 00000100:00100000:3.0:1788201691.704362:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064559761152 00002000:00100000:3.0:1788201691.704412:0:6674:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (189792256->190840831) req@ffff9624ba43a680 x1875064559761152/t0(0) o4->986744c8-ee81-4a47-8d91-97f81ede1f3e@192.168.201.56@tcp:57/0 lens 488/0 e 0 to 0 dl 1788201702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'iozone.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201691.704422:0:6674:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9624ba43a680 with x1875064559761152 ext(189792256->190840831) 00002000:00010000:3.0:1788201691.704439:0:6674:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624ba43a680 00000100:00100000:3.0:1788201691.704467:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1252 00000100:00100000:3.0:1788201691.704477:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624ba43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:986744c8-ee81-4a47-8d91-97f81ede1f3e+114:2344:x1875064559761152:12345-192.168.201.56@tcp:4:iozone.0 Debug log: 48120 lines, 48120 kept, 0 dropped, 0 bad.